Microsoft’s New Deepfake Detector Puts Reality to the Test – Singularity Hub

The upcoming US presidential election seems set to be something of a messto put it lightly. Covid-19 will likely deter millions from voting in person, and mail-in voting isnt shaping up to be much more promising. This all comes at a time when political tensions are running higher than they have in decades, issues that shouldnt be political (like mask-wearing) have become highly politicized, and Americans are dramatically divided along party lines.

So the last thing we need right now is yet another wrench in the spokes of democracy, in the form of disinformation; we all saw how that played out in 2016, and it wasnt pretty. For the record, disinformation purposely misleads people, while misinformation is simply inaccurate, but without malicious intent. While theres not a ton tech can do to make people feel safe at crowded polling stations or up the Postal Services budget, tech can help with disinformation, and Microsoft is trying to do so.

On Tuesday the company released two new tools designed to combat disinformation, described in a blog post by VP of Customer Security and Trust Tom Burt and Chief Scientific Officer Eric Horvitz.

The first is Microsoft Video Authenticator, which is made to detect deepfakes. In case youre not familiar with this wicked byproduct of AI progress, deepfakes refers to audio or visual files made using artificial intelligence that can manipulate peoples voices or likenesses to make it look like they said things they didnt. Editing a video to string together words and form a sentence someone didnt say doesnt count as a deepfake; though theres manipulation involved, you dont need a neural network and youre not generating any original content or footage.

The Authenticator analyzes videos or images and tells users the percentage chance that theyve been artificially manipulated. For videos, the tool can even analyze individual frames in real time.

Deepfake videos are made by feeding hundreds of hours of video of someone into a neural network, teaching the network the minutiae of the persons voice, pronunciation, mannerisms, gestures, etc. Its like when you do an imitation of your annoying coworker from accounting, complete with mimicking the way he makes every sentence sound like a question and his eyes widen when he talks about complex spreadsheets. Youve spent hoursno, monthsin his presence and have his personality quirks down pat. An AI algorithm that produces deepfakes needs to learn those same quirks, and more, about whoever the creators target is.

Given enough real information and examples, the algorithm can then generate its own fake footage, with deepfake creators using computer graphics and manually tweaking the output to make it as realistic as possible.

The scariest part? To make a deepfake, you dont need a fancy computer or even a ton of knowledge about software. There are open-source programs people can access for free online, and as far as finding video footage of famous peoplewell, weve got YouTube to thank for how easy that is.

Microsofts Video Authenticator can detect the blending boundary of a deepfake and subtle fading or greyscale elements that the human eye may not be able to see.

In the blog post, Burt and Horvitz point out that as time goes by, deepfakes are only going to get better and become harder to detect; after all, theyre generated by neural networks that are continuously learning from and improving themselves.

Microsofts counter-tactic is to come in from the opposite angle, that is, being able to confirm beyond doubt that a video, image, or piece of news is real (I mean, can McDonalds fries cure baldness? Did a seal slap a kayaker in the face with an octopus? Never has it been so imperative that the world know the truth).

A tool built into Microsoft Azure, the companys cloud computing service, lets content producers add digital hashes and certificates to their content, and a reader (which can be used as a browser extension) checks the certificates and matches the hashes to indicate the content is authentic.

Finally, Microsoft also launched an interactive Spot the Deepfake quiz it developed in collaboration with the University of Washingtons Center for an Informed Public, deepfake detection company Sensity, and USA Today. The quiz is intended to help people learn about synthetic media, develop critical media literacy skills, and gain awareness of the impact of synthetic media on democracy.

The impact Microsofts new tools will have remains to be seenbut hey, were glad theyre trying. And theyre not alone; Facebook, Twitter, and YouTube have all taken steps to ban and remove deepfakes from their sites. The AI Foundations Reality Defender uses synthetic media detection algorithms to identify fake content. Theres even a coalition of big tech companies teaming up to try to fight election interference.

One thing is for sure: between a global pandemic, widespread protests and riots, mass unemployment, a hobbled economy, and the disinformation thats remained rife through it all, were going to need all the help we can get to make it through not just the election, but the rest of the conga-line-of-catastrophes year that is 2020.

Image Credit: Darius BasharonUnsplash

View original post here:

Microsoft's New Deepfake Detector Puts Reality to the Test - Singularity Hub