Deepfakes are scarily simple to create. But will this technology create a reality of alternative facts where truth goes to die? No. Deepfakes are a technology, and more widespread abuse is expected with more widespread availability. Over time, we will adopt better transparency, better detection, and, most importantly, each of us users will become more aware and thus better equipped to fight the abuse of Deepfakes.
Deep Fakes are here to stay.
What are deepfakes?
Deepfakes are a way to manipulate images. Image manipulation is not new. Stalin removed Nikolai Yezhov from still images. Today, the underlying technology that creates deepfakes is Artificial Intelligence (AI). AI-supported deepfake technology offers improved capabilities - but it also increases the scale for manipulation and bad actor intervention. Starting with obvious examples: Check out this Tiktok compilation about Tom Cruise. FAKE. Or this video of Barack Obama calling Trump a total and complete dipshit. Also, FAKE. The list goes on. There was once a meme in which Nicolas Cage became the fake leading actor of a series of different movies (video compilation). Today, anyone can create a deepfake. No programming skills are needed. If youre interested in learning more about the technology behind deepfakes in detail, take a look at this Forbes article.
Deepfakes are widely used today - and theyre here to stay. Its AI and thus the same technology that helps read human emotions (for example, for people with Autism) or helps identify obstacles on the road (for example, a Duck Chase). Deepfakes are also used in Hollywood: Look no further than to the Star Wars empire, the de-aging in Marvel movies, or the Late Paul Walker in Fast & Furious 7. Deepfakes have the potential to replace high-end CGI, which would save millions of dollars and countless hours of processing time in filmmaking.
But then deepfakes can be - and are - abused. Unfortunately, this type of abuse of technology is nothing new. In my 2014 book Ask Measure Learn I wrote: [...] when email suddenly made it possible to communicate with large numbers of strangers for free, it immediately led to the problem of unsolicited commercial email, better known as spam. When computers could communicate openly through networks, it spawned viruses and Trojan horses. And now that we live in a society of social media channels and information on demand, this world has become flooded with phoney or even fraudulent information. Spam has grown into social spam. [...]
During the 2013 Strata Conference (video), I presented state-of-the-art, AI-driven Bot conversations and the ways to detect them. Our technology has evolved over the last decade, and in addition to fake emails, fake Amazon reviews, and fake bot conversations, we are now dealing with deepfakes. This is pretty annoying. But, on the bright side, the way to deal with this threat remains the same: detection, transparency, regulation, and education.
(1) Detection
A growing number of researchers are studying fake news or building technologies to identify deepfakes. Big Tech firms like Google, Microsoft, and Meta have openly condemned deepfake technology and are creating tools for recognizing them. Microsoft is creating new anti-deep-fake technology to fight misinformation (Microsoft Video Authenticator). YouTube, owned by Google, reiterated in February 2020 that it will not host deepfake videos related to the U.S. election, voting procedures, or the 2020 U.S. census.
With over Millions of dollars of awards, Meta's deepfake detector challenge has encouraged researchers and developers to create algorithms to fight deepfakes. The challenges launch came after releasing a large dataset of visual deepfakes produced in collaboration with Jigsaw, Googles internal technology incubator. In addition, the large dataset of deepfakes was incorporated into a benchmark made freely available to researchers for developing synthetic video detection systems.
In a rapidly evolving and attention-frenzy world, detecting deepfakes is even more important. However, we are nowhere close to distinguishing real content from fake. Some of the best tools out there are Counter.social, deeptrace, Reality Defender, and Sensity.ai (which claims to be the worlds first deepfake detection tool). Still, the best deepfake detector is still only 65% accurate. Even Azure Cognitive Services was fooled over 78% of the time.
The future of these detectors will likely mirror bot detectors, spam detectors, or any other cyber threat detectors. Each evolution will spark a counter-reaction. It will be an arms race, or put differently: future deepfake detection will be as good as your Email Spam Detector and we all know that we still get the SPAM from Nigerian princes in our inboxes.
(2) Transparency
Social networks have allowed us to connect with everyone. This new connectedness means every fringe opinion will find its audience. Lies and fake news have become a business model. Chaos and mistrust were the consequence. To instill trust, social media companies created verified accounts (for example in Twitter). In a world of deepfake abundance, verified accounts alone will not be not sufficient. For instance, even the verified RealDonaldTrump account tweeted a DeepFake of Pelosi, which was widely shared and re-shared. In order to eliminate second-order effects of social networks, a different level of transparency is required.
Perhaps, we can establish trust if we know the source of a given video? One proposition to combat deepfakes points to the usage of NFTs (Non-Fungible Tokens) as a possible solution: If everyone encrypted their videos as NFTs, it would be easy to find and compare different sources of the same moment.
(3) Regulation
Misuse of deepfakes without a clear identification should be outlawed - and regulators around the globe have started to take them seriously. Already in 2019, there were about a dozen federal- and state-level bills to regulate deepfakes. These laws range from criminalizing the use of a womans likeness in a pornographic film without her consent (Virginia Law), to the appropriate use of a deceased persons data (New York Law), and dealing with cheap fakes (low-tech digital frauds not requiring AI). When we look at how personal data is being used, and realize the value of a digital identity, it becomes clear that privacy is a key pillar of a digitally safe environment. To read more on this, see my take on privacy and data.
Spam and Fake news is nothing new.
(4) Education
Coming back to the Nigerian Prince. These scams typically start with an email. The fraudsters offer a share of a vast investment opportunity but, in turn, need some money from you. There are many different versions of this internet scam, and it keeps coming back. But, today, many wont fall for it anymore. Why? Because you have all heard about it (if not, you just did here). Education is the best protection. And just like with the Nigerian Prince, we need the same degree of education for deepfakes.
With that purpose in mind, Channel 4 in the UK created a deepfake of the Queens speech last Christmas. It was hilarious and brought deepfakes into the public discussion. For my course at Cornell, where I teach MBA candidates to design products that use Data and AI, we start each term with a 1min Video summary that Prithvi and I created to welcome the students to the course. Yes, its fun. But its also a reminder to all of us that great technology can be abused.
This article was written with Prithvi Sriram, who has not only been a student of the course, but also helped create toolkits that future students can use to get their hands on Deep Learning. He currently works at Infinitus Systems, a late series B healthcare startup, where he was the founding member of the analytics team.
Please see this Forbes article if you are looking for an overview of different Deep Learning tool sets for deepfakes.
Link:
Deepfakes - The Danger Of Artificial Intelligence That We Will Learn To Manage Better - Forbes
- Sleepwalkers Podcast: What Happens When Machines Find Their Creative Muse - WIRED [Last Updated On: November 30th, 2019] [Originally Added On: November 30th, 2019]
- Artificial Intelligence Will Facilitate Growth of Innovative Kinds of VR and AR Platforms - AiThority [Last Updated On: November 30th, 2019] [Originally Added On: November 30th, 2019]
- Manufacturing Leaders' Summit: Realising the promise of Artificial Intelligence - Manufacturer.com [Last Updated On: November 30th, 2019] [Originally Added On: November 30th, 2019]
- How Augmented Reality and Artificial Intelligence Are Helping Entrepreneurs Create a Better Customer Experience - Entrepreneur [Last Updated On: November 30th, 2019] [Originally Added On: November 30th, 2019]
- Global Director of Tech Exploration Discusses Artificial Intelligence and Machine Learning at Anheuser-Busch InBev - Seton Hall University News &... [Last Updated On: November 30th, 2019] [Originally Added On: November 30th, 2019]
- 2019 Artificial Intelligence in Precision Health - Dedication to Discuss & Analyze AI Products Related to Precision Healthcare Already Available -... [Last Updated On: November 30th, 2019] [Originally Added On: November 30th, 2019]
- SC Proposes Introduction Of Artificial Intelligence In Justice Delivery System - Inc42 Media [Last Updated On: November 30th, 2019] [Originally Added On: November 30th, 2019]
- Artificial intelligence will affect Salt Lake, Ogden more than most areas in the nation, study shows - KSL.com [Last Updated On: November 30th, 2019] [Originally Added On: November 30th, 2019]
- The Best Artificial Intelligence Stocks of 2019 -- and The Top AI Stock for 2020 - The Motley Fool [Last Updated On: November 30th, 2019] [Originally Added On: November 30th, 2019]
- It Pays To Break Artificial Intelligence Out Of The Lab, Study Confirms - Forbes [Last Updated On: November 30th, 2019] [Originally Added On: November 30th, 2019]
- Artificial intelligence in FX 'may be hype' - FX Week [Last Updated On: November 30th, 2019] [Originally Added On: November 30th, 2019]
- The Surprising Way Artificial Intelligence Is Transforming Transportation - Forbes [Last Updated On: November 30th, 2019] [Originally Added On: November 30th, 2019]
- Need a New Topic for Thanksgiving Dinner? How to Explain Artificial Intelligence (AI) to Anyone...and Make it Fun! - Forbes [Last Updated On: November 30th, 2019] [Originally Added On: November 30th, 2019]
- The Artificial Intelligence Industry and Global Challenges - Forbes [Last Updated On: November 30th, 2019] [Originally Added On: November 30th, 2019]
- Artificial Intelligence in 2020: The Architecture and the Infrastructure - Gigaom [Last Updated On: December 1st, 2019] [Originally Added On: December 1st, 2019]
- AI IN BANKING: Artificial intelligence could be a near $450 billion opportunity for banks - here are the strat - Business Insider India [Last Updated On: December 1st, 2019] [Originally Added On: December 1st, 2019]
- Seattle Seahawks Select Amazon In Utilizing Artificial Intelligence To Help Make Smarter Decisions On The Field - Forbes [Last Updated On: December 1st, 2019] [Originally Added On: December 1st, 2019]
- Fujifilm Showcases Artificial Intelligence Initiative And Advances at RSNA 2019 - Imaging Technology News [Last Updated On: December 1st, 2019] [Originally Added On: December 1st, 2019]
- The impact of artificial intelligence on humans - Bangkok Post [Last Updated On: December 1st, 2019] [Originally Added On: December 1st, 2019]
- Artificial intelligence gets to work in the automotive industry - Automotive World [Last Updated On: December 8th, 2019] [Originally Added On: December 8th, 2019]
- BioSig Technologies Announces New Collaboration on Development of Artificial Intelligence Solutions in Healthcare - GlobeNewswire [Last Updated On: December 8th, 2019] [Originally Added On: December 8th, 2019]
- Emotion Artificial Intelligence Market Business Opportunities and Forecast from 2019-2025 | Eyesight Technologies, Affectiva - The Connect Report [Last Updated On: December 8th, 2019] [Originally Added On: December 8th, 2019]
- Artificial intelligence-based fitness is promising but may not be for everyone - Livemint [Last Updated On: December 8th, 2019] [Originally Added On: December 8th, 2019]
- Opinion | The artificial intelligence frontier of economic theory - Livemint [Last Updated On: December 8th, 2019] [Originally Added On: December 8th, 2019]
- Pondering the Ethics of Artificial Intelligence in Health Care Kansas City Experts Team Up on Emerging - Flatland [Last Updated On: December 8th, 2019] [Originally Added On: December 8th, 2019]
- Baidu Leads the Way in Innovation with 5712 Artificial Intelligence Patent Applications - GlobeNewswire [Last Updated On: December 8th, 2019] [Originally Added On: December 8th, 2019]
- Artificial Intelligence and National Security, and More from CRS - Secrecy News [Last Updated On: December 8th, 2019] [Originally Added On: December 8th, 2019]
- Artificial intelligence: How to measure the I in AI - TechTalks [Last Updated On: December 8th, 2019] [Originally Added On: December 8th, 2019]
- 52 ideas that changed the world: 26. Artificial intelligence - The Week UK [Last Updated On: December 8th, 2019] [Originally Added On: December 8th, 2019]
- Longer Looks: The Psychology Of Voting; Overexcited Neurons And Artificial Intelligence; And More - Kaiser Health News [Last Updated On: December 8th, 2019] [Originally Added On: December 8th, 2019]
- Maximize The Promise And Minimize The Perils Of Artificial Intelligence (AI) - Forbes [Last Updated On: December 8th, 2019] [Originally Added On: December 8th, 2019]
- Will the next Mozart or Picasso come from artificial intelligence? No, but here's what might happen instead - Ladders [Last Updated On: December 8th, 2019] [Originally Added On: December 8th, 2019]
- China Will Outpace US Artificial Intelligence Capabilities, But Will It Win The Race? Not If We Care About Freedom - Forbes [Last Updated On: December 8th, 2019] [Originally Added On: December 8th, 2019]
- Artificial intelligence apps, Parkinsons and me - BBC News [Last Updated On: December 8th, 2019] [Originally Added On: December 8th, 2019]
- Artificial intelligence will affect Utah more than other states, new study says - Deseret News [Last Updated On: December 8th, 2019] [Originally Added On: December 8th, 2019]
- Aural Analytics Joins Consumer Technology Association Initiative to Set New Standards for Artificial Intelligence in Healthcare - Business Wire [Last Updated On: December 10th, 2019] [Originally Added On: December 10th, 2019]
- TECH 2019: stalls related to technology, artificial intelligence a big draw - The Hindu [Last Updated On: December 10th, 2019] [Originally Added On: December 10th, 2019]
- The Artificially Intelligent Investor: AI And The Future Of Stock Picking - Forbes [Last Updated On: December 10th, 2019] [Originally Added On: December 10th, 2019]
- Defining the Scope of an Artificial Intelligence Project - Toolbox [Last Updated On: December 10th, 2019] [Originally Added On: December 10th, 2019]
- Facebooks Jerome Pesenti Explains the Limitations of Artificial Intelligence Research - NullTX [Last Updated On: December 10th, 2019] [Originally Added On: December 10th, 2019]
- How AI Is Transforming The Art of Stock Picking - Analytics India Magazine [Last Updated On: December 10th, 2019] [Originally Added On: December 10th, 2019]
- Whistle Adds Artificial Intelligence and Workflow Automation to Guest Messaging Platform for Improved Hotel and Lodging Customer Service and Increased... [Last Updated On: December 10th, 2019] [Originally Added On: December 10th, 2019]
- Singapore BIGO Technology Integrates Artificial Intelligence Into Communication Apps for a Holistic and Immersive Experience for Users - Business Wire [Last Updated On: December 10th, 2019] [Originally Added On: December 10th, 2019]
- Commuter Benefits Company, Clarity Benefit Solutions, Gives Insight into Embracing Artificial Intelligence in Human Resources - PRNewswire [Last Updated On: December 10th, 2019] [Originally Added On: December 10th, 2019]
- THE AI IN TRANSPORTATION REPORT: How automakers can use artificial intelligence to cut costs, open new revenue - Business Insider India [Last Updated On: December 10th, 2019] [Originally Added On: December 10th, 2019]
- Chinese Association of Artificial Intelligence is hosting the 6th IEEE International Conference on the AI Pharos Pte Ltd co-organised Cloud Computing... [Last Updated On: December 10th, 2019] [Originally Added On: December 10th, 2019]
- VA launches National Artificial Intelligence Institute to drive research and development - FierceHealthcare [Last Updated On: December 10th, 2019] [Originally Added On: December 10th, 2019]
- SkyWatch Selected to Build Advanced Autonomous Space Systems Using Artificial Intelligence and Big Data Analytics for the Canadian Space Agency -... [Last Updated On: December 10th, 2019] [Originally Added On: December 10th, 2019]
- Microsoft tech expert warns of bias and sexism in artificial intelligence - The Age [Last Updated On: December 10th, 2019] [Originally Added On: December 10th, 2019]
- Artificial Intelligence as Security Solution and Weaponization by Hackers - CISO MAG [Last Updated On: December 10th, 2019] [Originally Added On: December 10th, 2019]
- Baidu Leads the Way in Innovation with 5,712 Artificial Intelligence Patent Applications - MarTech Series [Last Updated On: December 10th, 2019] [Originally Added On: December 10th, 2019]
- Finland seeks to teach 1% of Europeans basics on artificial intelligence - Reuters UK [Last Updated On: December 10th, 2019] [Originally Added On: December 10th, 2019]
- Artificial Intelligence (AI) in Supply Chain Market Worth $21.8 billion by 2027- Exclusive Report by Meticulous Research - GlobeNewswire [Last Updated On: December 10th, 2019] [Originally Added On: December 10th, 2019]
- What Veterans Affairs Aims to Accomplish Through Its Artificial Intelligence Institute - Nextgov [Last Updated On: December 10th, 2019] [Originally Added On: December 10th, 2019]
- The Bot Decade: How AI Took Over Our Lives in the 2010s - Popular Mechanics [Last Updated On: December 10th, 2019] [Originally Added On: December 10th, 2019]
- Benefits & Risks of Artificial Intelligence - Future of ... [Last Updated On: December 10th, 2019] [Originally Added On: December 10th, 2019]
- What is Artificial Intelligence? How Does AI Work? | Built In [Last Updated On: December 10th, 2019] [Originally Added On: December 10th, 2019]
- artificial intelligence | Definition, Examples, and ... [Last Updated On: December 10th, 2019] [Originally Added On: December 10th, 2019]
- Iktos and Almirall Announce Research Collaboration in Artificial Intelligence for New Drug Design - Business Wire [Last Updated On: December 17th, 2019] [Originally Added On: December 17th, 2019]
- Artificial Intelligence Job Demand Could Live Up to Hype - Dice Insights [Last Updated On: December 17th, 2019] [Originally Added On: December 17th, 2019]
- Artificial intelligence is writing the end of Beethoven's unfinished symphony - Euronews [Last Updated On: December 17th, 2019] [Originally Added On: December 17th, 2019]
- LTTE: It's important to know of weaponized artificial intelligence - Rocky Mountain Collegian [Last Updated On: December 17th, 2019] [Originally Added On: December 17th, 2019]
- 8 Artificial Intelligence, Machine Learning and Cloud Predictions To Watch in 2020 - Irish Tech News [Last Updated On: December 17th, 2019] [Originally Added On: December 17th, 2019]
- It's artificial intelligence to the rescue (and response and recovery) - GreenBiz [Last Updated On: December 17th, 2019] [Originally Added On: December 17th, 2019]
- Joint Artificial Intelligence Center Director tells Naval War College audience to 'Dive In' on AI - What'sUpNewp [Last Updated On: December 17th, 2019] [Originally Added On: December 17th, 2019]
- Tip: Seven recommendations for introducing artificial intelligence to your newsroom - Journalism.co.uk [Last Updated On: December 17th, 2019] [Originally Added On: December 17th, 2019]
- Boschs A.I.-powered tech could prevent accidents by staring at you - Digital Trends [Last Updated On: December 17th, 2019] [Originally Added On: December 17th, 2019]
- Schlumberger inks deal to expand artificial intelligence in the oil field - Chron [Last Updated On: December 17th, 2019] [Originally Added On: December 17th, 2019]
- Artificial Intelligence Isn't an Arms Race With China, and the United States Shouldn't Treat It Like One - Foreign Policy [Last Updated On: December 17th, 2019] [Originally Added On: December 17th, 2019]
- Beethovens unfinished tenth symphony to be completed by artificial intelligence - Classic FM [Last Updated On: December 17th, 2019] [Originally Added On: December 17th, 2019]
- Accountability is the key to ethical artificial intelligence, experts say - ComputerWeekly.com [Last Updated On: December 17th, 2019] [Originally Added On: December 17th, 2019]
- Artificial intelligence must be used with care - The Australian Financial Review [Last Updated On: December 17th, 2019] [Originally Added On: December 17th, 2019]
- Squirrel AI Learning Attends the Web Summit to Talk About the Application and Breakthrough of Artificial Intelligence in the Field of Education -... [Last Updated On: December 17th, 2019] [Originally Added On: December 17th, 2019]
- Top Artificial Intelligence Books Released In 2019 That You Must Read - Analytics India Magazine [Last Updated On: December 17th, 2019] [Originally Added On: December 17th, 2019]
- 12 Everyday Applications Of Artificial Intelligence Many People Aren't Aware Of - Forbes [Last Updated On: December 17th, 2019] [Originally Added On: December 17th, 2019]
- Artificial Intelligence might be a factor behind the Climate Change - Digital Information World [Last Updated On: December 21st, 2019] [Originally Added On: December 21st, 2019]
- Innovations in Artificial Intelligence-, Cloud-, and IoT-based Security, 2019 Research Report - ResearchAndMarkets.com - Business Wire [Last Updated On: December 21st, 2019] [Originally Added On: December 21st, 2019]
- Artificial intelligence predictions for 2020: 16 experts have their say - Verdict [Last Updated On: December 21st, 2019] [Originally Added On: December 21st, 2019]
- Tommie Experts: Ethically Educating on Artificial Intelligence at St. Thomas - University of St. Thomas Newsroom [Last Updated On: December 21st, 2019] [Originally Added On: December 21st, 2019]
- How Internet of Things and Artificial Intelligence pave the way to climate neutrality - EURACTIV [Last Updated On: December 21st, 2019] [Originally Added On: December 21st, 2019]