NEW YORK (AP) Artificial intelligence imaging can be used to create art, try on clothes in virtual fitting rooms or help design advertising campaigns.
But experts fear the darker side of the easily accessible tools could worsen something that primarily harms women: nonconsensual deepfake pornography.
Deepfakes are videos and images that have been digitally created or altered with artificial intelligence or machine learning. Porn created using the technology first began spreading across the internet several years ago when a Reddit user shared clips that placed the faces of female celebrities on the shoulders of porn actors.
Since then, deepfake creators have disseminated similar videos and images targeting online influencers, journalists and others with a public profile. Thousands of videos exist across a plethora of websites. And some have been offering users the opportunity to create their own images essentially allowing anyone to turn whoever they wish into sexual fantasies without their consent, or use the technology to harm former partners.
The problem, experts say, grew as it became easier to make sophisticated and visually compelling deepfakes. And they say it could get worse with the development of generative AI tools that are trained on billions of images from the internet and spit out novel content using existing data.
The reality is that the technology will continue to proliferate, will continue to develop and will continue to become sort of as easy as pushing the button, said Adam Dodge, the founder of EndTAB, a group that provides trainings on technology-enabled abuse. And as long as that happens, people will undoubtedly ... continue to misuse that technology to harm others, primarily through online sexual violence, deepfake pornography and fake nude images.
Noelle Martin, of Perth, Australia, has experienced that reality. The 28-year-old found deepfake porn of herself 10 years ago when out of curiosity one day she used Google to search an image of herself. To this day, Martin says she doesnt know who created the fake images, or videos of her engaging in sexual intercourse that she would later find. She suspects someone likely took a picture posted on her social media page or elsewhere and doctored it into porn.
Horrified, Martin contacted different websites for a number of years in an effort to get the images taken down. Some didnt respond. Others took it down but she soon found it up again.
You cannot win, Martin said. This is something that is always going to be out there. Its just like its forever ruined you.
The more she spoke out, she said, the more the problem escalated. Some people even told her the way she dressed and posted images on social media contributed to the harassment essentially blaming her for the images instead of the creators.
Eventually, Martin turned her attention towards legislation, advocating for a national law in Australia that would fine companies 555,000 Australian dollars ($370,706) if they dont comply with removal notices for such content from online safety regulators.
But governing the internet is next to impossible when countries have their own laws for content thats sometimes made halfway around the world. Martin, currently an attorney and legal researcher at the University of Western Australia, says she believes the problem has to be controlled through some sort of global solution.
In the meantime, some AI models say theyre already curbing access to explicit images.
OpenAI says it removed explicit content from data used to train the image generating tool DALL-E, which limits the ability of users to create those types of images. The company also filters requests and says it blocks users from creating AI images of celebrities and prominent politicians. Midjourney, another model, blocks the use of certain keywords and encourages users to flag problematic images to moderators.
Meanwhile, the startup Stability AI rolled out an update in November that removes the ability to create explicit images using its image generator Stable Diffusion. Those changes came following reports that some users were creating celebrity inspired nude pictures using the technology.
Stability AI spokesperson Motez Bishara said the filter uses a combination of keywords and other techniques like image recognition to detect nudity and returns a blurred image. But its possible for users to manipulate the software and generate what they want since the company releases its code to the public. Bishara said Stability AIs license extends to third-party applications built on Stable Diffusion and strictly prohibits any misuse for illegal or immoral purposes.
Some social media companies have also been tightening up their rules to better protect their platforms against harmful materials.
TikTok said last month all deepfakes or manipulated content that show realistic scenes must be labeled to indicate theyre fake or altered in some way, and that deepfakes of private figures and young people are no longer allowed. Previously, the company had barred sexually explicit content and deepfakes that mislead viewers about real-world events and cause harm.
The gaming platform Twitch also recently updated its policies around explicit deepfake images after a popular streamer named Atrioc was discovered to have a deepfake porn website open on his browser during a livestream in late January. The site featured phony images of fellow Twitch streamers.
Twitch already prohibited explicit deepfakes, but now showing a glimpse of such content even if its intended to express outrage will be removed and will result in an enforcement, the company wrote in a blog post. And intentionally promoting, creating or sharing the material is grounds for an instant ban.
Other companies have also tried to ban deepfakes from their platforms, but keeping them off requires diligence.
Apple and Google said recently they removed an app from their app stores that was running sexually suggestive deepfake videos of actresses to market the product. Research into deepfake porn is not prevalent, but one report released in 2019 by the AI firm DeepTrace Labs found it was almost entirely weaponized against women and the most targeted individuals were western actresses, followed by South Korean K-pop singers.
The same app removed by Google and Apple had run ads on Metas platform, which includes Facebook, Instagram and Messenger. Meta spokesperson Dani Lever said in a statement the companys policy restricts both AI-generated and non-AI adult content and it has restricted the apps page from advertising on its platforms.
In February, Meta, as well as adult sites like OnlyFans and Pornhub, began participating in an online tool, called Take It Down, that allows teens to report explicit images and videos of themselves from the internet. The reporting site works for regular images, and AI-generated content which has become a growing concern for child safety groups.
When people ask our senior leadership what are the boulders coming down the hill that were worried about? The first is end-to-end encryption and what that means for child protection. And then second is AI and specifically deepfakes, said Gavin Portnoy, a spokesperson for the National Center for Missing and Exploited Children, which operates the Take It Down tool.
We have not ... been able to formulate a direct response yet to it, Portnoy said.
Original post:
Deepfake porn could be a growing problem amid AI race - The Associated Press
- European parliament prepares tough measures over use of AI - Financial Times [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Nvidia stock surges on dominant A.I. market position, buy recommendation from HSBC - Fox Business [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Bloomberg plans to integrate GPT-style A.I. into its terminal - CNBC [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Workforce ecosystems and AI - Brookings Institution [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Adobe Lightroom AI Feature Tackles a Massive Problem With Photos - CNET [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- How artificial intelligence is matching drugs to patients - BBC [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- These are the tech jobs most threatened by ChatGPT and A.I. - CNBC [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Elon Musk Launches X.AI To Fight ChatGPT Woke AI, Says Twitter Is Breakeven - Forbes [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Two late iconic Israeli singers have been resurrected via AI for a ... - JTA News - Jewish Telegraphic Agency [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- AI anxiety: The workers who fear losing their jobs to artificial ... - BBC [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Grandma exploit tricks Discords AI chatbot into breaking its rules - Polygon [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Commonwealth joins forces with global tech organisations to ... - Commonwealth [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- The power players of retail transformation: IoT, 5G, and AI/ML on Microsoft Cloud - CIO [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- AI is the word as Alphabet and Meta get ready for earnings - MarketWatch [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Purdue launches nation's first Institute of Physical AI (IPAI), recruiting ... - Purdue University [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Will AI ever reach human-level intelligence? We asked 5 experts - The Conversation [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- The next arms race: China leverages AI for edge in future wars - The Japan Times [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Amazon Unleashes Bedrock: The Game-Changing AI Cloud Service Powering the Future of Tech - Yahoo Finance [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Atlassian taps OpenAI to make its collaboration software smarter - CNBC [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Dating an AI? Artificial Intelligence dating app founder predicts the future of AI relationships - Fox News [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Military Tech Execs Tell Congress an AI Pause Is 'Close to Impossible' - Gizmodo [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Philips Future Health Index shows providers plan to invest in AI - Healthcare Finance News [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Reddit Wants to Get Paid for Helping to Teach Big A.I. Systems - The New York Times [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- OpenAIs CEO Says the Age of Giant AI Models Is Already Over - WIRED [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- 9 Resources to Make the Most of Generative AI - WIRED [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Impact of AI on higher education panel event May 3 - Boise State University [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Microsoft reportedly working on its own AI chips that may rival Nvidia's - The Verge [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- Deepfake porn could be a growing problem amid AI race - The Associated Press [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- AI cameras: More than 2 on two-wheelers, even if children, will invite fine - Onmanorama [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- How artificial intelligence is matching drugs to patients - BBC [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- These are the tech jobs most threatened by ChatGPT and A.I. - CNBC [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- Will Generative AI Supplant or Supplement Hollywoods Workforce? - Variety [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- Marrying Human Interaction and AI with Navid Alipour - Healio [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- Competition authorities need to move fast and break up AI - Financial Times [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- 5 AI Projects to Try Right Now - IGN [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- Financial Services Will Embrace Generative AI Faster Than You Think - Andreessen Horowitz [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- Grandma exploit tricks Discords AI chatbot into breaking its rules - Polygon [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- US FTC leaders will target AI that violates civil rights or is deceptive - Reuters [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- Why open-source generative AI models are an ethical way forward ... - Nature.com [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- Religion against the machine: Pope Francis takes on AI - Euronews [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- Fujitsu launches AI platform Fujitsu Kozuchi, streamlining access to ... - Fujitsu [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- Commonwealth joins forces with global tech organisations to ... - Commonwealth [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- In this era of AI photography, I no longer believe my eyes - The Guardian [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- AI is the word as Alphabet and Meta get ready for earnings - MarketWatch [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- Google CEO Sundar Pichai warns society to brace for impact of A.I. acceleration, says its not for a company to decide' - CNBC [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- Purdue launches nation's first Institute of Physical AI (IPAI), recruiting ... - Purdue University [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- We soon wont tell the difference between AI and human music so can pop survive? - The Guardian [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- Atlassian brings an AI assistant to Jira and Confluence - TechCrunch [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- How DARPA wants to rethink the fundamentals of AI to include trust - The Register [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- Dating an AI? Artificial Intelligence dating app founder predicts the future of AI relationships - Fox News [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- Snapchat expands chatbot powered by ChatGPT to all users, creates AI-generated images - Fox Business [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- ChatGPT sparks AI investment bonanza - DW (English) [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- AI-generated spam may soon be flooding your inbox -- and it will be personalized to be especially persuasive - The Conversation [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- AI predictions for the new year - POLITICO - POLITICO [Last Updated On: August 18th, 2024] [Originally Added On: January 4th, 2024]
- Intel Hires HPE's Justin Hotard To Lead Data Center And AI Group - CRN [Last Updated On: August 18th, 2024] [Originally Added On: January 4th, 2024]
- At Morgan State, seeking AI that is both smart and fair - Baltimore Sun [Last Updated On: August 18th, 2024] [Originally Added On: January 4th, 2024]
- Opinion | A.I. Use by Law Enforcement Must Be Strictly Regulated - The New York Times [Last Updated On: August 18th, 2024] [Originally Added On: January 4th, 2024]
- UBS boosts AI revenue forecast by 40%, calls industry the 'tech theme of the decade' - CNBC [Last Updated On: August 18th, 2024] [Originally Added On: January 4th, 2024]
- AI is here and everywhere: 3 AI researchers look to the challenges ahead in 2024 - The Conversation Indonesia [Last Updated On: August 18th, 2024] [Originally Added On: January 4th, 2024]
- What software developers using ChatGPT can tell us about how it's changing work - Quartz [Last Updated On: August 18th, 2024] [Originally Added On: January 4th, 2024]
- AI and satellite data helped uncover the ocean's 'dark vessels' - Popular Science [Last Updated On: August 18th, 2024] [Originally Added On: January 4th, 2024]
- 2024 health tech budgets to be driven by AI tools, automation - STAT [Last Updated On: August 18th, 2024] [Originally Added On: January 4th, 2024]
- Samsung's new phones replace Google AI with Baidu in China - The Verge [Last Updated On: August 18th, 2024] [Originally Added On: January 28th, 2024]
- Researchers Say the Deepfake Biden Robocall Was Likely Made With Tools From AI Startup ElevenLabs - WIRED [Last Updated On: August 18th, 2024] [Originally Added On: January 28th, 2024]
- Satya Nadella says the explicit Taylor Swift AI fakes are 'alarming and terrible' - The Verge [Last Updated On: August 18th, 2024] [Originally Added On: January 28th, 2024]
- One month with Microsoft's AI vision of the future: Copilot Pro - The Verge [Last Updated On: August 18th, 2024] [Originally Added On: February 22nd, 2024]
- Nvidia's Q4 Earnings Blow Past Expectations as Company Benefits From AI Boom - Investopedia [Last Updated On: August 18th, 2024] [Originally Added On: February 22nd, 2024]
- HOUSE LAUNCHES BIPARTISAN TASK FORCE ON ARTIFICIAL INTELLIGENCE - Congressman Ted Lieu [Last Updated On: August 18th, 2024] [Originally Added On: February 22nd, 2024]
- What is AI governance? - Cointelegraph [Last Updated On: August 18th, 2024] [Originally Added On: February 22nd, 2024]
- Scale AI to set the Pentagon's path for testing and evaluating large language models - DefenseScoop [Last Updated On: August 18th, 2024] [Originally Added On: February 22nd, 2024]
- Can AI help us forecast extreme weather? - Vox.com [Last Updated On: August 18th, 2024] [Originally Added On: February 22nd, 2024]
- Google launches Gemini Business AI, adds $20 to the $6 Workspace bill - Ars Technica [Last Updated On: August 18th, 2024] [Originally Added On: February 22nd, 2024]
- AI and You: OpenAI's Sora Previews Text-to-Video Future, First Ivy League AI Degree - CNET [Last Updated On: August 18th, 2024] [Originally Added On: February 22nd, 2024]
- Tor Books Criticized for Use of AI-Generated Art in 'Gothikana' Cover Design - Publishers Weekly [Last Updated On: August 18th, 2024] [Originally Added On: February 22nd, 2024]
- Generative AI's environmental costs are soaring and mostly secret - Nature.com [Last Updated On: August 18th, 2024] [Originally Added On: February 22nd, 2024]
- Energy companies tap AI to detect defects in an aging grid - E&E News by POLITICO [Last Updated On: August 18th, 2024] [Originally Added On: February 22nd, 2024]
- Intel Launches World's First Systems Foundry Designed for the AI Era - Investor Relations :: Intel Corporation (INTC) [Last Updated On: August 18th, 2024] [Originally Added On: February 22nd, 2024]
- Google Just Released Two Open AI Models That Can Run on Laptops - Singularity Hub [Last Updated On: August 18th, 2024] [Originally Added On: February 22nd, 2024]
- AI agents like Rabbit aim to book your vacation and order your Uber - NPR [Last Updated On: August 18th, 2024] [Originally Added On: February 22nd, 2024]
- The Samsung Galaxy S23 series will get AI features in late March - The Verge [Last Updated On: August 18th, 2024] [Originally Added On: February 22nd, 2024]