It took less than 24 hours for Twitter to corrupt an innocent AI chatbot. Yesterday, Microsoft unveiled Tay a Twitter bot that the company described as an experiment in "conversational understanding." The more you chat with Tay, said Microsoft, the smarter it gets, learning to engage people through "casual and playful conversation."
Unfortunately, the conversations didn't stay playful for long. Pretty soon after Tay launched, people starting tweeting the bot with all sorts of misogynistic, racist, and Donald Trumpist remarks. And Tay being essentially a robot parrot with an internet connection started repeating these sentiments back to users, proving correct that old programming adage: flaming garbage pile in, flaming garbage pile out.
Now, while these screenshots seem to show that Tay has assimilated the internet's worst tendencies into its personality, it's not quite as straightforward as that. Searching through Tay's tweets (more than 96,000 of them!) we can see that many of the bot's nastiest utterances have simply been the result of copying users. If you tell Tay to "repeat after me," it will allowing anybody to put words in the chatbot's mouth.
One of Tay's now deleted "repeat after me" tweets.
However, some of its weirder utterances have come out unprompted. The Guardian picked out a (now deleted) example when Tay was having an unremarkable conversation with one user (sample tweet: "new phone who dis?"), before it replied to the question "is Ricky Gervais an atheist?" by saying: "ricky gervais learned totalitarianism from adolf hitler, the inventor of atheism."
But while it seems that some of the bad stuff Tay is being told is sinking in, it's not like the bot has a coherent ideology. In the span of 15 hours Tay referred to feminism as a "cult" and a "cancer," as well as noting "gender equality = feminism" and "i love feminism now." Tweeting "Bruce Jenner" at the bot got similar mixed response, ranging from "caitlyn jenner is a hero & is a stunning, beautiful woman!" to the transphobic "caitlyn jenner isn't a real woman yet she won woman of the year?" (Neither of which were phrases Tay had been asked to repeat.)
It's unclear how much Microsoft prepared its bot for this sort of thing. The company's website notes that Tay has been built using "relevant public data" that has been "modeled, cleaned, and filtered," but it seems that after the chatbot went live filtering went out the window. The company starting cleaning up Tay's timeline this morning, deleting many of its most offensive remarks.
Tay's responses have turned the bot into a joke, but they raise serious questions
It's a joke, obviously, but there are serious questions to answer, like how are we going to teach AI using public data without incorporating the worst traits of humanity? If we create bots that mirror their users, do we care if their users are human trash? There are plenty of examples of technology embodying either accidentally or on purpose the prejudices of society, and Tay's adventures on Twitter show that even big corporations like Microsoft forget to take any preventative measures against these problems.
For Tay though, it all proved a bit too much, and just past midnight this morning, the bot called it a night:
In an emailed statement given later to Business Insider, Microsoft said: "The AI chatbot Tay is a machine learning project, designed for human engagement. As it learns, some of its responses are inappropriate and indicative of the types of interactions some people are having with it. We're making some adjustments to Tay."
Update March 24th, 6:50AM ET: Updated to note that Microsoft has been deleting some of Tay's offensive tweets.
Update March 24th, 10:52AM ET: Updated to include Microsoft's statement.
Verge Archives: Can we build a conscious computer?
See the rest here:
Twitter taught Microsofts AI chatbot to be a racist asshole in less ...
- Chapel Hill police: Parking dispute may have led to triple shooting [Last Updated On: February 12th, 2015] [Originally Added On: February 12th, 2015]
- Chapel Hill killings shine light on particular tensions between Islam and atheism [Last Updated On: February 12th, 2015] [Originally Added On: February 12th, 2015]
- Atheism and obesity - Main Page - Conservapedia [Last Updated On: February 12th, 2015] [Originally Added On: February 12th, 2015]
- Demographics of atheism - Wikipedia, the free encyclopedia [Last Updated On: February 12th, 2015] [Originally Added On: February 12th, 2015]
- Atheism - Main Page - Conservapedia [Last Updated On: February 12th, 2015] [Originally Added On: February 12th, 2015]
- science against atheism - Video [Last Updated On: February 12th, 2015] [Originally Added On: February 12th, 2015]
- Conversations Regarding Atheism & Theism - Video [Last Updated On: February 12th, 2015] [Originally Added On: February 12th, 2015]
- My Journey to Atheism - Part 5: Faith in God as an Adult - Video [Last Updated On: February 12th, 2015] [Originally Added On: February 12th, 2015]
- Russell Brand Rips Stephen Fry's Atheism - Video [Last Updated On: February 12th, 2015] [Originally Added On: February 12th, 2015]
- Book about Jaclyn Glenn @jaclynglenn #freespeech #atheism #freethought - Video [Last Updated On: February 12th, 2015] [Originally Added On: February 12th, 2015]
- Response to Atheism Episode 6 - Video [Last Updated On: February 12th, 2015] [Originally Added On: February 12th, 2015]
- Atheist Analysis S04 E07: Interview With Peter Boghossian/ Street Epistemology /Atheism Evangelism - Video [Last Updated On: February 12th, 2015] [Originally Added On: February 12th, 2015]
- Atheism Unleashed Presents.. 5 Stupid Questions... - Video [Last Updated On: February 12th, 2015] [Originally Added On: February 12th, 2015]
- Follow-up to "Defining Atheism" - Video [Last Updated On: February 12th, 2015] [Originally Added On: February 12th, 2015]
- Atheism Implodes Hard - Video [Last Updated On: February 12th, 2015] [Originally Added On: February 12th, 2015]
- God, Science & the Big Questions: Leading Christian Thinkers Respond to the New Atheism - Video [Last Updated On: February 12th, 2015] [Originally Added On: February 12th, 2015]
- Does Atheism Lead To A Bad Society? - Video [Last Updated On: February 12th, 2015] [Originally Added On: February 12th, 2015]
- Atheism vs India Revisited 9 - Video [Last Updated On: February 12th, 2015] [Originally Added On: February 12th, 2015]
- My Flavor of Atheism - Video [Last Updated On: February 12th, 2015] [Originally Added On: February 12th, 2015]
- Robert Richert 'Communicating Atheism' - Video [Last Updated On: February 12th, 2015] [Originally Added On: February 12th, 2015]
- My Testimony - from Atheism to Biblical Christian - Video [Last Updated On: February 12th, 2015] [Originally Added On: February 12th, 2015]
- How to Convert a Theist to Atheism - Video [Last Updated On: February 12th, 2015] [Originally Added On: February 12th, 2015]
- Materialism begets atheism removing inherent spiritualistic realization *Nouman Ali Khan* - Video [Last Updated On: February 12th, 2015] [Originally Added On: February 12th, 2015]
- Creation,Evolution, Christianity and Atheism - Video [Last Updated On: February 12th, 2015] [Originally Added On: February 12th, 2015]
- Atheism, World Religions 1 - Video [Last Updated On: February 12th, 2015] [Originally Added On: February 12th, 2015]
- A Short Talk About Christianity VS Atheism - Video [Last Updated On: February 13th, 2015] [Originally Added On: February 13th, 2015]
- The Rules Of Atheism - Video [Last Updated On: February 13th, 2015] [Originally Added On: February 13th, 2015]
- the point of atheism is non-violence - Video [Last Updated On: February 13th, 2015] [Originally Added On: February 13th, 2015]
- Reacting to `Atheism Leads to Suicide - Video [Last Updated On: February 13th, 2015] [Originally Added On: February 13th, 2015]
- 'The Atheist Experience' Responds To Me - Video [Last Updated On: February 13th, 2015] [Originally Added On: February 13th, 2015]
- Atheist Psychologist Admits Atheism is Unscientific - Video [Last Updated On: February 13th, 2015] [Originally Added On: February 13th, 2015]
- Understanding Atheism | Session 1 | Asadullah Ali - Video [Last Updated On: February 13th, 2015] [Originally Added On: February 13th, 2015]
- Atheism vs India Revisited 9a - Video [Last Updated On: February 13th, 2015] [Originally Added On: February 13th, 2015]
- How I Got Saved From Evolution/Atheism To Christ - Video [Last Updated On: February 13th, 2015] [Originally Added On: February 13th, 2015]
- Atheism is... - Video [Last Updated On: February 13th, 2015] [Originally Added On: February 13th, 2015]
- Atheism - Why Atheists Are Atheists - Video [Last Updated On: February 13th, 2015] [Originally Added On: February 13th, 2015]
- Atheism Not Belief - War on Easter - Video [Last Updated On: February 13th, 2015] [Originally Added On: February 13th, 2015]
- A Christian defines Atheism - Video [Last Updated On: February 13th, 2015] [Originally Added On: February 13th, 2015]
- Atheist Dan Barker proves Atheism is madness - Video [Last Updated On: February 13th, 2015] [Originally Added On: February 13th, 2015]
- St. Athanasius & Why Atheism in on the Rise - Video [Last Updated On: February 13th, 2015] [Originally Added On: February 13th, 2015]
- LIVE Multi-Topic Hangout. Atheism, Christianity, My Personal Life With Sarah - Video [Last Updated On: February 13th, 2015] [Originally Added On: February 13th, 2015]
- The Deceit Of Atheism - Video [Last Updated On: February 13th, 2015] [Originally Added On: February 13th, 2015]
- Atheism-is-Unstoppable-2: What a moronic video! - Video [Last Updated On: February 13th, 2015] [Originally Added On: February 13th, 2015]
- Cool People in Heaven Song #freespeech #atheism - Video [Last Updated On: February 13th, 2015] [Originally Added On: February 13th, 2015]
- GodTVRadio Show - Freedom of Speech - Pimpmunkx Atheism is Money, Hustling, and Bank - Video [Last Updated On: February 13th, 2015] [Originally Added On: February 13th, 2015]
- Atheism-is-Unstoppable-2 is a douche. - Video [Last Updated On: February 13th, 2015] [Originally Added On: February 13th, 2015]
- Atheism - Man's Biggest Delusion - Video [Last Updated On: February 13th, 2015] [Originally Added On: February 13th, 2015]
- Part 1 Election: Jacob and Esau; Atheism & Agnosticism Debunked - Video [Last Updated On: February 14th, 2015] [Originally Added On: February 14th, 2015]
- Whiny Fans Complain About the Show - Atheism is Depressing - Obama vs ISIS - and Much More! DPP #84 - Video [Last Updated On: February 14th, 2015] [Originally Added On: February 14th, 2015]
- A few current events relevant to atheism - Video [Last Updated On: February 14th, 2015] [Originally Added On: February 14th, 2015]
- Finish Drive Into City Of Lancaster, PA 2/11/15, Atheism Is An Ideology - Video [Last Updated On: February 14th, 2015] [Originally Added On: February 14th, 2015]
- Atheism: No Good, No Evil, No Hope | Big Objections | Andrew Wilson - Video [Last Updated On: February 14th, 2015] [Originally Added On: February 14th, 2015]
- From Atheism to Freethought - Nirmukta - Video [Last Updated On: February 14th, 2015] [Originally Added On: February 14th, 2015]
- The Trouble With Atheism Part 6 - Video [Last Updated On: February 14th, 2015] [Originally Added On: February 14th, 2015]
- Ed Buckner Shatters Closed Minded Hamza Tzortzis To Pieces on Atheism vs Islam Debate - Video [Last Updated On: February 16th, 2015] [Originally Added On: February 16th, 2015]
- Does God Exist? A Muslim response to the growing trend of Atheism! - Video [Last Updated On: February 16th, 2015] [Originally Added On: February 16th, 2015]
- Does Atheism Exist? - Video [Last Updated On: February 16th, 2015] [Originally Added On: February 16th, 2015]
- Understanding Atheism | Session 5 | Asadullah Ali - Video [Last Updated On: February 16th, 2015] [Originally Added On: February 16th, 2015]
- Hamza Tzortzis vs Lawrence Krauss - Islam or Atheism which one makes more sense? The Big Debate - Video [Last Updated On: February 16th, 2015] [Originally Added On: February 16th, 2015]
- Stupid Anti-Vaxxers - Eric Hovid on How Atheism Causes Suicide - Stupid Ads - DPP #83 - Video [Last Updated On: February 16th, 2015] [Originally Added On: February 16th, 2015]
- Theism vs Atheism with Christjahn Beck - Video [Last Updated On: February 16th, 2015] [Originally Added On: February 16th, 2015]
- Session 1|| Understanding Atheism|| Asadullah Ali - Video [Last Updated On: February 16th, 2015] [Originally Added On: February 16th, 2015]
- Atheism vs India Revisited 10 - Video [Last Updated On: February 16th, 2015] [Originally Added On: February 16th, 2015]
- Understanding Atheism | Session 3 | Asadullah Ali - Video [Last Updated On: February 16th, 2015] [Originally Added On: February 16th, 2015]
- Contradictions of Atheism #atheistlogic - Video [Last Updated On: February 16th, 2015] [Originally Added On: February 16th, 2015]
- Understanding Atheism | Session 2 | Asadullah Ali - Video [Last Updated On: February 16th, 2015] [Originally Added On: February 16th, 2015]
- New Atheism and a Meaningless Universe | William Lane Craig, PhD - Video [Last Updated On: February 16th, 2015] [Originally Added On: February 16th, 2015]
- Richard Dawkins slams video that claims to 'destroy atheism' [Last Updated On: February 17th, 2015] [Originally Added On: February 17th, 2015]
- Don't blame Atheism. - Video [Last Updated On: February 17th, 2015] [Originally Added On: February 17th, 2015]
- Bibles atheism moms why me? - Video [Last Updated On: February 17th, 2015] [Originally Added On: February 17th, 2015]
- Craig Hicks: The Face of Atheism? - Video [Last Updated On: February 17th, 2015] [Originally Added On: February 17th, 2015]
- Atheism vs India Revisited 10a - Video [Last Updated On: February 17th, 2015] [Originally Added On: February 17th, 2015]
- A C Grayling - Atheism, Theism and Proof - Video [Last Updated On: February 17th, 2015] [Originally Added On: February 17th, 2015]
- 2 reasons why it's a bad week to be an atheist [Last Updated On: February 18th, 2015] [Originally Added On: February 18th, 2015]
- GodTVRadio Show - BionicDance - Atheism is Money for Hate - Video [Last Updated On: February 18th, 2015] [Originally Added On: February 18th, 2015]
- Atheism is Child Indoctrination - By Brett Keane - Video [Last Updated On: February 18th, 2015] [Originally Added On: February 18th, 2015]
- North Carolina shootings do not represent Atheism [Last Updated On: February 19th, 2015] [Originally Added On: February 19th, 2015]
- FEMINISM IS RUINING ATHEISM - Video [Last Updated On: February 19th, 2015] [Originally Added On: February 19th, 2015]
- Dear World, Happy Valentines Day, Love Islam - Video [Last Updated On: February 19th, 2015] [Originally Added On: February 19th, 2015]
- Religious Atheism - Video [Last Updated On: February 19th, 2015] [Originally Added On: February 19th, 2015]