Back when artificial intelligence development company OpenAI created the text-writing algorithm GPT-2, it initially said it was too dangerous to release into the world.
Of course, it eventually did did release a full version of the neural network. By and large, it turned out that people were more interested in using GPT-2 as an AI dungeon master than churning out the endless torrent of fake news and propaganda that OpenAI had worried about.
But one evil genius slipped through the cracks: Tiago, a student whos getting his masters degree in business, told Futurism that hebeen using GPT-2 to write essays for his coursework.
He was willing to share his story and copies of his AI-generated essays on the condition that Futurism didnt share identifying information beyond his first name.
I dont know if it qualifies as plagiarism, Tiago told Futurism. I figure no, maybe, but thats not a gamble Id like to take right now.
Below is Futurisms conversation with Tiago, which has been lightly edited for clarity.
So, you used the AI algorithm GPT-2 to write one of your homework assignments. I have to say, thats an incredible move to pull off.
Tiago: Well, not that amazing. I would say, all my friends that work in tech and the STEM fields dont understand how poor the business school curriculum is in general. Its not as much a feat for GPT-2, Id say, as proof of the poorness of business schools curriculum.
You couldnt write an essay on science that could be anywhere near as convincing using the methods that I used. Many of the courses that I take in business school wouldnt make it possible as well. However, some particular courses are less information-dense, and so if you can manage to write a few pages with some kind of structure and some kind of argument, you can get through. Its not that great of an achievement, I would say, for GPT-2.
What was the actual assignment?
We did a presentation on some kind of business case, and then we had to do a follow-up essay. Three to five pages on that business case, and what it meant. Its weird to explain.
I would have to say also Im more pessimistic than the average business school student those courses that revolve around the business cases are not as fact-based as courses you might be used to. Because business cases are not like a theorem, theyre more like a parable.
It could be how innovation is important or something like that. You can take any conclusion that you want, and if it makes sense and if it fits in the more general narrative, you are assured a passing grade. Its very far from publishing an academic essay Id like to stress that point.
What gave you the idea to use GPT-2 for this assignment in particular?
I read an article about a student contest for essays on climate change. One of the entries was not a student, but a journalist at The Economist who used GPT-2 to write an entry. It was a very close experiment to my essay.
At that point, I started looking up how I could use GPT-2 to write essays in some of my classes. However, I do not have a technical background at all, so it was too much for me.
One thing that was made available between that time and the essay that I wrote was a tool, Talktotransformer.com, which makes GPT-2 accessible to everyone through a web browser. I dont know the details, but thats what made it possible for someone with a non-technical background like me to use GPT-2 to write my essay.
How did you actually write the essay? Did you have a game plan going in, or did you basically put some writing into TalkToTransformer and hope for the best?
Basically, I wrote the outline of my essay, with a few sentences or a paragraph per section, each with a point. And then I fed the first sentence of each paragraph that I wrote, fed it to GPT-2, and I got a full paragraph.
I had to iterate a few times to get something that was close to what I was looking for, and then I put it back in my word document and went to my next paragraph.
So you provided one sentence per paragraph, sort of like a topic sentence, and let the algorithm fill it out?
I wrote the structure and one sentence per paragraph. All the information that was in that final essay was in that structure, but the sentences were added by GPT-2. It added false quotes sometimes, or false information about the companies I was talking about. I found adding words like innovation, synergy,and stuff like that made the essay sound more suited for the course.
I did it for two essays in two different courses. What I figured as I was doing it was that if I write my first sentence in a certain way, it increases the probability that the paragraph will look how I want it to. So, if I use the words that are in a lot of business review articles, then the probability of similar words and similar points being made in the generated paragraph was increased.
What did you think of the output? Did it seem believable to you? Did you have to fix any errors?
I would write the first sentence of the paragraph, lets say the point of the paragraph is Starbucks has innovated by raising the quality of its coffee. I would write a sentence that encompasses the whole point, and then I would feed it to GPT-2, and then I would get a paragraph. I would generate again until I get something that I found more or less believable.
Some sentences would generate paragraphs indifferent tones. So, for instance, if I used some keywords, it would write a quote from the Starbucks CEO like what he would say in a shareholders meeting. But if I wrote it slightly differently, it might produce something about how to make coffee.
So you didnt change the paragraph at all once it looked about right?
There was light editing. Removing a sentence from a paragraph or adding it elsewhere. Sometimes GPT-2 would start a quote without ending it, so I would have to remove it.
Or it would make some bold claims that I was not comfortable with because they were factually false. Those I would remove.
And how was it received? Did the paper get a passing grade?
Both times I passed. But there was not much feedback on one of them, just a grade. And the second one, there was a grade on relationship to the subject, whether it got the point across.
It did get an okay grade. I dont have the grades for other students, but I think 80 percent of the class passed. Its hard to tell. I passed and some students didnt, but I was far from the best. I was clearly one of the worst ones that did pass.
It was okay for me because Im at the end of my masters and this was one of my last classes. For me, it was just pass or fail.
Were you nervous at all when you were submitting the work? Were you concerned that youd be found out?
I was confident enough to turn it in. However, I then was looking online and found out theres a really easy way to find out if an essay was written by GPT-2. Its to feed it to GPT-2 and if its able to predict the next words, then it was written by the AI. Its easier to find out than normal plagiarism.
I knew that the business school had software that they were using to look out for plagiarism in all the essays that are turned in to their online platform, which is how I turned in my essays. So I was slightly worried that the company that sold them the anti-plagiarism software would have made an update.
I dont think the professors even considered the possibility of GPT-2 writing the essays, but I was slightly worried that the company making the software added a module. But not that much.
Were you surprised when you passed?
Not really. I think its hard to get across to people who didnt study in business school how poor the standards are for essays that are turned in. I think the professors are too proud to think of the possibility of AI writing an essay. But it was really easy to do.
I think it will become an issue for business schools in the future, and unfortunately for students, its easily solved through anti-plagiarism software.
I know youre basically done with school. But if you had more ahead of you, would you do this again? Or was it more of a fun experiment for you?
Yeah, this is something Id do again. You just cant expect a good grade. The final essay is pretty poor, its just not poor enough for the professor to fail you.
More on GPT-2: Now You Can Experiment With OpenAIs Dangerous Fake News AI
See the article here:
Automated Education This Grad Student Used a Neural Network to Write His Papers - Futurism
- The G-Bound RC Car Drives On Water [Rc] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- Nanoparticles Can Rip Your DNA Apart Without Ever Touching It [Nanoparticles] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- My Favorite Top 10 List Today: The Dumbest Evil Geniuses Of All Time [Evil Geniuses] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- 5,000 Volts Is More Than Enough Power To Crush a Soda Can [DIY] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- Computers Are Scary, But Steve Allen Is Here to Help [Retromodo] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- Pangolin Backpack [Bags] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- New For iPhone: 2 Balls 1 Cup [IPhone Apps] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- Office Building Or Home To A Super Heroine? [Architecture] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- This Inflating Bra Commercial Left Me Confused Yet Reaching For My Wallet [Nsfw] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- 10 Terrible Tips for Longer Battery Life [Humor] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- Dealzmodo: $100 Xbox 360 at Amazon, More Electronics Deals All Day Long [Dealzmodo] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- Gigabyte BIOS Update Fixes iPhone Syncing Issues [IPhone] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- Hello Facebook User, I'm a Nigerian Prince in Need of Assistance... [Facebook] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- Zune HD Update 4.3: Speedier Browser, Predictive Text and More [Zune Hd] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- 8-Bit Wedding Invitation Acknowledges the Marital Bickering to Come [8-Bit Wedding] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- The iPhone Nano Rumor Strikes Again: Coming to Verizon in 2010? [Rumor] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- Building a NAS? Skip the Performance Drives [Nas] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- Microsoft COFEE, Some of the Most Illegal Software You Can Pirate [Hacking] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- Robot Cow Rectum: For Educational, not Recreational, Purposes [Robots] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- Watch Jonathan Ive's Segment in Objectified [Apple] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- BlueBeat’s Innovative Defense That Will Never Hold Up in Court [Music] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- Nokia Booklet 3G Landing November 15 at Best Buy [Nokia] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- Latest Snow Leopard Developer Build Breaks Hackintosh Support... Again [Hackintosh] [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- The Cité du Design Certainly Lives Up to Its Name [Architecture] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- 64% of Men Don’t RTFM Before Calling Tech Support [Tech Support] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- MIT Media Lab: Electronic Wallpaper, Conductive Threads and More [Fashion] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Famous Paintings Reproduced In Coffee [Art] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- How Far Can 'Medical Tourism' Go? [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Actuarial Escape Velocity [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- A Rebuttal to 'Peak Oil' Doomsday Predictions [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Reverend Jeremiah White,...I mean, Wright [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Energy vs. Financials, A Divergence of Historical Extremes [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- US Ideological Distribution, 2008 [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Ten Biotechnology Breakthroughs Soon to be Available [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Nanohealing Material Heads to Market [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The Solar Revolution is Near [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Why the US Will Still be the Only Superpower in 2030, v2.0 [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The Culture of Happiness [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Surfaces : The Next Killer Ap in Computing [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- More on the Economics of Medical Tourism [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Ten Myths in America [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Can Buildings be 'Printed'? [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Pre-Singularity Abundance Milestones [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The Futurist's Stock Portfolio for 2009 [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- A Future Timeline for Economics [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- A History of Stock Market Bottoms [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- A Few Electoral Statistics [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- It's Official : The Recession Began in December 2007 [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- How We Decisively WON in Iraq in 2008 [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- 2008 Technology Breakthrough Roundup [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The Futurist's Stock Portfolio for 2008 - RESULTS [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Why Government is Set to Extinguish Silicon Valley [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Solar Power's Next 5 Game-Changing Technologies [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The End of Rabbit Ears, a Billion more Broadband Users - Part II [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Guantanamo Meets Geneva Convention Rules [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Nanotechnology : Bubble, Bust, ....Boom? [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The Form of Economic Recovery [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The Impact of Computing : 78% More per Year, v2.0 [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Wolfram Alpha : The Birth of Web 3.0 [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Energy vs. Financials, RESULTS [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- SETI and the Singularity [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Eight Ways to Supercharge the US Economy [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The Next Big Thing in Entertainment, A Half-Time Update [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Video Conferencing : A Cascade of Disruptions [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Timing the Singularity [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Mobile Broadband Surge : A Prediction Follow Up [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The Next Two US Recessions [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Google Promotes Droid Day With Rare Homepage Ad [Google] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Microsoft Confirms Improved Xbox 360 Warranty Seal [Blockquote] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- OpenOfficeMouse Is An 18 Button Freak, But I Want It [Mouse] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- 10 Classic Analog Games Defiled By Digital [Tgif] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Wire Your House With Ethernet Cable For Better Home Networking [DIY] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The Next Room Eavesdropping Device Is Way Better Than a Drinking Glass [Surveillance] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Steve Jobs and Sarah Jessica Parker Sittin' In A Courthouse B-E-I-N-G S-U-E-D [Lawsuits] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The Folding Titanium Spork Is the Ultimate Portable Eating Utensil [Spork] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The Queen of Google: "I Do Code All Night!" [Google] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- This Week's Best iPhone Apps [IPhone Apps] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- DIY Star Trek Bluetooth Communicator Almost Makes Regular Bluetooth Headsets Look Stylish [DIY] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Intel Swears That It's Gonna Stop Its Firmware From Bricking Any More SSDs [Intel] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- H20 Audio's Waterproof iPod Nano Case Is Built for Surfer-Videographers [Accessories] [Last Updated On: December 12th, 2009] [Originally Added On: December 12th, 2009]