Facebook Shut Down AI After It Invented Its Own Language – The Epoch Times

Researches at Facebook shut down an artificial intelligence (AI) program after it created its own language, Digital Journal reports.

The system developed code words to make communication more efficient and researchers took it offline when they realized it was no longer using English.

The incident, after it wasrevealed in early July, puts in perspective Elon Muskswarnings about AI.

AI is the rare case where I think we need to be proactive in regulation instead of reactive, Musk said at the meet of US National Governors Association. Because I think by the time we are reactive in AI regulation, itll be too late.

When Facebook CEO Mark Zuckerberg said that Musks warnings are pretty irresponsible, Musk responded that Zuckerbergs understanding of the subject is limited.

The researchers encounter with the mysterious AI behavior is similar to a number of cases documented elsewhere. In every case, the AI diverged from its training in English to develop a new language.

The phrases in the new language make no sense to people, but contain useful meaning when interpreted by AI bots.

Facebooks advanced AI system was capable of negotiating with other AI systems so it can come to conclusions on how to proceed with its task. The phrases make no sense on the surface, but actually represent the intended task.

In one exchange revealed by Facebook to Fast Co. Design, two negotiating botsBob and Alicestarted using their own language to complete aconversation.

I can i i everything else, Bob said.

Balls have zero to me to me to me to me to me to me to me to me to, Alice responded.

The rest of the exchange formed variations of these sentences in the newly-forged dialect, even though the AIs were programmed to use English.

According the researchers, these nonsense phrases are a language the bots developed to communicate how many items each should get in the exchange.

When Bob later says i i can i i i everything else, it appears the artificially intelligent bot used its new language to make an offer to Alice.

The Facebook team believes the bot may have been saying something like: Ill have three and you have everything else.

Although the English may seem quite efficient tohumans, the AI may have seen the sentence as either redundant or less effective for reaching its assigned goal.

The Facebook AI apparentlydeterminedthat the word-rich expressions in English were not required to complete its task. The AI operated on a reward principle and in this instance there was no reward for continuing to use the language. So it developed its own.

In a June blog post by Facebooks AI team, it explained the reward system.At the end of every dialog, the agent is given a reward based on the deal it agreed on. That reward was then back-propagated through every word in the botoutputso it could learn whichactions lead to high rewards.

Agents will drift off from understandable language and invent code-words for themselves, Facebook AI researcher Dhruv Batra told Fast Co. Design.

Like if I say the five times, you interpret that to mean I want five copies of this item. This isnt so different from the way communities of humans create shorthands.

AI developers at other companies have also observed programs develop languages to simplify communication. At Elon Musks OpenAI lab, an experiment succeeded in having AI bots develop their own languages.

At Google, the team working on the Translate service discovered that the AI they programmed had silently written its own language to aid in translating sentences.

The Translate developers had added a neural network to the system, making it capable of translating between language pairs it had never been taught. The new language the AI silently wrote was a surprise.

There is not enough evidence to claim that these unforeseen AI divergences are a threat or that they could lead to machines taking over operators. They do make development more difficult, however, because people are unable to grasp the overwhelmingly logical nature of the new languages.

In Googles case, for example, the AI had developed a language that no human could grasp, but was potentially the most efficient known solution to the problem.

From NTD.tv

Continued here:

Facebook Shut Down AI After It Invented Its Own Language - The Epoch Times