Facebook is reportedly developing AI to summarize news what could go wrong? – The Next Web

Facebook has been trying to get a foothold in the news space for many years. Last year, the company launched a dedicated section on its sitecalled Facebook News for users in the US. It also wants to expand this program to other countries such as Brazil, Germany, and India.

But thats not the only project the social network is working on in the news space. According to a report from BuzzFeed News, Facebook is testing an AI-powered tool called TL;DR (Too Long; Didnt Read) to summarizenews pieces, so you dont even have to click through to read those articles.

The report noted that the company showed off this tool in an internal meeting last night. Its also planning to add features such as voice narration and an assistant to answer queries about an article.

At the outset, this seems like a great idea getting a short summary of an article you dont have time to read, right. There are already some similar tools such as theAutoTLDR bot on Reddit.However, given Facebooks sketchy history with news and publishers, there are many ways this could go wrong.

At best, the AI makes silly mistakes in parsing the article content, so you cant make sense of the summary it spits out. After all,Weve seen many incidents where bots picked out problematic portions of contentfrom their training algorithms and spewed racist gibberish.

At worst, theres potential to create or distribute misinformation. There are a ton of news sources on Facebook that are not known for their accuracy. If a skewed summary of those articles starts floating around, it might create more trouble.

Facebook will also need to train its algorithm to avoid taking quotes or sentences from articles out of context. A seemingly non-problematic summary could be contradicting the article or the subject and vice versa.

In thepast, researchers have successfully tricked AI systems that are designed to detect toxic comments on the internetwith positive words. If the people behind propaganda operations could crack Facebooks algorithm for summarizing articles, they could write stories in such a way that the summaries include the messages they want to spread.

Many reports have pointed out the social networks massive misinformation problem, and a lot of it was because of poorly designed software. While Facebooks TL;DR product is not public yet,it already sounds like it could be a disaster.

Published December 16, 2020 06:16 UTC