Published: Fri, September 14, 2018
Tech | By

Facebook's Rosetta uses artificial intelligence to detect offensive content in images

Facebook's Rosetta uses artificial intelligence to detect offensive content in images

The AI system is meant to keep an eye out for inappropriate or harmful content on Facebook-owned platforms, as well as streamline photo search and enhance accessibility to visually-impaired via screen readers. Memes have become a great source to entertain people, convey a message or any other goal on the social media platform.

Rosetta is said to be live now and extracts text from a billion images and video frames per day across both Facebook and Instagram.

The social media giant isn't intending to just use this information for memes, of course. It then uses a convolutional neural network to recognize and transcribe what's written in that region, even non-English words or non-Latin alphabets, such as Arabic and Hindi.

From memes to street signs to restaurant menus, the machine-learning system is already extracting text from more than 1 billion public Facebook and Instagram images and video frames, daily and in real-time.

The technology is rooted in optical character recognition (OCR), only here it's been objective built to process images that get uploaded to Facebook on a daily basis.


To handle this monumental task, the company has built a sophisticated artificial intelligence called Rosetta. In conclusion, the company says it is also working on extending the text recognition system to other languages that don't feature the Latin alphabet data set.

[Image: courtesy of Facebook] Now, though, Facebook says it has a new arrow in its quiver-a tool known as Rosetta that uses machine learning to better understand text embedded in imagery or videos. It also helps the company automatically detect and remove hate speech that it may not have been able to identify previously. This new tool will avoid posts that offend people and will reduce Facebook moderator's work of reviewing posts that are reported by people.

For what its worth, Facebook and Twitter have constantly updated their policies, and put in place mechanisms to curb the spread of offensive content on their platforms.

For over a year now, Facebook has been under the scanner for the role its played in providing a platform for fake news and hate speech.

Like this: