Instagram’s abuse-fighting AI system has trouble with Kanye West lyrics

Kanye WestGetty

In an effort to root out spam and abusive comments from its app, Instagram has been using DeepText — a deep-learning, word categorization system pioneered by its parent company Facebook — to separate good text from harmful text, and eliminate the latter.

And according to a recent Wired profile, Instagram has been testing DeepText’s ability to fight “mean comments” by feeding the system a variety of clean and explicit material including, notably, Kanye West lyrics.

Instagram cofounder Kevin Systrom began using DeepText to successfully fight spam posts after the release of the “near-human,” text-understanding AI last June.

In June of this year, Systrom turned to the more complex task of eliminating mean comments from the app through DeepText — a formidable undertaking that requires the AI system to assess the context of potentially abusive, and often enigmatic, posts.

So far, according to the report, user response to the tool has been “reasonably positive,” if unnoticed. But it does have some notable issues. 

For instance, DeepText has had difficulty with words and slang that have different meanings across cultures. And it also has trouble distinguishing Kanye West lyrics from abusive insults when Instagram employees feed it such content, as the report details of West’s controversial song “Famous”:

“Every line in this sequence got banned when it was put through: ‘For my southside n—– that know me best / I feel like me and Taylor still might have sex / Why, I made that b—h famous.'”

Read the full Wired profile here (spotted via Complex). 

NOW WATCH: 8 details you might have missed on the season 7 premiere of ‘Game of Thrones’

Feedburner

Post Author: martin

Martin is an enthusiastic programmer, a webdeveloper and a young entrepreneur. He is intereted into computers for a long time. In the age of 10 he has programmed his first website and since then he has been working on web technologies until now. He is the Founder and Editor-in-Chief of BriefNews.eu and PCHealthBoost.info Online Magazines. His colleagues appreciate him as a passionate workhorse, a fan of new technologies, an eternal optimist and a dreamer, but especially the soul of the team for whom he can do anything in the world.

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.