Roblox launches real-time AI chat rephrasing to filter out banned language

Roblox is introducing a real-time, AI-powered chat rephrasing diagnostic that automatically replaces banned words with much respectful language, the institution announced connected Thursday.

The caller diagnostic goes beyond Roblox’s existent substance filter, which simply replaces banned words and phrases with the “#” symbol. But Roblox says that erstwhile users brushwood strings of “####,” conversations tin beryllium disrupted and hard to follow.

Now, alternatively of simply displaying hash marks, filtered substance volition beryllium rephrased into much respectful connection that is adjacent to the user’s archetypal intent.

For example, a connection that reads “Hurry TF up!” would antecedently person appeared arsenic “####,” but volition present beryllium rephrased to “Hurry up!” Everyone successful the chat is notified that the connection has been rephrased to support the speech civil, Roblox says.

“Chat is cardinal to however radical connect, coordinate, and play connected Roblox,” said Rajiv Bhatia, Vice President of User and Discovery Product astatine Roblox, successful a press release. “Real-time rephrasing helps support gameplay and conversations connected way portion guiding connection toward what’s appropriate. This attack reduces friction successful chat portion maintaining the standards that assistance support our assemblage civil.”

Roblox notes that portion rephrasing reduces immoderate of the disruption successful the chat, its information strategy remains successful effect for much superior behavior. 

The caller diagnostic is supported successful each languages presently disposable done Roblox’s automatic translation tools.

The institution is besides upgrading the text-filtering strategy to observe much variations of banned language. Roblox says aboriginal results amusement that the strategy is getting amended astatine detecting leetspeak, and much blase attempts to bypass filters. This has allowed the institution to trim the prevalence of mendacious negatives erstwhile sharing oregon soliciting idiosyncratic accusation by 20x.

Thursday’s announcement comes soon aft Roblox introduced mandatory facial verification for entree to chats connected its level pursuing a question of lawsuits implicit kid information from the attorneys wide of Texas, Kentucky, and Louisiana, among others. The lawsuits were filed in effect to reports that Roblox was exposing young users to unsafe risks, specified arsenic grooming and explicit content.