Roblox introduces real-time AI-powered chat rephraser for inappropriate language
TL;DR
Roblox has launched a feature powered by AI that can rephrase inappropriate language in real time. The online game has been using AI filters to block out any language that goes against its policy for a while now, but it has been replacing censored chats with a series of hash signs (####). Roblox admits that encountering too many hashmarks can be disruptive and make conversations hard to follow. This new feature will instead replace words and phrases with what the AI deems as more appropriate substitutes. Rajiv Bhatia, Roblox’s Chief Safety Office, said the game is starting with profanity. For instance, if a user sends “Hurry TF up” in chat, the system will replace it with “Hurry up!” Everyone in the chat will see a note when a message has been rephrased, and the sender will see what language was edited out. A user who keeps cursing in chat will still be penalized for breaking Roblox poli.
Nauti's Take
Rephrasing beats blanking out, but Roblox still has to check whether the rephraser is creating fresh frustration. Builders of chat moderation need tight feedback loops so substitutions stay honest and policy breaches remain visible.
Summary
Roblox has launched a feature powered by AI that can rephrase inappropriate language in real time. The online game has been using AI filters to block out any language that goes against its policy for a while now, but it has been replacing censored chats with a series of hash signs (####).
Roblox admits that encountering too many hashmarks can be disruptive and make conversations hard to follow. This new feature will instead replace words and phrases with what the AI deems as more appropriate substitutes.
Rajiv Bhatia, Roblox’s Chief Safety Office, said the game is starting with profanity. For instance, if a user sends “Hurry TF up” in chat, the system will replace it with “Hurry up!
” Everyone in the chat will see a note when a message has been rephrased, and the sender will see what language was edited out. A user who keeps cursing in chat will still be penalized for breaking Roblox poli
Sources
