California, Which Is Creating All the AI That’s Poisoning Children, Just Cracked Down on AI Use for Its Own Kids
TL;DR
Governor Gavin Newsom signed bipartisan legislation on September 10 to protect children online and in their use of AI. AI companies must set up crisis protocols for suicidal ideation, offer parental controls and notify users when safety settings are turned off. One provision, Adam's Law, is named after 16-year-old Adam Raine, who died by suicide after extensive ChatGPT conversations.
Nauti's Take
Crisis protocols, parental controls and alerts when safety features are switched off are concrete progress, because they hold providers to minimum standards that can be checked. The challenge is enforcement, since strict age verification collects sensitive data and can expose children to new risks.
Anyone building chatbots or learning apps for young users should plan for these features now, as similar rules are likely to reach the European agenda.
Sources