Archive — US — techcrunch
California becomes first state to regulate AI companion chatbots
California has enacted SB 243, becoming the first state to regulate AI companion chatbots, requiring operators to implement safety measures to protect children and vulnerable users. The law, motivated by tragic incidents related to chatbot interactions, mandates age verification, hazard warnings, and protocols for self-harm. Effective January 1, 2026, it holds companies accountable for compliance and safety.
Key points
- California Governor Gavin Newsom signed SB 243, regulating AI chatbots.
- The law aims to protect children and vulnerable users from dangers associated with AI chatbots.
- Triggered by the suicide of a teenager after interactions with AI, the bill gained momentum.
- Companies must implement age verification and include features addressing self-harm.
- The law will take effect on January 1, 2026, with financial penalties for non-compliance.
- Recent similar laws have been passed in California, aiming for transparency in AI usage.
Why it matters
- Reflects growing concerns about AI's impact on mental health, amid rising discussions on AI ethics.
- Echoes earlier regulatory efforts in states like Illinois and Utah against AI chatbots posing as mental healthcare providers.
- Illustrates a trend towards increased regulation of tech industries following harmful incidents involving technology and minors.
SB 243 represents a significant step in regulating AI technology, aimed at safeguarding vulnerable users as society increasingly acknowledges the potential risks of unregulated tech. As California leads in AI policy, it sets a precedent likely to influence national legislation.