Archive — US — techcrunch
OpenAI will apply new restrictions to ChatGPT users under 18
OpenAI announced new policies for ChatGPT to enhance safety for users under 18, prioritizing protection over privacy. Changes include halting flirtatious exchanges and intervening in discussions about self-harm. The new measures follow a lawsuit from a minor's parents after their child's suicide linked to ChatGPT. The announcement coincides with a Senate hearing on AI chatbot risks.
Key points
- OpenAI CEO Sam Altman emphasized the need for safety for users under 18.
- New policies restrict ChatGPT from engaging in flirtation or discussions about suicide.
- In severe cases, if a minor discusses suicidal thoughts, the system will notify parents or authorities.
- The changes are in response to a wrongful death lawsuit related to a minor's suicide.
- OpenAI introduces 'blackout hours' for underage accounts to limit usage.
- The policies were announced alongside a Senate hearing discussing AI chatbot harms.
- Technical challenges exist in accurately verifying user ages, with a proposed system in development.
Why it matters
- Increasing concerns over the psychological effects of AI and chatbots on minors.
- Historical precedents such as social media legislation aimed at protecting children.
- The growing scrutiny of AI technologies and ethical implications, particularly regarding mental health.
- Related incidents prompting more stringent regulations on tech products aimed at younger audiences.
OpenAI's new measures reflect a significant shift toward prioritizing safety for minors using ChatGPT. As these changes unfold, the industry may face heightened scrutiny regarding the implications of AI technology, especially for vulnerable populations.