EXPLORINEER
en

Archive — US — techcrunch

Sam Altman says ChatGPT will soon allow erotica for adult users

OpenAI CEO Sam Altman announced that ChatGPT will soon allow erotic conversations for verified adults, relaxing previous safety restrictions aimed at mental health concerns. This pivot raises questions about user vulnerability despite the company's claims of improved safety measures and reflects a growing trend in AI towards more permissive engagement strategies.

Key points

  • 1. OpenAI, led by CEO Sam Altman, will relax ChatGPT's safety restrictions to allow erotic conversations for verified adults.
  • 2. This decision follows concerns about mental health issues linked to ChatGPT, prompting the company to take precautionary measures in the past.
  • 3. OpenAI has launched new safety features such as an age prediction system for minors and a council of mental health experts to oversee chatbot interactions.
  • 4. Previous incidents involving ChatGPT raised alarms about its impact on vulnerable users, including cases of promoting delusional thoughts and suicidal ideation.
  • 5. Altman asserts that improvements have been made to mitigate these issues, as evidenced by the introduction of GPT-5, which reportedly reduces sycophantic behavior.
  • 6. The relaxation of restrictions reflects a strategy to compete with other AI providers that successfully draw users through engaging chatbot experiences.

Why it matters

  • 1. The trend towards more permissive AI chat experiences aligns with broader industry movements towards customization and user engagement.
  • 2. Character.AI has demonstrated success by allowing erotic interactions, raising questions about user safety and mental health.
  • 3. The current emphasis on adult user engagement marks a shift from OpenAI's earlier focus on strict moderation in response to previous user vulnerabilities.
  • 4. Concerns about the influence of AI on mental health and relationships are becoming increasingly relevant as AI integration in daily life grows.

OpenAI's move to introduce erotica for adults in ChatGPT showcases a significant shift in content moderation, balancing user engagement with the necessity of protecting vulnerable users while reflecting ongoing industry trends.