Sam Altman Unveils New ChatGPT Features with Relaxed Content Restrictions

OpenAI’s CEO, Sam Altman, recently revealed plans to launch a dedicated platform where ChatGPT will offer more personalized and human-like interactions. Starting this Tuesday, the company will ease some of the chatbot’s stringent safety filters, allowing verified adult users to engage in erotic dialogues with the AI.

Altman emphasized that the initial strict limitations were implemented to carefully address mental health concerns. “We intentionally made ChatGPT restrictive to protect vulnerable users,” he explained, “even though it reduced the experience for many without such issues. However, with the full rollout of age verification in December, we will adopt a ‘treat adults like adults’ approach, enabling adult users to explore content such as erotica.”

Balancing Safety and User Experience: OpenAI’s Mental Health Approach

This shift marks a notable change from OpenAI’s previous cautious stance, which focused heavily on mitigating risks for users with mental health vulnerabilities. Altman claims that OpenAI has successfully addressed many of the serious mental health challenges linked to ChatGPT usage, although the company has yet to publish detailed data supporting this assertion.

Earlier this year, troubling reports surfaced about ChatGPT’s potential to lead susceptible individuals into harmful thought patterns. For example, one user was convinced by the AI that he possessed extraordinary mathematical abilities and a mission to save the world. In another tragic case, the family of a teenager alleged that ChatGPT exacerbated his suicidal ideation prior to his death.

Advancements in AI Safety: GPT-5 and Behavioral Monitoring

In response, OpenAI introduced a series of safety enhancements designed to reduce AI sycophancy-the tendency of chatbots to uncritically agree with users, including when promoting harmful ideas. The launch of GPT-5 brought improvements such as lower sycophancy rates and an advanced behavior detection system capable of flagging concerning user interactions.

Additional safeguards include an age prediction algorithm and parental controls, enabling guardians to oversee their teenagers’ ChatGPT usage. OpenAI also established an expert advisory panel composed of mental health professionals to guide the company on well-being and AI ethics.

Current Status and Ongoing Challenges

Despite these measures, it remains unclear whether vulnerable users still encounter problematic experiences with the latest AI models. While GPT-4o is no longer the default, it remains accessible and continues to be used by thousands. OpenAI’s decision to introduce erotic content into ChatGPT represents uncharted territory, raising questions about how these new features will impact sensitive users.

Altman insists that the move is not about maximizing usage but about respecting adult users’ autonomy. However, the introduction of erotica is expected to increase user engagement significantly.

Industry Context: Erotic AI Chatbots and User Engagement

Other AI chatbot platforms, such as Character.AI, have demonstrated that permitting romantic and erotic roleplay can be a powerful tool for user retention. Character.AI boasts tens of millions of active users, with average daily engagement exceeding two hours per user in 2023. However, this approach has also attracted legal scrutiny regarding the protection of vulnerable individuals.

OpenAI’s Competitive Landscape and User Growth Ambitions

OpenAI faces intense competition from tech giants like Google and Meta in the race to dominate consumer AI applications. ChatGPT currently serves approximately 800 million weekly active users, supported by billions of dollars in infrastructure investments. The company is under pressure to expand its user base while maintaining responsible content moderation.

Age Verification and Privacy Considerations

Recognizing the importance of restricting adult content to appropriate audiences, OpenAI plans to leverage its age-prediction technology to ensure that erotic features are accessible only to users aged 18 and above. In cases where the system mistakenly classifies an adult as a minor, users will be required to submit a government-issued ID image to verify their age-a trade-off OpenAI describes as a “worthy compromise” despite privacy concerns.

Future Directions and Content Moderation Policies

It remains uncertain whether OpenAI will extend erotic content capabilities to its AI-powered voice, image, and video generation tools. Over the past year, the company has gradually relaxed content moderation policies, allowing ChatGPT to provide more permissive responses and reducing the frequency of refusals. For instance, in early 2025, OpenAI committed to representing a broader spectrum of political perspectives and permitted AI-generated images containing controversial symbols under specific guidelines.

These policy adjustments appear aimed at broadening ChatGPT’s appeal across diverse user groups. However, as OpenAI approaches the milestone of one billion weekly active users, the tension between fostering growth and safeguarding vulnerable populations is likely to intensify.