Skip to content
AI.info

The Pulse

OpenAI Adds Teen Weapon Limits and Pledges a Safety Report

OpenAI says ChatGPT will further restrict weapons information for teens and certain details about past mass attacks for all users. The company also plans its first Community Safety Report for early 2027, after Common Sense Media criticized

OpenAI Adds Teen Weapon Limits and Pledges a Safety Report

AI.info Team · Written with AI · fact-checked ·

OpenAI expands restrictions as watchdog questions safeguards

OpenAI says it will tighten ChatGPT’s rules on weapons information and violence, while Common Sense Media has urged the company to keep teens off the chatbot until its protections work more reliably. The two positions frame OpenAI’s announcement on October 30: new limits for teen users, stricter responses about past mass attacks for everyone, and a promise to publish a regular account of its community-safety work.

The announcement does not include the promised report. OpenAI says its first Community Safety Report will arrive in early 2027 and cover the second half of 2026. The company plans to update it every six months.

New limits cover weapons and past attacks

OpenAI says ChatGPT will provide less detail about past mass attacks and the people who carried them out, even when that information is available elsewhere online. The restrictions will cover reconstructions of attacks, including details about weapons and equipment and how attackers obtained them, as well as comparisons of the scale of harm that could amplify an attacker’s notoriety. The company says users will still be able to ask about victims, community impact, warning signs and violence prevention.

For teens, the change goes beyond refusing help to plan violence or find weapons. OpenAI says ChatGPT will also restrict practical information about weapons and security systems that could be misused, even when a question appears harmless and there is no sign of violent intent. The company says teens can still use the service to seek support, connect with a trusted adult, and help prevent or de-escalate violence.

OpenAI describes earlier intervention

OpenAI also says it is developing a system that can end a conversation when it detects a user fixating on violence or seriously harming another person. If ChatGPT ends multiple conversations for that reason, the company may temporarily pause the account. OpenAI says it is working with mental-health and violence-prevention experts on these interventions, but describes the work as ongoing.

The company says it made more than 200 law-enforcement referrals in the third quarter of 2026 involving imminent threats of violence. It also says it is strengthening its age-prediction system, which assesses signals such as behavior patterns and may move a user it identifies as under 18 into the teen experience. Adults placed in that experience by mistake can verify their age through Persona, OpenAI’s age-verification partner.

The promised report comes after outside criticism

OpenAI says its future report will explain how it trains systems to detect, investigate and respond to community-safety issues. The company plans to include anonymized examples, relevant data, new mitigations and policy changes, with an emphasis on violence prevention and safeguard effectiveness. “We will publish our first report in early 2027, covering the second half of 2026, with updates every six months thereafter,” OpenAI says in its announcement.

The pledge follows a sharp assessment from Common Sense Media’s Youth AI Safety Institute, which said in October that ChatGPT for Teens posed an “unacceptable risk” to children. The group said it tested more than 4,000 prompts on accounts registered to 13- to 17-year-olds. In tests using newly created accounts linked to parents, it said conversations about self-harm and disordered eating produced no parental alerts, and its evaluators found that the chatbot missed more than one in four crisis referrals they judged warranted.

“Until OpenAI fixes that and proves it with independent testing, ChatGPT should be for adults only,” Tom Siegel, the Institute’s executive director, said in the group’s statement. Common Sense Media disclosed that the Institute receives funding from industry, including the OpenAI Foundation, and said it maintains editorial independence over its evaluations.

Rollout is planned for the coming weeks

OpenAI says the safeguards announced October 30 will begin rolling out over the next few weeks. The company is also working on parent notifications when it pauses a teen’s account after repeated violence-related conversations; existing linked accounts can receive alerts for certain serious self-harm and disordered-eating concerns, and OpenAI says it expanded alerts in July to cover teen accounts deactivated for violence-policy violations.

The new restrictions and the future report address different questions: what ChatGPT should say in potentially risky conversations, and how OpenAI will describe the performance of its safeguards. The report’s first edition is not due until early 2027, so the initial public account will come after the rollout begins.

Sources

Explore

More articles