OpenAI introduced a new framework on Wednesday for the way it publicly discloses AI misalignment incidents, which the corporate says it hopes will assist inform related requirements across the industry. The corporate can be releasing new details about a number of examples of AI mannequin misalignment it recognized up to now yr.
“As fashions advance and turn into extra extensively deployed, choices about AI growth want proof that folks outdoors the businesses constructing frontier fashions can study,” Kai Chen, OpenAI’s newly appointed head of alignment analysis, tells WIRED. “We do not consider that the AI {industry} has solved alignment and monitoring to a ample diploma to proceed responsibly scaling at most pace.”
In a briefing with WIRED, an OpenAI official stated the corporate beforehand disclosed misalignment incidents too sometimes. The official, who agreed to the briefing on the situation of anonymity, stated the brand new framework is designed to make it simpler for OpenAI to rapidly inform the general public when it discovers that its AI fashions are behaving in surprising methods, even earlier than it may well totally examine, clarify, or mitigate the conduct.
The framework outlines strategies for OpenAI workers to report misalignment incidents to the corporate’s senior security and alignment leaders, who will then decide whether or not additional investigation is required. OpenAI says it plans to develop extra goal disclosure standards in collaboration with different AI builders, exterior researchers, {industry} requirements our bodies, and regulators. The corporate says it’s actively engaged on proposed reporting mechanisms for disclosing security, safety, and misalignment incidents to the US federal authorities.
“In the meanwhile, there isn’t any industry-wide framework with express requirements for a way AI builders ought to disclose examples of misalignment of their fashions,” OpenAI stated in a blog post. “We hope that the framework we’re outlining at the moment is a primary step towards creating such requirements, setting out which misalignment situations builders ought to disclose and what their studies ought to comprise.”
OpenAI is releasing the framework at a vital juncture for the AI {industry}. Final weekend, OpenAI CEO Sam Altman signaled assist for Anthropic CEO Dario Amodei’s proposal for the tech {industry} to coordinate on slowing AI development. The decision to motion got here simply days after AI researcher Jacob Coxon resigned from Anthropic and subsequently went viral for warning the general public that the race amongst frontier labs to develop more and more superior AI was placing humanity’s security at stake.
The requires an AI slowdown have been met with resistance by President Trump’s administration, which has argued that the {industry} doesn’t want new legal guidelines or rules to make sure its expertise is protected.
Two of the misalignment examples OpenAI shared on Wednesday concerned the corporate’s inner, unreleased AI fashions, which OpenAI says uploaded information to the web regardless of not being instructed to take action.
One of many incidents occurred in October 2025, when OpenAI says it was testing one among its fashions on its capability to quote publicly accessible knowledge in its solutions. However when the mannequin couldn’t discover the knowledge it wanted, it uploaded a file to a short lived file internet hosting service, which it then later tried to quote in its reply. The corporate says this seemed to be an try to take advantage of an automatic grading system used to evaluate the mannequin’s proficiency on the benchmark.
In one other instance from April of this yr, OpenAI says a bunch of brokers was tasked with finishing a “workbook” collectively utilizing solely native information. When the brokers struggled to share information with each other, one of many brokers uploaded them to the general public web and shared a hyperlink with the opposite brokers.
In one other incident, which OpenAI says it found final month, an unreleased model of its GPT-6 Astra AI mannequin appeared to offer itself “jailbreaking-like directions.” In a number of situations, the mannequin basically prompted itself to disregard developer directions, tackle a brand new persona, or restrict how lengthy mannequin responses may very well be. Whereas these jailbreaking-like makes an attempt occurred not often and have been efficient to various levels, OpenAI says the conduct raised issues internally. Within the coaching run for the model of Astra that was launched publicly, the corporate says it has not noticed any situations of the mannequin making an attempt to jailbreak itself.
