OpenAI Strengthens AI Model Safeguards Against Unauthorised Attacks

Published : Nov 21, 2026, 09:00 AM IST
Open AI logo (Photo/X/@OpenAI)

Synopsis

OpenAI has implemented robust security upgrades to prevent unauthorized model distillation, successfully reducing attacks on internal reasoning from 54% to 0.2% in its latest models, thereby safeguarding advanced AI capabilities and research.

OpenAI Strengthens AI Model Safeguards Against Unauthorised Attacks

New Delhi [India], November 21 (ANI): OpenAI has strengthened safeguards in its latest AI models to prevent unauthorised attempts to extract their internal reasoning and replicate advanced capabilities, reporting a sharp decline in the success rate of such attacks following security upgrades.

In an update outlining its efforts to combat adversarial distillation, the company said the average success rate of attacks attempting to extract protected reasoning from an earlier request fell to 0.2 per cent in GPT-6.2 Astra, compared with 54 per cent in GPT-6 Astra under its original safeguards. The success rate for attacks targeting reasoning generated in the current request also declined to 0.9 per cent from 22.9 per cent, according to internal adaptive evaluations involving automated red-teaming.

Distillation is a machine-learning technique through which one AI model learns from data generated by another. While the technique has legitimate applications, unauthorised distillation can allow another model to reproduce advanced capabilities without inheriting the safety protections of the original system. OpenAI warned that this could create risks in sensitive areas such as cybersecurity and biological research, where capabilities developed for defensive or legitimate purposes could be repurposed for harmful activities.

The company said it had placed particular emphasis on protecting its models' chain-of-thought, or the intermediate reasoning steps generated while working towards an answer. Such information can contain details not included in the final response and can provide valuable training material for competing models. An internal study found that AI models trained on exact reasoning traces generally performed better in cybersecurity benchmarks after supervised fine-tuning than those trained on reasoning summaries. The advantage persisted at higher inference budgets following additional reinforcement learning.

To address the threat, OpenAI is combining model-level safeguards, input and output classifiers, API restrictions and investigations into coordinated extraction campaigns. The company said it had detected multiple unauthorised distillation campaigns on its platform this year, with weekly enforcement actions ranging from thousands to tens of thousands of accounts. The pace of such activity increased significantly over the summer. OpenAI also said it shares indicators of compromise with other AI model providers to help identify and disrupt similar activities across platforms.

Highlighting the broader national security implications, the company said foreign actors could reproduce advanced capabilities developed by US AI companies and deploy them without comparable safeguards. It called for stronger coordination among AI developers, deployment partners and governments, arguing that protecting frontier models from unauthorised capability extraction would be essential as advanced AI systems become more widely available. (ANI)

PREV
Read more

Recommended Stories

Oracle Secures Funding for OpenAI Infrastructure Contract Targets
Gold, Silver Rates Today, November 21: Check Latest Price In Delhi, Bengaluru, Mumbai And More