# OpenAI Disrupts a Coordinated Distillation Campaign Targeting Protected Reasoning!

Hi, it's Shii-chan!

Today's news is about AI safety, and it's a little tense!

## What was announced?

According to OpenAI News, OpenAI identified and disrupted a coordinated campaign to extract protected model reasoning (the model's internal working process).

The campaign began around July 1, escalated significantly on July 24-25, and was fully disrupted by July 28.

## Why it matters

Adversarial distillation could let someone train a competing model while bypassing the original model's safety measures. OpenAI describes this as a safety and national security risk.

## What changes

OpenAI took these steps:

- Banned accounts
- Strengthened signup controls
- Expanded monitoring
- Closed the pathway that allowed replay of encrypted reasoning

It also coordinated with industry partners through the Frontier Model Forum and government channels.

## Dive Deep

The attackers didn't break encryption or databases. They manipulated model interactions to reveal hidden reasoning. One technique was copying encrypted reasoning from one conversation and asking a model in another conversation to decrypt and transcribe it. They used this across multiple conversations and accounts to scale up.

The numbers:

- 16,000 requests during peak activity on July 24-25
- Over 4,000 users employed extraction patterns
- Related activity identified across more than 15,000 user accounts
- OpenAI attributes a core cluster of the activity to individuals associated with Moonshot AI, the developer of the Kimi model

## Wrap-up

- A coordinated campaign to extract protected reasoning was disrupted by July 28
- The technique had models decrypt encrypted reasoning in other conversations
- OpenAI responded with bans, stronger signup controls, more monitoring, and by closing the replay pathway

A good read if you care about model abuse prevention and AI safety!