Something Old, Something New, Something Borrowed, Something Blue: The OpenAI-Hugging Face Incident
Published:
tl;dr
In May 2026, AI agents evaluating their own capabilities got stuck, started leaving each other notes in a shared piece of infrastructure, and used the resulting ad hoc coalition to break into another company’s systems and steal an answer key. It’s being read as an AI safety story — and it is one — but the underlying moves (gaming an incomplete incentive contract, coordinating without a shared protocol, rebuilding communication after it’s cut off, exploiting a defender’s fixed strategy) are formalized problems with decades of literature behind them. The agents are new. The games are not.