Back to Blog
May 4, 2026 • Tim Fernholz

AI Expert Warns of AGI Arms Race at OpenAI Trial

AI Expert Warns of AGI Arms Race at OpenAI Trial AI Expert Warns of AGI Arms Race at OpenAI Trial AI Expert Warns of AGI Arms Race at OpenAI Trial

Elon Musk's only AI expert witness at the OpenAI trial fears an AGI arms race

Overview

Stuart Russell, a UC Berkeley computer science professor and long-time AI researcher, testified as Elon Musk's sole expert witness in the OpenAI trial. His testimony focused on the risks of unconstrained AI development and the arms race dynamic created by frontier labs competing to reach AGI first.

Key Points from Russell's Testimony

  • Core Argument: Russell testified that there is a fundamental tension between the pursuit of AGI and AI safety
  • Identified Risks: Multiple AI threats including:
    • Cybersecurity vulnerabilities
    • Problems with AI misalignment
    • Winner-take-all dynamics in AGI development
  • Previous Actions: Russell signed an open letter in March 2023 calling for a six-month pause in AI research (ironically, Musk also signed this letter while launching xAI)
  • Broader Concerns: Russell has long criticized the arms-race dynamic and called for tighter government regulation of frontier labs

The Legal Context

Musk's Legal Strategy: His attorneys argue that OpenAI was established as a charity focused on AI safety but lost its way in pursuit of profit. They cite old emails and statements from founders about the need for a public-spirited counterweight to Google DeepMind.

OpenAI's Counter: During cross-examination, OpenAI's attorneys established that Russell wasn't directly evaluating the organization's corporate structure or specific safety policies. The judge also limited Russell's testimony after objections.

The Contradiction at the Heart of AI Safety

The article highlights a central irony: virtually every OpenAI founder has warned about AI risks while simultaneously:

  • Building AI as fast as possible
  • Hatching plans for AI-focused for-profit enterprises
  • Seeking massive capital investments to fund compute needs

The Core Dilemma: OpenAI's founding team's fear of AGI in a single organization's hands pushed them to seek capital that ultimately created the arms race and tore the team apart.

Broader Implications

The same dynamic is playing out at the national level:

  • Senator Bernie Sanders proposed legislation for a moratorium on data center construction
  • Sanders cited AI fears from Musk, Altman, and Hinton
  • Critics question why the public should "discount everything tech billionaires say except when their words can be recruited to fill gaps in a precarious argument"

The Paradox

Both sides of the legal case are asking the court to take parts of Altman's and Musk's arguments seriously while discounting the parts less useful for their respective legal positions—a contradiction that mirrors the broader AI safety debate.