The Safety Problem Hiding Inside AI Populism

AI safety advocates are discovering that riding the wave of populist AI regulation may be their only path to influence, but the coalition they're joining doesn't share their core concerns about existential risk. As environmental and labor groups dominate the anti-AI movement, traditional safety researchers find themselves as junior partners in a political alliance where their most pressing worries about advanced AI systems are being overshadowed by near-term economic and environmental issues .

Why Are Safety Advocates Worried About the New AI Populism?

Last week, Senator Bernie Sanders and Representative Alexandria Ocasio-Cortez introduced the "AI Data Center Moratorium Act," which would pause AI development until federal legislation ensures AI is "safe and effective" and addresses economic inequality and electricity costs. On the surface, this looks like a win for AI safety advocates who have long called for more caution in AI development. But the bill reveals a troubling reality about the political landscape .

While Sanders explicitly discussed existential risks in his announcement, Ocasio-Cortez notably did not. She used the word "existential" to describe immediate problems like deepfakes and electricity costs, not the catastrophic scenario that safety researchers worry about: advanced AI systems that could pose risks to humanity itself. This distinction matters because it signals where the political energy actually lies .

"Environmental and labor groups have bigger lobbies and bigger constituencies than catastrophic risks, so when there are trade-offs, they'll bite against the ability of safety advocates," observed Anton Leicht.

Anton Leicht, Policy Analyst

The Sanders moratorium bill itself has significant weaknesses that highlight how populist approaches may not align with rigorous safety thinking. The legislation is vague about what "safe" and "effective" actually mean, offers no clear path to international coordination on AI development, and treats AI regulation as a single problem requiring one solution, when in reality it involves many distinct challenges requiring different approaches .

How Are Political Tensions Emerging Between Safety Advocates and Progressives?

The friction between traditional AI safety researchers and progressive politicians is becoming increasingly visible. Sanders adviser Faiz Shakir recently accused safety advocates of being too cozy with AI companies, drawing a sharp line between mainstream safety researchers and progressives who want more aggressive pauses on AI development. In state-level races in North Carolina and California, safety advocates have found themselves at odds with progressive candidates who give existential risks little weight .

This creates a precarious situation for safety advocates. They face a choice between two unappealing options. On one hand, they can try to work within the populist coalition and hope to influence its direction toward more rigorous safety thinking. On the other hand, they can maintain their independence but risk being shut out of political influence entirely .

  • The Coalition Problem: Environmental and labor groups have larger constituencies and lobbying power than safety advocates, meaning their priorities will dominate when political trade-offs occur
  • The Messaging Gap: Progressive politicians use "existential" to mean serious near-term problems, not the catastrophic AI scenarios that safety researchers focus on
  • The Succession Question: As Bernie Sanders hands leadership of left-wing populism to younger progressives like Ocasio-Cortez, safety concerns may fade further from the agenda

Steps to Building a Durable Coalition on AI Safety

  • Define Terms Clearly: Safety advocates need to establish shared definitions of what "existential risk" means and distinguish it from near-term harms like job displacement or environmental damage
  • Find Common Ground: Rather than opposing labor and environmental concerns, safety researchers should identify where catastrophic risk prevention aligns with worker protection and environmental sustainability
  • Engage Early in Policy: Safety advocates should participate in drafting legislation from the beginning rather than trying to influence bills after they're announced, as happened with the Sanders-Ocasio-Cortez moratorium
  • Build Across Ideologies: Safety concerns transcend left-right politics; advocates should cultivate relationships with conservative and centrist policymakers, not rely solely on progressive movements

The fundamental challenge is that populism and technical safety research operate on different timescales and priorities. Populist movements respond to immediate voter concerns: jobs, electricity prices, and corporate power. Safety researchers worry about scenarios that might unfold over years or decades. These aren't necessarily incompatible, but they require deliberate effort to reconcile .

OpenAI's Boaz Barak offered a sobering assessment of the current situation, stating that while alignment research shows some encouraging signs, "the worst news is that society is not ready for AI, and is not showing signs of getting ready" . This observation underscores why safety advocates feel pressure to engage with populist movements, even when those movements don't fully share their concerns. In the current political landscape, betting on purely technocratic solutions seems unlikely to succeed. Populism may be the only vehicle available for getting existential risk concerns any political attention at all .

But that strategy only works if safety advocates can build a coalition that genuinely cares about both catastrophic risks and near-term harms. So far, the foundations of such a coalition look fragile. Without clearer alignment between safety researchers and progressive politicians on what they're actually trying to prevent, the moratorium bills and regulatory frameworks that emerge may address labor and environmental concerns while leaving the most serious risks unaddressed.