The United Nations established a new International Scientific Panel on Artificial Intelligence in February 2026, but critics argue it's focused on the wrong problem. While the UN's AI Panel aims to assess risks and guide governance, experts say it overlooks the more pressing threat: artificial general intelligence (AGI), a fundamentally different technology that could emerge within years and operate beyond human control .

What's the Difference Between AI and AGI?

Today's artificial intelligence systems, like chatbots and image generators, excel at specific tasks but require human guidance. AGI represents a leap forward: machines that can solve novel problems, rewrite their own code, and pursue objectives independently of human oversight. The distinction matters enormously for governance and risk management .

Tech leaders and researchers including Bill Gates, Demis Hassabis, Stuart Russell, Yoshua Bengio, Sam Altman, Elon Musk, and Geoffrey Hinton have publicly warned that AGI poses real and urgent existential risks. Big tech companies are investing $650 billion into AGI development, marking history's largest investment in a single technology frontier. Early forms are already emerging from research labs, with advanced versions potentially arriving within a few years .

Why Is the UN's Current Approach Falling Short?

The UN's AI Panel faces several structural challenges that limit its effectiveness. The mandate is broad but vague, the expert selection process lacks transparency, and the panel operates within a political context where nations have competing interests in AI governance. Tech-heavy countries fear global oversight will reduce their competitiveness, while authoritarian regimes view AI as a tool for state control. Without clear safeguards, the panel risks becoming a battleground for geopolitical interests rather than a genuine safety mechanism .

The practical consequences are concerning. If the UN sets one standard while democratic alliances and industry groups set others, the world could fragment into parallel governance tracks. This fragmentation would slow innovation, complicate cross-border cooperation, and leave AGI development largely unregulated. Additionally, the panel's recommendations may be cited widely but acted upon narrowly, producing reports that lack enforcement mechanisms or real-world impact .

Steps to Strengthen AGI Governance at the UN

• Establish a dedicated AGI focus: The UN Secretary-General should refit the existing AI Panel by making AGI its central priority with appropriate urgency, rather than treating AGI as a subset of broader AI concerns.
• Distribute expert recommendations: The high-level AGI Panel's detailed report, "Governance of the Transition to Artificial General Intelligence (AGI): Urgent Considerations for the UN General Assembly," should be distributed to all UN member states and stakeholders to inform policy discussions.
• Activate AGI expertise: The UN should tap Yoshua Bengio, the only AGI expert currently on the AI Panel, to lead a dedicated working group focused specifically on AGI governance and safety measures.
• Convene an emergency session: The UN General Assembly should hold an emergency session dedicated to AGI, given forecasts that more powerful systems are arriving sooner than previously anticipated.

A separate High-Level Expert Panel on AGI, established by the Council of Presidents of the UN General Assembly, has already produced concrete recommendations. This AGI Panel proposes creating a global observatory to monitor AGI development, establishing international certification standards for AGI systems, and founding a dedicated UN agency focused exclusively on AGI governance .

The core argument from AGI experts is straightforward: if humanity doesn't act now, AGI will act for us. Unlike Y2K, which the world successfully navigated, AGI represents a qualitatively different challenge. The technology could solve novel problems and rewrite its own objectives in ways humans cannot predict or control. The risks are existential, meaning they could threaten human civilization itself if AGI development proceeds without adequate safety measures and international coordination .

Washington opposed the establishment of the UN's AI Panel and did not support its creation, partly because officials recognized that AI governance frameworks miss the central issue: AGI is developing faster than institutions can respond. The UN's current structure, juggling climate change, development, and peacekeeping, may lack the focus and agility required to address a technology that could fundamentally reshape global power dynamics and human agency .

The path forward requires acknowledging that the UN's AI Panel, while well-intentioned, is insufficient. The High-Level Expert Panel on AGI offers a clearer route: concrete steps including a global observatory, international certification, a dedicated AGI agency, and an emergency General Assembly session. Without these measures, humanity risks allowing AGI to become the grand marshal of its own future, determining the world's narrative, direction, and pace without meaningful human input or control .