

OpenAI CEO Sam Altman and Anthropic CEO Dario Amodei are taking the debate over artificial intelligence safety to the United Nations Security Council, as governments examine how increasingly powerful AI models could affect national and international security.
The two executives are expected to brief the 15-member council alongside Hugging Face co-founder Clément Delangue and AI researcher Yoshua Bengio. Representatives from Chinese AI developers DeepSeek and Moonshot have also been invited, according to Reuters, bringing competing US and Chinese approaches to frontier AI into the same global forum.
Altman is expected to advocate for common benchmarks that governments and AI developers can use to measure increasingly advanced AI capabilities and assess whether adequate safeguards are in place.
Such standardized testing could eventually influence when cutting-edge AI models are released, how extensively they are evaluated beforehand, and how much developers invest in safety infrastructure. The issue could therefore affect the AI industry and investors.
The discussion comes amid growing concerns about increasingly autonomous AI systems. There are fears that advanced models could eventually act in ways developers struggle to control, potentially creating cybersecurity or national-security risks.
Also Read: AI Gets Cheaper: OpenAI Anthropic Target Businesses with New Models
Anthropic has separately called for companies to slow the pace of AI capability development, giving governments and researchers more time to address potential risks.
OpenAI has also been working with Anthropic and Google DeepMind on AI safety measures. OpenAI's global policy chief Chris Lehane said the companies had been engaged on the issue for several weeks.
The debate comes as governments remain divided over how aggressively to regulate AI development. US President Donald Trump, in a statement to the UN General Assembly on Tuesday, expressed the US administration's position opposing wide-ranging limits on US AI development.
In contrast, UN Secretary-General António Guterres has called for more international regulation and oversight of the risks posed by advanced AI technologies.
The debate within the UN Security Council brings AI safety, international cooperation, and AI development into the limelight.