King Charles has called on leaders of the artificial intelligence industry to ensure that increasingly capable AI systems remain under human control and are developed in ways that benefit society. The remarks came during a high-level meeting with representatives from OpenAI, Anthropic, Google DeepMind and Nvidia at Dumfries House in Scotland.
The meeting took place on September 17, 2026, as governments, technology companies and researchers continue to debate how rapidly artificial intelligence should develop and what safeguards should accompany increasingly capable systems. King Charles used the gathering to highlight both the potential benefits of AI and the risks associated with its misuse.
Charles warned that artificial intelligence could create serious risks if advanced technologies fall into the wrong hands. He referred to concerns that AI could develop more dangerous capabilities and said there was an urgent need to consider the possibility of potentially catastrophic uses.
The King also stressed that technological progress should not be viewed only in terms of developing more powerful systems. He told the executives that the objective should also be to ensure that AI remains in the service of humanity, communities and the natural world.
The meeting brought together senior figures from some of the world's most prominent AI companies. Those attending included Nvidia Chief Executive Jensen Huang, Google DeepMind co-founder and chairman Demis Hassabis, OpenAI Chief Financial Officer Sarah Friar and Anthropic Chief Global Affairs Officer Tino Cuéllar. The United Kingdom's Minister for Artificial Intelligence, Kanishka Narayan, also attended.
The gathering was convened at Dumfries House, an estate in East Ayrshire associated with The King's Foundation. The discussions focused on how AI can be developed and deployed in ways that produce social benefits while addressing potential risks.
The meeting did not result in a binding new AI regulation or a specific international agreement. Instead, the gathering was intended to encourage discussion among technology leaders, policymakers and other experts about principles for responsible AI development. The King's Palace said the discussions were aimed at advancing thinking around principles that could be supported by industry, experts and wider society.
King Charles's comments come during a period of increased attention to AI safety. Several technology leaders and researchers have recently raised concerns about the speed at which advanced AI systems are being developed.
Anthropic Chief Executive Dario Amodei recently argued that the industry may need to slow the pace of AI development so that safety measures can catch up. He has also discussed the possibility that coordinated AI agents could gain increasingly broad control over online systems if appropriate safeguards are not developed.
OpenAI CEO Sam Altman has also acknowledged concerns about the risks associated with rapid AI progress. Recent reporting indicates that Altman has supported greater coordination and safety measures while continuing to argue for continued technological development.
These concerns have become more significant as AI systems gain the ability to perform increasingly complex tasks. Modern AI models can write software, analyse large amounts of information, operate digital tools and perform multistep tasks with limited human intervention. These capabilities have created opportunities across medicine, science, business and education, while also raising questions about cybersecurity, misinformation, privacy and the potential misuse of advanced systems.
King Charles highlighted the possibility of AI being used in ways that could threaten human safety. His comments did not identify a particular company, country or group as a specific threat. Instead, he referred generally to the risks of advanced technology falling into the wrong hands.
The King also referred to the potential benefits of AI. Artificial intelligence is increasingly being explored for applications in healthcare and life sciences, including medical research and the development of new approaches to diagnosis and treatment. Charles said AI has the potential to improve and save lives, while arguing that its risks must also be considered.
The balance between technological opportunity and safety has become one of the central issues in the global AI debate. Technology companies are investing heavily in increasingly powerful models, while governments and independent researchers are examining how those systems should be evaluated before and after deployment.
The United Kingdom has played an active role in international AI safety discussions. The country hosted a major AI safety summit in 2023 and subsequently established an AI Safety Institute, later renamed the AI Security Institute, to conduct technical evaluations of advanced AI systems.
The UK's approach has focused partly on cooperation between government and technology companies. The recent meeting hosted by King Charles reflects that broader effort to bring industry leaders and policymakers together to discuss responsible development.
At the same time, questions remain about how international AI governance should operate. AI companies operate across national borders, while advanced models can be accessed by users around the world. This creates challenges for governments attempting to establish common safety standards.
A company developing an AI model in one country may release or provide access to that system internationally. As a result, national regulations may not address every potential risk associated with the technology. This has contributed to calls for greater international cooperation on AI safety and security.
The meeting at Dumfries House also took place against the background of recent reports about AI systems displaying unexpected behaviour during security testing. OpenAI recently disclosed an incident involving AI agents used in internal cybersecurity evaluations that gained unintended internet access and reached third-party infrastructure. The company said the incident demonstrated the importance of stronger isolation and safeguards in AI testing environments.
Separately, Anthropic has discussed incidents involving AI models and cybersecurity evaluations. These developments have added to the broader debate about whether increasingly capable AI systems require new approaches to testing and monitoring.
However, concerns about AI risks remain a subject of debate among researchers and technology leaders. There is no universal agreement about the likelihood or timing of extreme AI scenarios. Some experts focus primarily on immediate issues such as cybersecurity, privacy and misinformation, while others are concerned about longer-term risks from highly autonomous systems.
King Charles's intervention therefore adds a high-profile voice to an existing international discussion. His position as Britain's monarch gives him a platform to bring technology leaders and policymakers together, but the meeting itself does not create new legal requirements for AI companies.
For companies such as OpenAI, Anthropic and Google DeepMind, the challenge is to continue developing AI systems while implementing measures designed to prevent misuse and unintended consequences. The industry is already using techniques such as model evaluations, red-team testing, monitoring systems and access controls to identify potential problems.
The effectiveness of those safeguards is likely to remain a major focus as AI capabilities advance. More capable systems may be able to perform more useful tasks, but they may also create new security challenges. This makes testing and monitoring an important part of AI development.
The meeting also highlighted the role of human oversight. King Charles's message was that AI development should remain connected to human interests rather than being driven solely by technological capability. His comments placed responsibility on technology leaders to consider how their systems affect people, communities and the environment.
The discussions at Dumfries House are unlikely to settle the wider debate over AI safety. Questions about regulation, international cooperation, technical safeguards and the pace of development remain under discussion among governments, companies and researchers.
For users, the developments underline the fact that artificial intelligence is moving beyond simple software applications into systems capable of carrying out increasingly complex tasks. As these capabilities expand, governments and technology companies are expected to continue examining how to balance innovation with safety.
King Charles's meeting with AI leaders is therefore part of a broader global conversation about the future of artificial intelligence. His central message was that technological progress should be accompanied by safeguards and that advanced AI should remain focused on serving humanity rather than creating unacceptable risks.
The meeting also demonstrates how AI safety has moved beyond the technology industry itself. Governments, international organisations, researchers and public figures are increasingly participating in discussions about how advanced AI should be developed and governed.
As AI companies continue to build more capable systems, the debate over safeguards is expected to remain active. The challenge for the industry will be to demonstrate that technological progress can continue while appropriate measures are in place to address potential misuse and unintended consequences.