The King has warned of the “existential dangers” of artificial intelligence (AI) systems falling into the wrong hands, as he addressed tech leaders at a summit on the future of the technology.
Charles told an audience that included bosses from Nvidia, Anthropic, Google DeepMind and OpenAI that decisions taken today on the technology will “shape the world inherited by future generations”, and he called on them to ensure that as they develop the technology, “our humanity remains sacred”.
The event at Dumfries House in Cumnock, East Ayrshire, was also attended by guests including the chief advisor to the Vatican on the ethics of AI and technology, the UK’s AI Minister, government advisors and others.
Giving his opening address, Charles told the audience the development of AI is “both intriguing and deeply concerning in equal measure.”
PA Media“AI is already showing its immense capacity to improve and save life – for example, in the field of life sciences and medicine,” he said.
“Yet, those who have created these technologies are now increasingly warning that AI risks developing darker capacities – perhaps even to take life.
“In this regard, if I may say so, there seems urgency in adequately considering the existential dangers of such technologies falling into the wrong hands, and being used in potentially catastrophic ways.
“Surely, we need sufficient means of control before it is all too late?”
He added: “The decisions taken at this formative time will shape the world inherited by future generations.
“And so, the task before you is not merely to advance technology, but to ensure that it remains firmly in the service of humanity, community and the natural world.
“As we embrace what is new, we must not lose what is timeless.”
After the King’s address, Nvidia chief executive Jensen Huang and Google DeepMind chairman Demis Hassabis gave speeches highlighting the benefits AI can bring to humanity.
PA MediaSpeaking to journalists ahead of his speech, Mr Huang, who has been one of the industry figures resisting recent calls for tighter regulation of the sector, said it was the “responsibility” of AI companies to properly test the technology before releasing it.
“There were incidents, and those incidents thankfully did no harm,” he said.
“But those incidents are a reminder that as we move from labs to product development, the companies have to become much more rigorous in testing and securing and making sure that the products are ready for use before (they are) released.
“And in doing so, if it’s not ready, just hold it back. You should go as fast as you can, but no faster than that.”
He added: “We know that this technology is advancing very quickly, so we have to do it safely and securely.
“But don’t lose sight of the ultimate prize, which is the incredible impact that the technology can bring to all the different economies and societies.”
The event comes as an excerpt from a new book called Swan Song, about Diana, Princess of Wales written by her brother Earl Spencer, was published by the Daily Mail claiming that after her death in 1997 the King said “rest assured, we’ll forget her soon enough”.
Buckingham Palace pushed back against the claim, with a spokesman saying Charles is “mindful that the pain of fraternal grief can cloud reason”.
Doomsday warnings have been levelled at AI, seen by some as a threat to the existence of humanity, sparking a debate among industry leaders over how best to rein in the technology before it could escape human control.
On Thursday, the chief executive of Microsoft AI said “we’re essentially seeding a new silicon species” and suggested competitors Anthropic were paving the way.
Mustafa Suleyman told the BBC’s Today programme: “I think that if we all create AIs that are able to act autonomously, that can define their own objectives, that can earn money, that can own assets, that could run businesses, we’re essentially seeding a new silicon species which will no doubt compete with us for resources – no matter how much it cares about humanity and loves us.
“Which is, I think, Anthropic’s intention. I think that is mistaken and misguided but we have to empirically test it.
“And so if they believe that this is a safer route to developing AIs then they have to share the data to prove that, and I think instead we should be creating AIs that don’t introspect.”
Anthropic researcher Evan Hubinger sparked headlines around the world when he warned last week he believed there was a greater than 10% chance AI could pose a species-ending risk within 10 years.
Follow STV News on WhatsApp
Scan the QR code on your mobile device for all the latest news from around the country
