{"id":52107,"date":"2023-05-24T14:08:52","date_gmt":"2023-05-24T14:08:52","guid":{"rendered":"https:\/\/packetstormsecurity.com\/news\/view\/34649\/OpenAI-Leaders-Call-For-Regulation-To-Prevent-AI-Destroying-Humanity.html"},"modified":"2023-05-24T14:08:52","modified_gmt":"2023-05-24T14:08:52","slug":"openai-leaders-call-for-regulation-to-prevent-ai-destroying-humanity","status":"publish","type":"post","link":"https:\/\/www.threatshub.org\/blog\/openai-leaders-call-for-regulation-to-prevent-ai-destroying-humanity\/","title":{"rendered":"OpenAI Leaders Call For Regulation To Prevent AI Destroying Humanity"},"content":{"rendered":"
<\/div>\n

The leaders of the ChatGPT<\/a> developer OpenAI have called for the regulation of \u201csuperintelligent\u201d AIs, arguing that an equivalent to the International Atomic Energy Agency is needed to protect humanity from the risk of accidentally creating something with the power to destroy it.<\/p>\n

In a short note<\/a> published to the company\u2019s website, co-founders Greg Brockman and Ilya Sutskever and the chief executive, Sam Altman, call for an international regulator to begin working on how to \u201cinspect systems, require audits, test for compliance with safety standards, [and] place restrictions on degrees of deployment and levels of security\u201d in order to reduce the \u201cexistential risk\u201d such systems could pose.<\/p>\n

\u201cIt\u2019s conceivable that within the next 10 years, AI systems will exceed expert skill level in most domains, and carry out as much productive activity as one of today\u2019s largest corporations,\u201d they write. \u201cIn terms of both potential upsides and downsides, superintelligence will be more powerful than other technologies humanity has had to contend with in the past. We can have a dramatically more prosperous future; but we have to manage risk to get there. Given the possibility of existential risk, we can\u2019t just be reactive.\u201d<\/p>\n

<\/gu-island><\/figure>\n

In the shorter term, the trio call for \u201csome degree of coordination\u201d amongcompanies working on the cutting-edge of AI research, in order to ensure the development of ever-more powerful models integrates smoothly with society while prioritising safety. That coordination could come through a government-led project, for instance, or through a collective agreement to limit growth in AI capability.<\/p>\n

Researchers have been warning of the potential risks of superintelligence for decades, but as AI development has picked up pace those risks have become more concrete. The US-based Center for AI Safety (CAIS), which works to \u201creduce societal-scale risks from artificial intelligence\u201d, describes eight categories of \u201ccatastrophic\u201d and \u201cexistential\u201d risk that AI development could pose.<\/p>\n

While some worry about a powerful AI completely destroying humanity, accidentally or on purpose, CAIS describes other more pernicious harms. A world where AI systems are voluntarily handed ever more labour could lead to humanity \u201closing the ability to self-govern and becoming completely dependent on machines\u201d, described as \u201cenfeeblement\u201d; and a small group of people controlling powerful systems could \u201cmake AI a centralising force\u201d, leading to \u201cvalue lock-in\u201d, an eternal caste system between ruled and rulers.<\/p>\n

OpenAI\u2019s leaders say those risks mean \u201cpeople around the world should democratically decide on the bounds and defaults for AI systems\u201d, but admit that \u201cwe don\u2019t yet know how to design such a mechanism\u201d. However, they say continued development of powerful systems is worth the risk.<\/p>\n

skip past newsletter promotion<\/a><\/p>\n