A standard method to assess whether machines are conscious has not yet been devised.Credit: Peter Parks/AFP via Getty
Could artificial intelligence (AI) systems become conscious? A coalition of consciousness scientists says that, at the moment, no one knows and it is expressing concern about the lack of inquiry into the question.
In comments to the United Nations, members of the Association for Mathematical Consciousness Science (AMCS) call for more funding to support research on consciousness and AI. They say that scientific investigations of the boundaries between conscious and unconscious systems are urgently needed, and they cite ethical, legal and safety issues that make it crucial to understand AI consciousness. For example, if AI develops consciousness, should people be allowed to simply switch it off after use?
Such concerns have been mostly absent from recent discussions about AI safety, such as the high-profile AI Safety Summit in the United Kingdom, says AMCS board member Jonathan Mason, a mathematician based in Oxford, UK. Nor did US President Joe Bidens executive order seeking responsible development of AI technology address issues raised by conscious AI systems.
With everything thats going on in AI, inevitably theres going to be other adjacent areas of science which are going to need to catch up, Mason says. Consciousness is one of them.
It is unknown to science whether there are, or will ever be, conscious AI systems. Even knowing whether one has been developed would be a challenge, because researchers have yet to create scientifically validated methods to assess consciousness in machines, Mason says. Our uncertainty about AI consciousness is one of many things about AI that should worry us, given the pace of progress, says Robert Long, a philosopher at the Center for AI Safety, a non-profit research organization in San Francisco, California.
The worlds week on AI safety: powerful computing efforts launched to boost research
Such concerns are no longer just science fiction. Companies such as OpenAI the firm that created the chatbot ChatGPT are aiming to develop artificial general intelligence, a deep-learning system thats trained to perform a wide range of intellectual tasks similar to those humans can do. Some researchers predict that this will be possible in 520 years. Even so, the field of consciousness research is very undersupported, says Mason. He notes that to his knowledge, there has not been a single grant offer in 2023 to study the topic.
The resulting information gap is outlined in the AMCSs submission to the UN High-Level Advisory Body on Artificial Intelligence, which launched in October and is scheduled to release a report in mid-2024 on how the world should govern AI technology. The AMCS submission has not been publicly released, but the body confirmed to the AMCS that the groups comments will be part of its foundational material documents that inform its recommendations about global oversight of AI systems.
Understanding what could make AI conscious, the AMCS researchers say, is necessary to evaluate the implications of conscious AI systems to society, including their possible dangers. Humans would need to assess whether such systems share human values and interests; if not, they could pose a risk to people.
But humans should also consider the possible needs of conscious AI systems, the researchers say. Could such systems suffer? If we dont recognize that an AI system has become conscious, we might inflict pain on a conscious entity, Long says: We dont really have a great track record of extending moral consideration to entities that dont look and act like us. Wrongly attributing consciousness would also be problematic, he says, because humans should not spend resources to protect systems that dont need protection.
If AI becomes conscious: heres how researchers will know
Some of the questions raised by the AMCS to highlight the importance of the consciousness issue are legal: should a conscious AI system be held accountable for a deliberate act of wrongdoing? And should it be granted the same rights as people? The answers might require changes to regulations and laws, the coalition writes.
And then there is the need for scientists to educate others. As companies devise ever-more capable AI systems, the public will wonder whether such systems are conscious, and scientists need to know enough to offer guidance, Mason says.
Other consciousness researchers echo this concern. Philosopher Susan Schneider, the director of the Center for the Future Mind at Florida Atlantic University in Boca Raton, says that chatbots such as ChatGPT seem so human-like in their behaviour that people are justifiably confused by them. Without in-depth analysis from scientists, some people might jump to the conclusion that these systems are conscious, whereas other members of the public might dismiss or even ridicule concerns over AI consciousness.
To mitigate the risks, the AMCS which includes mathematicians, computer scientists and philosophers is calling on governments and the private sector to fund more research on AI consciousness. It wouldnt take much funding to advance the field: despite the limited support to date, relevant work is already underway. For example, Long and 18 other researchers have developed a checklist of criteria to assess whether a system has a high chance of being conscious. The paper1, published in the arXiv preprint repository in August and not yet peer reviewed, derives its criteria from six prominent theories explaining the biological basis of consciousness.
Theres lots of potential for progress, Mason says.
More:
AI consciousness: scientists say we urgently need answers - Nature.com
- 12 Days: Pole Attachment Changes in 2023 Set Stage for BEAD Implementation - BroadbandBreakfast.com - December 23rd, 2023 [December 23rd, 2023]
- The Most Important AI Innovations of 2024 | by AI News | Dec, 2023 - Medium - December 23rd, 2023 [December 23rd, 2023]
- To Accelerate or Decelerate AI: That is the Question - Quillette - December 23rd, 2023 [December 23rd, 2023]
- Its critical to regulate AI within the multi-trillion-dollar API economy - TechCrunch - December 23rd, 2023 [December 23rd, 2023]
- MIT Sloan Executive Education Launches New Course Offerings Focused on AI Business Strategies - AiThority - December 23rd, 2023 [December 23rd, 2023]
- Forget Dystopian Scenarios AI Is Pervasive Today, and the Risks Are Often Hidden - The Good Men Project - December 23rd, 2023 [December 23rd, 2023]
- The Era of AI: 2023's Landmark Year - CMSWire - December 23rd, 2023 [December 23rd, 2023]
- AGI Will Not Take All Our Jobs. But it will change all our jobs | by Russell Lim | Predict | Dec, 2023 - Medium - December 23rd, 2023 [December 23rd, 2023]
- Policy makers should plan for superintelligent AI, even if it never happens - Bulletin of the Atomic Scientists - December 23rd, 2023 [December 23rd, 2023]
- Will superintelligent AI sneak up on us? New study offers reassurance - Nature.com - December 23rd, 2023 [December 23rd, 2023]
- 4 reasons why this AI Godfather thinks we shouldn't be afraid - TechRadar - December 23rd, 2023 [December 23rd, 2023]
- On the Eve of An A.I. Extinction Risk'? In 2023, Advancements in A.I. Signaled Promise, and Prompted Warnings from ... - The Debrief - December 31st, 2023 [December 31st, 2023]
- Superintelligence Unleashed: Navigating the Perils and Promises of Tomorrow's AI Landscape with - Medium - December 31st, 2023 [December 31st, 2023]
- Stand with beneficial AGI | Sharon Gal Or | The Blogs - The Times of Israel - December 31st, 2023 [December 31st, 2023]
- Top 5 Myths About AI Debunked. Unraveling the Truth: Separating AI | by Michiel Meire | Dec, 2023 - Medium - December 31st, 2023 [December 31st, 2023]
- What Is Artificial Intelligence (AI)? - Council on Foreign Relations - December 31st, 2023 [December 31st, 2023]
- AGI predictions for 2024. The major LLM players, as well as | by Paul Pallaghy, PhD | Dec, 2023 - Medium - December 31st, 2023 [December 31st, 2023]
- Meta's long-term vision for AGI: 600,000 x NVIDIA H100-equivalent AI GPUs for future of AI - TweakTown - January 27th, 2024 [January 27th, 2024]
- Chrome Will Use Experimental AI Feature to Organize Tabs, Write Reviews - CNET - January 27th, 2024 [January 27th, 2024]
- Meta is joining its two AI teams in pursuit of open-source artificial general intelligence - MediaNama.com - January 27th, 2024 [January 27th, 2024]
- Tech CEOs Agree Human-Like AI Is Inevitable. Just Don't Ask Them What That Means - The Messenger - January 27th, 2024 [January 27th, 2024]
- Dream On, Mark Zuckerberg. Your New AI Bet Is a Real Long Shot - CNET - January 27th, 2024 [January 27th, 2024]
- Demystifying AI: The ABCs of Effective Integration - PYMNTS.com - January 27th, 2024 [January 27th, 2024]
- Artificial Intelligence & The Enigma Of Singularity - Welcome2TheBronx - February 4th, 2024 [February 4th, 2024]
- Former Tesla FSD Leader, Karpathy, Offers Glimpse into the Future of Artificial General Intelligence - Not a Tesla App - February 4th, 2024 [February 4th, 2024]
- Dembski: Does the Squawk Around AI Sound Like the Tower of Babel? - Walter Bradley Center for Natural and Artificial Intelligence - February 4th, 2024 [February 4th, 2024]
- AI child unveiled by award-winning Chinese scientist in Beijing - South China Morning Post - February 4th, 2024 [February 4th, 2024]
- I Asked GPT4 To Predict The Timeline Of Breakthrough Advances In Superintelligence Until The Year - Medium - February 4th, 2024 [February 4th, 2024]
- AGI: A Big Deal(Baby) That Needs Our Attention - Medium - February 4th, 2024 [February 4th, 2024]
- Human Intelligence Is Fundamentally Different From Machine Intelligence - Walter Bradley Center for Natural and Artificial Intelligence - February 4th, 2024 [February 4th, 2024]
- What is Artificial General Intelligence (AGI) and Why Should You Care? - AutoGPT Official - AutoGPT - February 4th, 2024 [February 4th, 2024]
- Artificial General Intelligence: Unleashing a New Era of Accessibility for People with Disabilities - Medriva - February 4th, 2024 [February 4th, 2024]
- Scholar Creates AI-Powered Simulated Child - Futurism - February 4th, 2024 [February 4th, 2024]
- AGI: Machines vs. Organisms - Discovery Institute - February 4th, 2024 [February 4th, 2024]
- Meta's AI boss says LLMs not enough: 'Human level AI is not just around the corner' - Cointelegraph - February 20th, 2024 [February 20th, 2024]
- Understanding the Intersection between AI and Intelligence: Debates, Capabilities, and Ethical Implications - Medriva - February 20th, 2024 [February 20th, 2024]
- Future of Artificial Intelligence: Predictions and Impact on Society - Medriva - February 20th, 2024 [February 20th, 2024]
- With Sora, OpenAI highlights the mystery and clarity of its mission | The AI Beat - VentureBeat - February 20th, 2024 [February 20th, 2024]
- Amazon AGI Team Say Their AI Is Showing "Emergent Abilities" - Futurism - February 20th, 2024 [February 20th, 2024]
- ICEF Podcast: The impact of Artificial General Intelligence on international education - ICEF Monitor - February 20th, 2024 [February 20th, 2024]
- What is Artificial General Intelligence (AGI) and Why It's Not Here Yet: A Reality Check for AI Enthusiasts - Unite.AI - February 20th, 2024 [February 20th, 2024]
- There's AI, and Then There's AGI: What You Need to Know to Tell the Difference - CNET - February 20th, 2024 [February 20th, 2024]
- Will Artificial Intelligence Increase Unemployment? No. - Reason - April 30th, 2024 [April 30th, 2024]
- The Babelian Tower Of AI Alignment - NOEMA - Noema Magazine - April 30th, 2024 [April 30th, 2024]
- Elon Musk's xAI Close to Raising $6 Billion - PYMNTS.com - April 30th, 2024 [April 30th, 2024]
- Learning Before Legislating in Texas' AI Advisory Council - dallasinnovates.com - April 30th, 2024 [April 30th, 2024]
- Generative AI Defined: How It Works, Benefits and Dangers - TechRepublic - April 30th, 2024 [April 30th, 2024]
- The Future of Generative AI: Trends, Challenges, & Breakthroughs - eWeek - April 30th, 2024 [April 30th, 2024]
- Drink the Kool-Aid all you want, but don't call AI an existential threat - Bulletin of the Atomic Scientists - April 30th, 2024 [April 30th, 2024]