https://arxiv.org/abs/1607.00913

close this message

Donate to arXiv

Please join the Simons Foundation and our generous member
organizations in supporting arXiv during our giving campaign
September 23-27. 100% of your contribution will fund improvements and
new initiatives to benefit arXiv's global scientific community.

DONATE

[secure site, no need to create account]

Skip to main content
Cornell University
We gratefully acknowledge support from
the Simons Foundation and member institutions.
 
arXiv.org > cs > arXiv:1607.00913
[                    ]

Help | Advanced Search

[All fields        ]
Search
arXiv
Cornell University Logo
[                    ] GO
quick links

  * Login
  * Help Pages
  * About

Computer Science > Computers and Society

arXiv:1607.00913 (cs)
[Submitted on 4 Jul 2016]

Title:Superintelligence cannot be contained: Lessons from
Computability Theory

Authors:Manuel Alfonseca, Manuel Cebrian, Antonio Fernandez Anta,
Lorenzo Coviello, Andres Abeliuk, Iyad Rahwan
Download PDF

    Abstract: Superintelligence is a hypothetical agent that
    possesses intelligence far surpassing that of the brightest and
    most gifted human minds. In light of recent advances in machine
    intelligence, a number of scientists, philosophers and
    technologists have revived the discussion about the potential
    catastrophic risks entailed by such an entity. In this article,
    we trace the origins and development of the neo-fear of
    superintelligence, and some of the major proposals for its
    containment. We argue that such containment is, in principle,
    impossible, due to fundamental limits inherent to computing
    itself. Assuming that a superintelligence will contain a program
    that includes all the programs that can be executed by a
    universal Turing machine on input potentially as complex as the
    state of the world, strict containment requires simulations of
    such a program, something theoretically (and practically)
    infeasible.

Comments: 7 pages, 5 figures
Subjects: Computers and Society (cs.CY); Artificial Intelligence
          (cs.AI)
Cite as:  arXiv:1607.00913 [cs.CY]
          (or arXiv:1607.00913v1 [cs.CY] for this version)

Submission history

From: Iyad Rahwan [view email]
[v1] Mon, 4 Jul 2016 14:44:21 UTC (1,508 KB)
Full-text links:

Download:

  * PDF
  * Other formats

(license)
Current browse context:
cs.CY
< prev   |   next >
new | recent | 1607
Change to browse by:
cs
cs.AI

References & Citations

  * NASA ADS
  * Google Scholar
  * Semantic Scholar

DBLP - CS Bibliography

listing | bibtex
Manuel Alfonseca
Manuel Cebrian
Antonio Fernandez Anta
Lorenzo Coviello
Andres Abeliuk
...
a export bibtex citation Loading...

Bibtex formatted citation

x
[loading...          ]
Data provided by:

Bookmark

BibSonomy logo Mendeley logo Reddit logo ScienceWISE logo
(*) About arXivLabs

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and
share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have
embraced and accepted our values of openness, community, excellence,
and user data privacy. arXiv is committed to these values and only
works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community?
Learn more about arXivLabs and how to get involved.

( ) Bibliographic Tools

Bibliographic and Citation Tools

[ ] Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
( ) Code

Code Associated with this Article

[ ] arXiv Links to Code Toggle
arXiv Links to Code (What is Links to Code?)
( ) Recommenders

Recommenders and Search Tools

[ ] Core recommender toggle
CORE Recommender (What is CORE?)
Which authors of this paper are endorsers? | Disable MathJax (What is
MathJax?)

  * About
  * Help

  * Click here to contact arXiv Contact
  * Click here to subscribe Subscribe

  * Copyright
  * Privacy Policy

  * Web Accessibility Assistance
  * arXiv Operational Status
    Get status notifications via email or slack