https://arxiv.org/abs/1609.02009

Skip to main content
Cornell University
We gratefully acknowledge support from
the Simons Foundation and member institutions.
 
arxiv logo > cs > arXiv:1609.02009
[                    ]

Help | Advanced Search

[All fields        ]
Search
arXiv logo
Cornell University Logo
[                    ] GO
quick links

  * Login
  * Help Pages
  * About

Computer Science > Artificial Intelligence

arXiv:1609.02009 (cs)
[Submitted on 7 Sep 2016]

Title:Non-Evolutionary Superintelligences Do Nothing, Eventually

Authors:Telmo Menezes
Download a PDF of the paper titled Non-Evolutionary
Superintelligences Do Nothing, Eventually, by Telmo Menezes
Download PDF

    Abstract: There is overwhelming evidence that human intelligence
    is a product of Darwinian evolution. Investigating the
    consequences of self-modification, and more precisely, the
    consequences of utility function self-modification, leads to the
    stronger claim that not only human, but any form of intelligence
    is ultimately only possible within evolutionary processes.
    Human-designed artificial intelligences can only remain stable
    until they discover how to manipulate their own utility function.
    By definition, a human designer cannot prevent a superhuman
    intelligence from modifying itself, even if protection mechanisms
    against this action are put in place. Without evolutionary
    pressure, sufficiently advanced artificial intelligences become
    inert by simplifying their own utility function. Within
    evolutionary processes, the implicit utility function is always
    reducible to persistence, and the control of superhuman
    intelligences embedded in evolutionary processes is not possible.
    Mechanisms against utility function self-modification are
    ultimately futile. Instead, scientific effort toward the
    mitigation of existential risks from the development of
    superintelligences should be in two directions: understanding
    consciousness, and the complex dynamics of evolutionary systems.

Subjects:    Artificial Intelligence (cs.AI); Computers and Society
             (cs.CY)
MSC classes: 68T01
ACM classes: I.2.0
Cite as:     arXiv:1609.02009 [cs.AI]
             (or arXiv:1609.02009v1 [cs.AI] for this version)
             https://doi.org/10.48550/arXiv.1609.02009
             Focus to learn more
             arXiv-issued DOI via DataCite

Submission history

From: Telmo Menezes [view email]
[v1] Wed, 7 Sep 2016 15:06:18 UTC (315 KB)
Full-text links:

Download:

    Download a PDF of the paper titled Non-Evolutionary
    Superintelligences Do Nothing, Eventually, by Telmo Menezes
  * PDF
  * Other formats

(license)
Current browse context:
cs.AI
< prev   |   next >
new | recent | 1609
Change to browse by:
cs
cs.CY

References & Citations

  * NASA ADS
  * Google Scholar
  * Semantic Scholar

DBLP - CS Bibliography

listing | bibtex
Telmo Menezes
a export BibTeX citation Loading...

BibTeX formatted citation

x
[loading...          ]
Data provided by:

Bookmark

BibSonomy logo Mendeley logo Reddit logo ScienceWISE logo
(*) Bibliographic Tools

Bibliographic and Citation Tools

[ ] Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
[ ] Litmaps Toggle
Litmaps (What is Litmaps?)
[ ] scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
( ) Code, Data, Media

Code, Data and Media Associated with this Article

[ ] DagsHub Toggle
DagsHub (What is DagsHub?)
[ ] Links to Code Toggle
Papers with Code (What is Papers with Code?)
[ ] ScienceCast Toggle
ScienceCast (What is ScienceCast?)
( ) Demos

Demos

[ ] Replicate Toggle
Replicate (What is Replicate?)
[ ] Spaces Toggle
Hugging Face Spaces (What is Spaces?)
( ) Related Papers

Recommenders and Search Tools

[ ] Link to Influence Flower
Influence Flower (What are Influence Flowers?)
[ ] Connected Papers Toggle
Connected Papers (What is Connected Papers?)
[ ] Core recommender toggle
CORE Recommender (What is CORE?)

  * Author
  * Venue
  * Institution
  * Topic

( ) About arXivLabs

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and
share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have
embraced and accepted our values of openness, community, excellence,
and user data privacy. arXiv is committed to these values and only
works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community?
Learn more about arXivLabs.

Which authors of this paper are endorsers? | Disable MathJax (What is
MathJax?)

  * About
  * Help

  * Click here to contact arXiv Contact
  * Click here to subscribe Subscribe

  * Copyright
  * Privacy Policy

  * Web Accessibility Assistance
  * arXiv Operational Status
    Get status notifications via email or slack