#intelligence #paper #ML
Superintelligence Cannot be Contained: Lessons from Computability Theory
https://www.jair.org/index.php/jair/article/view/12202
> We argue that total containment is, in principle, impossible, due to fundamental limits inherent to computing itself. Assuming that a superintelligence will contain a program that includes all the programs that can be executed by a universal Turing machine on input potentially as complex as the state of the world, strict containment requires simulations of such a program, something theoretically (and practically) impossible.
Superintelligence Cannot be Contained: Lessons from Computability Theory
https://www.jair.org/index.php/jair/article/view/12202
> We argue that total containment is, in principle, impossible, due to fundamental limits inherent to computing itself. Assuming that a superintelligence will contain a program that includes all the programs that can be executed by a universal Turing machine on input potentially as complex as the state of the world, strict containment requires simulations of such a program, something theoretically (and practically) impossible.