Re: ESSAY: How to deter a rogue AI by using your first-mover advantage

From: Mika Letonsaari (
Date: Thu Aug 23 2007 - 06:36:59 MDT

Those of you who believe in this argument must be very religious
people. I mean, isn't this kind of similar to religion, where someone
is telling you without good evidence, that there is someone capable of
pulling the plug or doing other nasty stuff if you don't obey his

Probably the superuser of the universe wouldn't just pull the plug,
because he would end the lives of all other intelligences in the
simulation too. And because obviously the superuser wouldn't use his
power to stop smaller suffering (because he doesn't want to be seen),
maybe the punishment would be something more abstract like going to
hell after AI reaches the goal, if the goal is achieved by hurting
other intelligences? And all the thinking why superuser allows bad
things etc...

But of course it might work. Most people believe in something
supernatural, even some intelligent ones. So maybe the AI will too.


This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:00:58 MDT