Re: continuity of self [ was META: Sept. 11 and Singularity]

From: Eliezer S. Yudkowsky (sentience@pobox.com)
Date: Sun Sep 15 2002 - 17:19:38 MDT


Cliff Stabbert wrote:
>
> How big would the temptation be for any current superpower to grab the
> first workable nanotech or the first usable general AI and use it to
> wield power over others?

Stealing the first workable nanotech is one thing. "Stealing" a general
AI is a bit different from stealing its physical hardware. AI is not a
tool. It is a mind. Moving an AI from one place to another doesn't make
it a tool in your hands, any more than moving Gandhi from India to Germany
causes him to become a Nazi. Now of course potential thieves may not know
that, but if so, failing to keep track of the distinction ourselves is
hardly conducive to enlightening them.

--
Eliezer S. Yudkowsky http://intelligence.org/
Research Fellow, Singularity Institute for Artificial Intelligence






This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:00:41 MDT