Re: continuity of self [ was META: Sept. 11 and Singularity]

From: Eliezer S. Yudkowsky (
Date: Sun Sep 15 2002 - 17:19:38 MDT

Cliff Stabbert wrote:
> How big would the temptation be for any current superpower to grab the
> first workable nanotech or the first usable general AI and use it to
> wield power over others?

Stealing the first workable nanotech is one thing. "Stealing" a general
AI is a bit different from stealing its physical hardware. AI is not a
tool. It is a mind. Moving an AI from one place to another doesn't make
it a tool in your hands, any more than moving Gandhi from India to Germany
causes him to become a Nazi. Now of course potential thieves may not know
that, but if so, failing to keep track of the distinction ourselves is
hardly conducive to enlightening them.

Eliezer S. Yudkowsky
Research Fellow, Singularity Institute for Artificial Intelligence

This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:00:41 MDT