Re: [sl4] Re: Uploads coming first would be good, right?

From: Michael Anissimov (michaelanissimov@gmail.com)
Date: Thu Feb 19 2009 - 16:38:01 MST


Hi Aleksei,

Uploading would not be such a great idea even if it came first, for the
simple fact that the technology is likely to be imperfect in its first
iteration. This will greatly increase the risk of spontaneously going
insane. (Moderate-resolution brain scans might not transfer over every
single low-level element necessary for sanity -- remember "sanity" is a
highly precise arrangement that occupies a vanishingly small portion of the
state space -- "insanity" is far, far more common.)

This argument does not necessarily apply to AI because AI would be
*custom-designed* for its computational limitations, rather than a mind
custom-designed for extreme computing power being ported to a lower-bit
version. Imagine porting a game meant for PS2 to a SNES. It might still
work, but shittily, and losing its original spirit.

Plus, I would think that pleasure spirals are quite likely. Humans are
fundamentally egocentric, whereas AI need not be.

-- 
Michael Anissimov
Lifeboat Foundation                 http://lifeboat.com
SIAI Supporter                         http://intelligence.org
Blog:                      http://acceleratingfuture.com


This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:01:04 MDT