RE: Why FAI Theory is both Necessary and Hard (was Re: SIAI's flawed friendliness analysis)

From: Christian Rovner (
Date: Sun May 11 2003 - 11:26:03 MDT

Eliezer wrote:
> I find it hard to believe that any human truly capable of
> learning and understanding that art would use it to do something
> so small and mean.

Cliff wrote:
> You "find it hard to believe"? _I_ find it hard to believe you would
> use such a phrase casually or unintentionally, without awareness
> of the implications. *Especially* when such a statement is made about
> a probability of the form P(small & mean | capable)...

Benw wrote:
> I agree, Cliff.
> Human history is full of twisted atrocities that are "hard to believe" --
> except that they actually happened.

Apparently, the kind of wisdom required to create Friendly AI is way greater
(and includes) the kind of wisdom required to realize the smallness and
meannes of seeking political power. If someone failed to achieve that sort of
understanding of human morality, alas, they will hardly be able to design and
raise a Friendly AI.

-- Christian Rovner
Singularity Institute for Artificial Intelligence,

This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:00:42 MDT