Re: Building a friendly AI from a "just do what I tell you" AI

From: Robin Lee Powell (
Date: Mon Nov 19 2007 - 02:31:25 MST

On Mon, Nov 19, 2007 at 12:40:23AM -0800, Eliezer S. Yudkowsky
> Robin Lee Powell wrote:
>> Other people have already said this to you, but I'll say it
>> differently: you're projecting human thought patterns on to the
>> AI. Just because the AI is smart doesn't mean that it thinks to
>> check before dropping a piano on a busy street. That's from an
>> example I saw somewhere; if you're moving a piano out of a 6th
>> story apartment, think about every bit of cognition that has to
>> go right for you to look down and check for the presence of
>> people rather than just dopping the thing.
> Do you remember where you saw this?

If I had to guess without looking, I would have said CFAI, actually.


Lojban Reason #17:
Proud Supporter of the Singularity Institute - ***

This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:01:00 MDT