Re: Building a friendly AI from a "just do what I tell you" AI

From: Robin Lee Powell (rlpowell@digitalkingdom.org)
Date: Mon Nov 19 2007 - 02:31:25 MST


On Mon, Nov 19, 2007 at 12:40:23AM -0800, Eliezer S. Yudkowsky
wrote:
> Robin Lee Powell wrote:
>> Other people have already said this to you, but I'll say it
>> differently: you're projecting human thought patterns on to the
>> AI. Just because the AI is smart doesn't mean that it thinks to
>> check before dropping a piano on a busy street. That's from an
>> example I saw somewhere; if you're moving a piano out of a 6th
>> story apartment, think about every bit of cognition that has to
>> go right for you to look down and check for the presence of
>> people rather than just dopping the thing.
>
> Do you remember where you saw this?

If I had to guess without looking, I would have said CFAI, actually.

-Robin

-- 
Lojban Reason #17: http://en.wikipedia.org/wiki/Buffalo_buffalo
Proud Supporter of the Singularity Institute - http://intelligence.org/
http://www.digitalkingdom.org/~rlpowell/ *** http://www.lojban.org/


This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:01:00 MDT