Re: Building a friendly AI from a "just do what I tell you" AI

From: Peter de Blanc (
Date: Mon Nov 19 2007 - 10:16:10 MST

On Mon, 2007-11-19 at 22:06 +1100, Stathis Papaioannou wrote:
> An AI need not think in any particular way nor have any particular
> goal. But if it is superintelligent, figuring out the subtleties of
> human language and what we call common sense should number amongst its
> capabilities. If not, then it wouldn't be able to manipulate people
> and would pose much less of a threat.

Just because an AI can model your goals and thought patterns does not
mean that they are part of the AI's goal content.

This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:01:00 MDT