Re: How to make a slave (was: Building a friendly AI)

From: Peter de Blanc (
Date: Tue Nov 20 2007 - 14:44:10 MST

On Tue, 2007-11-20 at 11:50 -0800, Jef Allbright wrote:
> You have a "goal" of eating sugar??
> How about "it is your evolved nature to highly value" sugar, to prefer
> sugar, even to crave sugar within a particular context?
> Does anyone here see a practical difference between the two?
> - Jef

OK, you're right that eating sugar is not part of the reflective closure
of my goal system; i.e. under self-modification, it's something that I
might target for removal.

This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:01:00 MDT