RE: supergoal stability

From: Peter Voss (peter@optimal.org)
Date: Fri May 03 2002 - 18:28:00 MDT


Ben, you make a very good point. Figuring out what is good for yourself
seems much easier than trying to balance the needs/ desires of everyone
else.

Peter

-----Original Message-----
From: owner-sl4@sysopmind.com [mailto:owner-sl4@sysopmind.com]On Behalf
Of Ben Goertzel

> 1. Are there supergoals other than Friendliness that can be stable for
> SI's?

It seems to me that pure selfishness would probably be a pretty stable goal.
In fact my intuition says this one would be less susceptible to drift than
Friendliness, because of its greater simplicity. Estimating the
Friendliness of an action is harder than estimating the selfish benefit of
an action, so there's more room for drift in Friendliness IMO.

But of course, this is just an intuition...



This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:00:38 MDT