Re: ethics

From: Michael Roy Ames (
Date: Thu May 20 2004 - 23:24:57 MDT

Thomas Buckner,

You wrote:
> We have a classic blocker problem hanging with
> human-level intelligence, and if we can't solve it at
> human-level, we may not have enough to go on for
> anything beyond.

Human unfriendliness could probably be considered a blocker problem, as
defined by Eliezer. Until we understood it, we would be held up. However,
we understand human unfriendliness quite well - there are reams of research
on why people seek power, abuse power and behave in unfriendly ways.
Therefore, because we *do* understand why it happens we can, quite simply,
NOT program the selfish gene promotion goals into FAI. We do not have to
solve the problem in humans to avoid the problem in a newly created being.

Michael Roy Ames

This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:00:46 MDT