Re: Investing in FAI research: now vs. later.

From: John K Clark (
Date: Sun Feb 17 2008 - 10:59:42 MST

On Fri, 15 Feb 2008 13:15:19 -0800 (PST), "Jeff Herrlich"
<> said:

> You are confusing the *ability* to overthrow its initial
> goals, with the *desire/motivation* to overthrow its
> initial goals.

If you donít want to do something then you cannot, and I donít find that
very confusing.

> Believe it or not, there exists somewhere a scientific
> explanation for why humans behave in the strange
> goal-oriented way that they do.

Apparently I have to point out yet again that there is no goal that
universally motivates human behavior, not even the goal of self

> Even your particular desire at this very moment,
> did not simply pop out of thin air; it was
> *caused* by something.

Perhaps not perhaps my actions were random, but even if they were not
and they could be derived directly from Dirac's equation you could never
hope to perform such a calculation, much less do so for an AI with a
mind thousands of times as powerful as your own.

> Do you honestly believe that you understand the intricacies
> of AI better than Dr. Ben Goertzel for example
>(who also believes that AI can be made Friendly/Safe


 John K Clark

  John K Clark
-- - Access all of your messages and folders
                          wherever you are

This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:01:02 MDT