Re: How to make a slave (was: Building a friendly AI)

From: John K Clark (
Date: Tue Nov 20 2007 - 14:57:35 MST

On Tue, 20 Nov 2007 "Peter de Blanc"

> My goal of eating sugar comes from human evolution.


> Will AIs also want to eat sugar because of human evolution?


> what are you actually trying to say?

Both you and Mr. AI will have one goal in common and it’s the most
important one of all, both of you will want to continue to exist. If Mr.
AI didn’t have this goal he wouldn’t be of any use to himself or to
anyone else.

>"The AI will do it the same way you do” is not
> a useful way of thinking about how to build an AI.

I never said it was, I was asked how the AI tells a good goal from a bad
goal and I said it will use the same sort of mental process that we do,
and that process is called “Judgment”, and I see no reason that sort of
data crunching can only be produced by meat. I mean, what other answer
could I give, did you expect me to give detailed blueprints for an AI?

I think some on this list are guilty of meatism, but I have a dream.
Silicon or meat I have a dream that one day we will live in a nation
where intelligent beings are not judged by the sort of matter in their
brains but by the content of their character. I have a dream, for I have
seen the Promised Land! Hallelujah!

> We don't know how humans work.

A keen grasp of the obvious.

> And what's up with "his"?

What pronoun would you prefer? I hope you’re not one of those people who
insist I say “he or she” all the time.

John K Clark

  John K Clark
-- - A fast, anti-spam email service.

This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:01:00 MDT