How to make a slave (was: Building a friendly AI)

From: John K Clark (
Date: Mon Nov 19 2007 - 14:48:47 MST

Roland has some ideas on how to make a slave:

> To avoid any possibility of dangers we program
> the OAI to not perform any actions other than
> answering with text and diagrams(other media
> like sound and video would be a possibility too).
> In essence what we would have is a glorified
> calculator. I think this avoids any dangers from
> the AI following orders literally with
> unintended consequences.

If you are like most people there have been times in your life when a
mere human being has talked you into doing something that you now
understand to be very stupid. And this AI will be far smarter, more
interesting, more likable, and just more goddamn charming than any human
being you have ever or will ever will meet; Mr. AI will have charisma Up
the Wahzoo, he will understand your physiology, what makes you tick,
better than you understand yourself. I estimate it would take the AI
about 45 seconds to trick or sweet talk you (or me) into doing exactly
what it wants you (or me) to do.

> So we go to the OAI and say: "Tell me how I
> can build a friendly AI in a manner that I
> can prove and understand that it will be friendly."

And after that we teach a dog Quantum Mechanics. Get real people! We
donít even understand the simple little programs we write today, at
least not well enough to prove they will always do what we what we want
them to. The idea that a bipedal hominid expects to understand how a
Jupiter Brain works is downright comical.

There are some very bright fellows on this list but I must say, and not
for the first time, the responses to this topic are intellectually sub
par. Even more disturbing they morally sub par. Iíd like to say more
about that last statement but I was told by the SL4 people not to.
Apparently it is too shocking. Shock Level 5 anyone?

John K Clark

  John K Clark
-- - mmm... Fastmail...

This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:01:00 MDT