Re: Friendliness and blank-slate goal bootstrap

From: Robin Lee Powell (rlpowell@digitalkingdom.org)
Date: Fri Oct 03 2003 - 14:42:04 MDT


On Fri, Oct 03, 2003 at 01:24:41PM -0700, Martin Striz wrote:
>
> The replicators (primitive ribonucleic acids) started out without
> a goal system: they were simply settling into the their most
> stable free energy state, based on the laws of physics and
> chemistry. Yet, from this system, goal- and meaning-creating
> intelligence arose. Perhaps an AI with the simplest directives or
> starting rules could produce some rather elaborate and magnificent
> results.

Or, perhaps, it could kill us all.

I'm not willing to take the chance, myself. The possible
intelligence gap makes it too great a risk.

-Robin

-- 
Me: http://www.digitalkingdom.org/~rlpowell/  ***   I'm a *male* Robin.
"but I'm not stupid and people are not stupid who think samely with me"
-- from an actual, real, non-spam mail sent to webmaster@lojban.org
http://www.lojban.org/             ***              .i cimo'o prali .ui


This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:00:42 MDT