Re: [sl4] Friendly AI and Enterprise Resource Management

From: Matt Mahoney (
Date: Mon Oct 11 2010 - 17:36:44 MDT

Robin Lee Powell <> wrote:
> *NO*. Things *building* other things, to deliberate design
> specifications, is exactly *NOT* evolution.

We built the internet to specifications that did not include worms and viruses.

> You seem to be saying that robot/AI babies will be, like, sexual
> results of their parents, so that they're incremental changes an
> improvements that then may or may not be selected by a fitness
> function?

There are lots of ways to do it. We might have many different kinds of robots
that cooperate to build many different kinds of factories, each of which
produces one kind of robot.

My point is that it is very hard to prevent evolution from occurring by
accident. The first computer worm in 1988 was an experiment gone wrong. It was
not intended to spread as fast as it

Even if you think an accident is unlikely, the cost of a mistake is

 -- Matt Mahoney,

This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:01:05 MDT