RE: Flawed Risk Analysis (was Re: SIAI's flawed friendliness analysis)

From: James Rogers (
Date: Tue May 20 2003 - 15:38:32 MDT

Bill Hibbard wrote:
> Humans will create the first AIs, and certainly will
> understand their designs and code. If human designers
> can understand it, then human regulators will also be
> able to understand it.

In what finite universe is this true, unless the regulators are also the
designers? And in practice such things are not even vaguely close to the
theoretical optimal, such that we have no reason to believe that this will
be the lone exception. Indeed, rational analysis suggests this would be an
utter disaster.

This reasoning doesn't hold water.

-James Rogers

This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:00:42 MDT