Re: SIAI's flawed friendliness analysis

From: Eliezer S. Yudkowsky (
Date: Thu May 29 2003 - 13:57:01 MDT

Rafal Smigrodzki wrote:
> This uncertainty is due to our general lack of knowledge about how to
> build an FAI - you cannot rationally regulate a non-existent field of
> research, because all of the "experts'" guesses are as good as mine or
> yours at this point.

Not really. There is no way for the government to tell the difference;
that is not the same as saying no difference exists.

Incidentally, Hibbard, if I were given to trying to pass regulations,
which I'm not, I'd prohibit the use of your reinforcement architecture,
which is, of course, invariably fatal...

...hence the problem.

Eliezer S. Yudkowsky                
Research Fellow, Singularity Institute for Artificial Intelligence

This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:00:42 MDT