From: Eliezer Yudkowsky (sentience@pobox.com)
Date: Fri Dec 31 2004 - 21:14:11 MST
Russell Wallace wrote:
>
> Yes; and both of these would in the long run encounter the same
> fundamental problem that a Strong RSI AI must encounter, as far as I
> can see. Again, the problem is, how do you know whether a putative
> improvement is in fact an improvement? There is no way of finding out
> other than by letting it run loose for an open-ended period of time,
> in which case you're back into evolution by natural selection. Do you
> think you have found a way to solve this problem? If so, how?
You mean that when you write code, you have no way of knowing what any
individual module does, except letting it run for an open-ended period of
time? That must make it awfully difficult to write code. How many
randomly generated strings do you need to test before you find one that
compiles?
-- Eliezer S. Yudkowsky http://intelligence.org/ Research Fellow, Singularity Institute for Artificial Intelligence
This archive was generated by hypermail 2.1.5 : Tue Feb 21 2006 - 04:22:50 MST