Re: [sl4] Singularity, "happiness", suffering, Mars

From: Rik van Riel (
Date: Sat Sep 24 2005 - 13:00:17 MDT

On Sat, 24 Sep 2005, J. Andrew Rogers wrote:

> In software implementation, everything can be and must be flawless in
> implementation or the implementation is broken.

Because a seed AI has to be able to modify itself and continue
to function, this property of software worries me.

> Conventional software is axiomatic in construction, while conventional
> engineering is non-axiomatic. That is why software is brittle and
> normal engineering is robust under adverse circumstances.

I wonder if software would need to be robust before properly
working self-modifying AI is possible...

"Debugging is twice as hard as writing the code in the first place.
Therefore, if you write the code as cleverly as possible, you are,
by definition, not smart enough to debug it." - Brian W. Kernighan

This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:00:52 MDT