From: Vladimir Nesov (robotact@gmail.com)
Date: Mon Feb 09 2009 - 12:56:14 MST
On Mon, Feb 9, 2009 at 9:26 PM, Petter Wingren-Rasmussen
<petterwr@gmail.com> wrote:
> For me the conclusion is clear:
> Any AI with a hard-coded law for "being nice","prevent murders" or any
> other non-modifiable procedure will with great probability be overrun
> by a system without those hardwritten rules.
>
This is vacuous: is it bad that civilization got destroyed, because
there was no moral way of avoiding destruction? From that
civilization's perspective, it just might be an optimal course of
action, it won even though it's destroyed.
-- Vladimir Nesov http://causalityrelay.wordpress.com/
This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:01:04 MDT