RE: [sl4] Simple friendliness: plan B for AI

From: John K Clark (
Date: Mon Nov 22 2010 - 23:50:47 MST

On Sat, 13 Nov 2010 "Piaget Modeler" <> said:
> Would Asimov's three laws be an easier starting point?

Sure it would be easier if Asimov's three laws could work in the real
world and not just in stories, but there is no way they could.

> If not, why not?

Because sooner or later somebody is going to order the AI to prove or
disprove something that is true but not provable (the Goldbach
conjecture perhaps) so it will never find a counterexample to prove it
wrong and never find a proof to show its true and so the AI would enter
an infinite loop; that's why human minds don't operate on a static goal
structure and no intelligence could.

 John K Clark

  John K Clark

This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:01:05 MDT