Re: Pete & Passive AI

From: Michael Wilson (
Date: Fri Dec 09 2005 - 07:59:16 MST

Chris Capel wrote:
> Passive AI reduces to the AI boxing problem, plain
> and simple.

Only for an extremely bad implementation. A correctly designed
Oracle does not /want/ to optimise the state of the external
world beyond providing people who ask questions with accurate
information, and this desire remains stable under
self-modification. An AI box relies on adversarial techniques
(to use the CFAI term) to contain a black-box AGI of unknown
goal system content. An Oracle has known goal-system content
and any adversarial mechanisms present are emergency fallbacks
intended to guard against uncaught design and implementation

 * Michael Wilson

Yahoo! Exclusive Xmas Game, help Santa with his celebrity party -

This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:00:54 MDT