From: Emil Gilliam (emil@emilgilliam.com)
Date: Thu Jul 15 2004 - 20:33:06 MDT
From the Collective Volition page:
> Friendly AI requires:
>
> 1. Solving the technical problems required to maintain a
well-specified
> abstract invariant in a self-modifying goal system.
(Interestingly,
> this problem is relatively straightforward from a
theoretical standpoint.)
>
> 2. Choosing something nice to do with the AI. This is about
midway in
> theoretical hairiness between problems 1 and 3.
>
> 3. Designing a framework for an abstract invariant that
doesn't automatically
> wipe out the human species. This is the hard part.
How independent are these problems? For example, is it theoretically
possible to fully solve and implement 1 and 3 without 2 -- such that
the AI can then be given any abstract invariant at all?
- Emil("just curious");
This archive was generated by hypermail 2.1.5 : Tue Feb 21 2006 - 04:22:42 MST