Re: The Future of Human Evolution

From: Eliezer Yudkowsky (sentience@pobox.com)
Date: Mon Sep 27 2004 - 03:05:18 MDT


Maru wrote:
> I think I'm misunderstanding something here: If you can't construct an
> AI to 'accomplish an end for which you do not possess a well-specified
> abstract description', then what is the point of Collective Volition?
> Isn't the idea for that to have the AI make the decision you would have
> made if you had understood just what you actually wanted (which sounds
> like something not very well-specified)?

If it's not well-specified, you can't do it. The point of "collective
volition" is to well-specify how to look at a human being (or, rather, a
group of human beings) and construe a reasonable definition of what they
"actually want".

-- 
Eliezer S. Yudkowsky                          http://intelligence.org/
Research Fellow, Singularity Institute for Artificial Intelligence


This archive was generated by hypermail 2.1.5 : Tue Feb 21 2006 - 04:22:46 MST