Re: The Future of Human Evolution

From: Eliezer Yudkowsky (
Date: Mon Sep 27 2004 - 03:05:18 MDT

Maru wrote:
> I think I'm misunderstanding something here: If you can't construct an
> AI to 'accomplish an end for which you do not possess a well-specified
> abstract description', then what is the point of Collective Volition?
> Isn't the idea for that to have the AI make the decision you would have
> made if you had understood just what you actually wanted (which sounds
> like something not very well-specified)?

If it's not well-specified, you can't do it. The point of "collective
volition" is to well-specify how to look at a human being (or, rather, a
group of human beings) and construe a reasonable definition of what they
"actually want".

Eliezer S. Yudkowsky                
Research Fellow, Singularity Institute for Artificial Intelligence

This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:00:48 MDT