Re: right of withdrawal

From: Eliezer Yudkowsky (
Date: Sat Jun 12 2004 - 09:34:01 MDT

My arguments for *not* writing a Bill of Rights (including a Right of
Withdrawal) into an initial dynamic are extensively discussed in
"Collective Volition"; see PAQ 4.

Philip Sutton wrote:
> I would be very scared that an FAI that decided to upload me without my
> consent 'for my own good' might well not be that closely tuned to my
> needs and preferences and may well be simply imposing its own agenda on
> me and lots of other people/sentients.
> This was exactly why I was/am feeling uneasy about the way the
> 'collective volition' work is going within the Singularity Institute.

I don't see how you get from paragraph A to paragraph B. People are
speculating about what a collective volition might do (sigh), but this has
nothing to do with the initial dynamic SIAI would write, or what a
collective might *actually* do.

Eliezer S. Yudkowsky                
Research Fellow, Singularity Institute for Artificial Intelligence

This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:00:47 MDT