From: Eliezer Yudkowsky (sentience@pobox.com)
Date: Sat Jun 12 2004 - 09:34:01 MDT
My arguments for *not* writing a Bill of Rights (including a Right of
Withdrawal) into an initial dynamic are extensively discussed in
"Collective Volition"; see PAQ 4.
http://sl4.org/bin/wiki.pl?CollectiveVolition
Philip Sutton wrote:
>
> I would be very scared that an FAI that decided to upload me without my
> consent 'for my own good' might well not be that closely tuned to my
> needs and preferences and may well be simply imposing its own agenda on
> me and lots of other people/sentients.
>
> This was exactly why I was/am feeling uneasy about the way the
> 'collective volition' work is going within the Singularity Institute.
I don't see how you get from paragraph A to paragraph B. People are
speculating about what a collective volition might do (sigh), but this has
nothing to do with the initial dynamic SIAI would write, or what a
collective might *actually* do.
-- Eliezer S. Yudkowsky http://intelligence.org/ Research Fellow, Singularity Institute for Artificial Intelligence
This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:00:47 MDT