qualia-oriented SI (was: "friendly" humans?)

From: Wei Dai (weidai@weidai.com)
Date: Fri Jan 02 2004 - 04:47:36 MST

On Thu, Jan 01, 2004 at 11:39:34PM +0900, Metaqualia wrote:
> "An intelligent being who does know qualia will understand that the first
> person perspective generated by qualia experiencing systems is the only
> absolute frame of reference to judge what is good and what is evil, and will
> in the end reach its own conclusion, that you don't make lower life forms
> experience evil."

This is an interesting idea, but won't such an SI just find the best
qualia possible and then fill the universe with copies of the structure
that most efficiently generates the optimal qualia, painlessly killing all
other life forms for their atoms?

This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:00:43 MDT