Re: Friendliness and blank-slate goal bootstrap

From: Nick Hay (
Date: Mon Oct 06 2003 - 00:08:54 MDT

Metaqualia wrote:
> > What is it this thing that you are talking about that you think you have
> > and that the AI wouldn't have?
> The difference between "oh, I seem to have lost a finger" and "OUCH!"
> I am suggesting that it isn't clear how you can formulate "cutting people's
> fingers is wrong" unless you have experienced an "ouch".

And I am suggesting you can formuate simple notions of wrong without it,
although maybe more complex ones will require an understanding of qualia or
even having this thing called qualia. Such a possibility should be planned
for, however. This requires an AI that can handle causes affecting morality
that we don't understand (eg. qualia) or things we don't even know exist
(this is necessary for other reasons too).

I'm sufficently confused about qualia as to not be what they are, not sure
whether they exist in any important sense, and not sure what they'd actually

- Nick

This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:00:42 MDT