CEV specifies who the AI cares about (was Re: Can't afford to rescue cows)

From: Tim Freeman (tim@fungible.com)
Date: Fri Apr 25 2008 - 08:31:35 MDT


On Thu, Apr 17, 2008 at 11:59 PM, Nick Tarleton <nickptar@gmail.com> wrote:
> Fixing who the AI cares about is over-specification. That's what the
> AI (in the CFAI model) or extrapolated volition (in the newer model)
> is supposed to figure out.

> http://www.sl4.org/wiki/CoherentExtrapolatedVolition

CEV fixes who the AI cares about. Quoting directly from the cited article:

>As of May 2004, my take on Friendliness is that the initial dynamic
>should implement the coherent extrapolated volition of humankind.

The AI cares about the extrapolated volition of "humankind", not the
extraploated volition of mammals or some other group.

-- 
Tim Freeman               http://www.fungible.com           tim@fungible.com


This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:01:02 MDT