Re: Changing the value system of FAI

From: Eliezer S. Yudkowsky (
Date: Sun May 07 2006 - 12:17:55 MDT

Phillip Huggan wrote:
> I guess the program would need to weigh its own available computer
> resources and divide by the potential aggregate # of human-years of
> suffering or happiness that hangs in the balance of the decision, and
> then pick the highest (tractable) pathway solution.

That's known as an "optimal stopping" rule. The problem being, of
course, that computing the exactly optimal time to spend computing a
good action is often more expensive than computing the exactly best action.

Eliezer S. Yudkowsky                
Research Fellow, Singularity Institute for Artificial Intelligence

This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:00:56 MDT