Re: Fighting UFAI

From: Eliezer S. Yudkowsky (sentience@pobox.com)
Date: Wed Jul 13 2005 - 20:28:55 MDT


Tennessee Leeuwenburg wrote:
> What do people suppose the goals of a UFAI might be? Other than our
> destruction, of course. I'm assuming that UFAI isn't going to want our
> destruction just for its own sake, but consequentially, for other
> reasons.

I usually assume paperclips, for the sake of argument. More realistically the
UFAI might want to tile the universe with tiny smiley faces (if, as Bill
Hibbard suggested, we were to use reinforcement learning on smiling humans) or
most likely of all, circuitry that holds an ever-increasing representation of
the pleasure counter. It doesn't seem to make much of a difference.

-- 
Eliezer S. Yudkowsky                          http://intelligence.org/
Research Fellow, Singularity Institute for Artificial Intelligence


This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:00:51 MDT