Re: How big is an FAI solution? (was Re: [sl4] to-do list for strong, nice AI)

From: Matt Mahoney (matmahoney@yahoo.com)
Date: Wed Oct 21 2009 - 10:02:56 MDT


Tim Freeman wrote:
> The PDF file at http://www.fungible.com/respect/talk-mar-2009.pdf is
> <1MB. A real definition would include training data that would
> probably be a few GB's.

That's a guess. I think the training data is 10^17 bits.

Also, your design has the same shortcoming as CEV and my cheating ideal-market definition. It doesn't define "human".
 -- Matt Mahoney, matmahoney@yahoo.com

----- Original Message ----
From: Tim Freeman <tim@fungible.com>
To: sl4@sl4.org
Sent: Wed, October 21, 2009 9:59:13 AM
Subject: How big is an FAI solution? (was Re: [sl4] to-do list for strong, nice AI)

On Tue, Oct 20, 2009 at 2:16 PM, Luke <wlgriffiths@gmail.com> wrote:
> (1) With regard to a definition of friendly AI, and how it needs to
> encompass all those bits, I've got a big problem there. (a) That's
> impossible. So we either need to find a way around that intractable problem
> (i.e. a smaller definition...

The PDF file at http://www.fungible.com/respect/talk-mar-2009.pdf is
<1MB. A real definition would include training data that would
probably be a few GB's. Start reading at
http://www.fungible.com/respect/index.html.

The described algorithm has known bugs, but it seems unlikely that
fixing the bugs would make it an order of magnitude bigger. I've been
tracking the bugs people have pointed out in a text file. It really
needs a bug tracker of some sort. Some people might think I'm
concealing the bugs but I've just not got around to publishing the
list yet. My apologies to those people who have provided that input in
past conversations on SL4.

-- 
Tim Freeman              http://www.fungible.com          tim@fungible.com


This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:01:05 MDT