Re: Military Friendly AI

From: James Higgins (
Date: Tue Jul 02 2002 - 10:01:05 MDT

At 08:47 PM 6/29/2002 -0400, Brian Atkins wrote:
> > > Higgins seems to want "hundreds or thousands of relevant experts" to
> agree
> > > that it is ok for you to "push the big red button". Are you ok with that?
> >
> > I am not OK with that, but I believe he backpedaled on that particular
> > assertion.
>He backed away from "thousands", but not "hundreds" as far as I can tell.

Well, like everyone else on this list I don't know how to best proceed with
the Singularity in a safe manner.

Thousands is ridiculous. I believe my comment on "hundreds" was in regard
to a fairly high risk of problems (double digits). Frankly, like I keep
saying, if you get a good group of people together to act as an "advisory
board" and they think the risk is small, great. But if they think the risk
is significant (which is hard to quantify exactly) then maybe there would
be value in consulting "hundreds" of intelligent people. Espicially if a
safer way to proceed can't be identified, getting more ideas and
perspectives could lead to finding a better (safer) design. But if the
risks are low then there would be no reason to consult a large group of
people as long as a reasonable group of people were utilized.

James Higgins

This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:00:40 MDT