Re: Why friendly AI (FAI) won't work

From: Stathis Papaioannou (
Date: Fri Nov 30 2007 - 01:24:19 MST

On 30/11/2007, Kaj Sotala <> wrote:

> Also, there are numerous people who would /want/ an independently
> acting AI, for the simple reason that an AI built only to carry out
> goals given to it by humans could be used for vast harm - while an AI
> built to actually care for humanity could act in humanity's best
> interests, in a neutral and bias-free fashion. Therefore, in either
> case, the motivation to build independently-acting AIs is there, and
> the cheaper computing power becomes, the easier it will be for even
> small groups to build AIs.

The vast majority of people would want an AI that they could control,
if possible. Even in the case of what is universally considered a
benevolent relationship, such as that between mother and child,
society has mechanisms to ensure that the trust is not abused.

Stathis Papaioannou

This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:01:01 MDT