14 objections against AI/Friendly AI/The Singularity answered

From: Kaj Sotala (xuenay@gmail.com)
Date: Thu Oct 25 2007 - 17:28:47 MDT

Can be found at http://www.saunalahti.fi/~tspro1/objections.html .

Answers the following objections:

1: There are limits to everything. You can't get infinite growth
2: Extrapolation of graphs doesn't prove anything. It doesn't show
that we'll have AI in the future.
3: A superintelligence could rewrite itself to remove human tampering.
Therefore we cannot build Friendly AI.
4: What reason would a super-intelligent AI have to care about us?
5: The idea of a hostile AI is anthropomorphic.
6: Intelligence is not linear.
7: There is no such thing as a human-equivalent AI.
8: Intelligence isn't everything. An AI still wouldn't have the
resources of humanity.
9: It's too early to start thinking about Friendly AI
10: Development towards AI will be gradual. Methods will pop up to deal with it.
11: "Friendliness" is too vaguely defined.
12: What if the AI misinterprets its goals?
13: Couldn't AIs be built as pure advisors, so they wouldn't do
anything themselves? That way, we wouldn't need to worry about
Friendly AI.
14: Machines will never be placed in positions of power.

Constructive criticism welcome, as always.

http://www.saunalahti.fi/~tspro1/ | http://xuenay.livejournal.com/
Organizations worth your time:
http://www.intelligence.org/ | http://www.crnano.org/ | http://lifeboat.com/

This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:00:58 MDT