Another reminder of irrationality

From: Michael Vassar (
Date: Tue Feb 28 2006 - 16:55:12 MST

I know it's tedious, but you aren't SL4 until you appreciate the depth of
human irrationality. Yes rationality is there, but at a level that just
barely shows up when measured with precise instruments. This is important
with respect to non-human intelligences, because super-rationality, almost
as much as superintelligence, is potentially overwhelming and because
intelligence bootstraping moves a system towards rationality. Appreciate
how far humans are from rational and you appreciate how utterly transformed,
and essentially recreated, they would be by haphazard bootstrapping.
Appreciate how formidable rationality is and you see why a highly rational
infrahuman GAI would still be a massive existential threat.

This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:00:56 MDT