Re: Defining Right and Wrong

From: Eliezer S. Yudkowsky (
Date: Tue Dec 03 2002 - 01:47:28 MST

Michael Roy Ames wrote:
> Creating the FAI content is going to be interesting and important,
> and can proceed independently of the programming of the Seed AI. I
> imagine it to be like putting together the schooling curriculum for a
> child, a child who will probably absorb and integrate the information
> very quickly. The simulations and tests presented to a Seed AI will
> be as important (if not more so) than the initial content, as *that*
> is when the Seed AI will relate the new information to all the other
> knowledge it has. The lessons will have to be graded (just like for
> human children) starting with very simplistic material, probably
> tailored to a 'toy-simulation' or 'microdomain', and gradually
> becoming more sophisticated as the Seed AI grows in intelligence.
> I'm not sure if SL4 is the place to discuss the Seed AI's curriculum
> (Eliezer?) but I have lots of ideas about it (I'm sure many
> subscribers here do as well). I'll save them for another time.

SL4 would be an appropriate place.

Eliezer S. Yudkowsky                
Research Fellow, Singularity Institute for Artificial Intelligence

This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:00:41 MDT