Re: [sl4] Long-term goals

From: Stuart Armstrong (
Date: Mon Jul 07 2008 - 07:46:54 MDT

> So that nascent AI has the capability to learn about cars, trees, people,
> etc., but that knowledge isn't built in. Therefore the goals that are
> built-in need to be created without reference to such things...except to the
> extend that you rely on "imprinting" (which can produce results that are a
> bit iffy). This makes creating a set of goals that will result in an AI
> that's both friendly and useful a bit tricky...

Which is why I keep arguing that the goals need to be incrementally
constructed under human instruction and AI guidance, as the power of
the AI increases.

This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:01:03 MDT