Basic AI drives

From Lesswrongwiki
Revision as of 12:15, 17 February 2010 by Zack M. Davis (talk | contribs) (Created page)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search

Whatever your goals are, choosing in accordance with decision-theoretic desiderata will help you achieve them, and so despite the vast diversity of possible minds, we have theoretical reasons to expect that AIs that have undergone substantial self-improvement will share certain features. Steve Omohundro has identified several of these Basic AI drives. Goal-seeking agents will strive to represent their goals as a utility function, prevent "counterfeit" utility, protect themselves and similar agents, and acquire resources.

See also

External links