Difference between revisions of "Basic AI drives"

From Lesswrongwiki
Jump to: navigation, search
m (See also: link to Oracle AI)
(External links)
Line 6: Line 6:
  
 
* [http://selfawaresystems.com/2007/11/30/paper-on-the-basic-ai-drives/ The Basic AI Drives] by Stephen M. Omohundro
 
* [http://selfawaresystems.com/2007/11/30/paper-on-the-basic-ai-drives/ The Basic AI Drives] by Stephen M. Omohundro
 +
* [www.nickbostrom.com/superintelligentwill.pdf The Superintelligent Will] by Nick Bostrom
  
 
==See also==
 
==See also==

Revision as of 15:24, 14 June 2012

For the most part, whatever your goals are, choosing in accordance with decision-theoretic desiderata will help you achieve them, and so despite the vast diversity of possible minds, we have theoretical reasons to expect that AIs that have undergone substantial self-improvement will tend to share certain features. Steve Omohundro has identified several of these Basic AI drives. Goal-seeking agents will usually strive to represent their goals as a utility function, prevent "counterfeit" utility, protect themselves and similar agents, and acquire resources.

Obviously, AIs whose goals directly contradict these basic AI drives will strive to avoid them.

External links

  • The Basic AI Drives by Stephen M. Omohundro
  • [www.nickbostrom.com/superintelligentwill.pdf The Superintelligent Will] by Nick Bostrom

See also