Difference between revisions of "Basic AI drives"
From Lesswrongwiki
m (→See also) |
m (Moved Omohundro's paper to a more prominent place) |
||
| Line 2: | Line 2: | ||
Obviously, AIs whose goals directly contradict these basic AI drives will strive to avoid them. | Obviously, AIs whose goals directly contradict these basic AI drives will strive to avoid them. | ||
| + | |||
| + | ==External links== | ||
| + | |||
| + | * [http://selfawaresystems.com/2007/11/30/paper-on-the-basic-ai-drives/ The Basic AI Drives] by Stephen M. Omohundro | ||
==See also== | ==See also== | ||
| Line 9: | Line 13: | ||
*[[Instrumental values]] | *[[Instrumental values]] | ||
*[[Dutch book argument]] | *[[Dutch book argument]] | ||
| − | |||
| − | |||
| − | |||
Revision as of 08:01, 31 December 2011
For the most part, whatever your goals are, choosing in accordance with decision-theoretic desiderata will help you achieve them, and so despite the vast diversity of possible minds, we have theoretical reasons to expect that AIs that have undergone substantial self-improvement will tend to share certain features. Steve Omohundro has identified several of these Basic AI drives. Goal-seeking agents will usually strive to represent their goals as a utility function, prevent "counterfeit" utility, protect themselves and similar agents, and acquire resources.
Obviously, AIs whose goals directly contradict these basic AI drives will strive to avoid them.
External links
- The Basic AI Drives by Stephen M. Omohundro
