Jeeves Problem

From Lesswrongwiki
Jump to: navigation, search

The Jeeves problem emerges in scenarios where capital-controlling humans use AI servants to manage their affairs, and are in competition with other human-AI pairs or other AI's. It may be advantageous for the pair if the AI were to manipulate the choices of its human 'master', especially where the human's level of consumption is concerned. If the AI is able and willing to change its master's choices through social engineering or other means, we have a Jeeves problem.