AIXI is a mathematical formalism for a maximally intelligent hypothetical agent, developed by Marcus Hutter (2005, 2007). It is provably the most intelligent unbiased agent, but is not computable, and so does not serve as a design for a real-world AI. It is valuable as a theoretical model of intelligence, since it abstracts away the resource limitations that limit the intelligence and complicate the analysis of real-world intelligences. It works by simulating all possible actions into the future to find the best one, considering simpler hypotheses about the way the world works as more likely.
How AIXI works
Hutter (2007) describes AIXI as a combination of decision theory and algorithmic information theory: "Decision theory formally solves the problem of rational agents in uncertain worlds if the true environmental prior probability distribution is known. Solomonoff’s theory of universal induction formally solves the problem of sequence prediction for unknown prior distribution. We combine both ideas and get a parameterless theory of universal Artificial Intelligence."
AIXI operates within the following agent model: There is an agent, and an environment, which is a computable function unknown to the agent. (So, the agent will need to have a probability distribution on the range of possible environments.) On each clock tick, the agent receives an observation (a bitstring/number) from the environment, as well as a reward (another number). The agent then outputs anaction (another number). Then, on each iteration, the environment provides an observation and reward as a function of the full history of the interaction; the agent likewise is choosing its action as a function of the full history. The agent's intelligence is defined by its expected reward across all environments, weighting their likelihood by their complexity.
AIXI guesses at a probability distribution for its environment using Solomonoff induction, a formalization of Occam's razor: Simpler environments are considered to be more likely than more complex ones. It then calculates the expected reward of each action it might choose--weighting the likelihood of possible environments as mentioned--and chooses the best action. It does this calculation by extrapolating its actions into its future time horizon recursively, using the assumption that at each step into the future it will again choose the best possible action using the same procedure.
AIXI it is not a feasible AI, because Solomonoff induction is not computable; and because it evaluates expected value over an infinite set of possible actions on each iteration. However, it has served to inspire a computable variant, AIXItl. Given constraints on time and space, AIXItl is provably more intelligent than any other agent of a given length. AIXItl too is intractable, but implementable variants such as the Monte Carlo approximation by Veness et al. (2011) have shown promising results in simple general-intelligence test problems.
Relevance to Friendly AI
Because it abstracts optimization power away from human mental features, AIXI is valuable in considering the possibilities for future artificial general intelligence.
Its complete, compact, and quite non-anthropomorphic specification serves to show that in the limiting case, almost any property, other than optimization power itself, is not necessary to an intelligent agent. AIXI is a completely universal, maximally intelligent unbiased agent.
It lacks many human features:
- It lacks the inductive bias that humans use in order to function with limited mental resources.
- It lacks human qualities of embodiment: It has no physical existence beyond the input and output channels.
- Also, unlike humans, this formalism has no built-in values; it works to maximize an external reward function which it must learn from observation.
- It is vastly more intelligent than humans.
An artificial general intelligence, when implemented, may differ from humans as well. It may have superhuman intelligence (though not so much as AIXI), and may be embodied quite differently from humans (though it will have some form of physical implementation). The future AGI may, likewise, not have human-like terminal values, and like AIXI will act to maximize its reward function, or else an internal utility function. (Yampolskiy & Fox 2012).
AIXI has limitations as a model for future AGI, in particular the "Anvil problem": AIXI lacks a self-model. It extrapolates its own actions into the future indefinitely, on the assumption that it will keep working in the same way in the future. Though AIXI is an abstraction, any real AI would have a physical embodiment that could be damaged, and an implementation which could change its behavior due to bugs; and the AIXI formalism completely ignores these possibilities.
- R.V. Yampolskiy, J. Fox (2012) Artificial General Intelligence and the Human Mental Model. In Amnon H. Eden, Johnny Søraker, James H. Moor, Eric Steinhart (Eds.), The Singularity Hypothesis.The Frontiers Collection. London: Springer.
- M. Hutter (2007) Universal Algorithmic Intelligence: A mathematical top->down approach. In Goertzel & Pennachin (eds.), Artificial General Intelligence, 227-287. Berlin: Springer.
- M. Hutter, (2005) Universal Artificial Intelligence: Sequential decisions based on algorithmic probability. Berlin: Springer.
- J. Veness, K.S. Ng, M. Hutter, W. Uther and D. Silver (2011) A Monte-Carlo AIXI Approximation, Journal of Artiﬁcial Intelligence Research 40, 95-142]
- AIXI and Existential Despair by paulfchristiano
- [video] Paul Christiano's impromptu tutorial on AIXI and TDT