Lifespan dilemma

From Lesswrongwiki
Revision as of 21:27, 2 January 2013 by Eliezer Yudkowsky (talk | contribs)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search

The lifespan dilemma is a thought experiment devised by Eliezer Yudkowsky based on an argument by Wei Dai. It describes a counterintuitive consequence of expected utility maximization given an unbounded utility function. In the dilemma, an agent is offered two options:

  1. The agent will probably live for a long time (e.g., 10^(10^10) years).
  2. The agent will die a near-certain death, except for a tiny chance (e.g., 1 in 10^1000) of living for an unimaginably much longer time.

It seems appealing to choose the first option, no matter how long the lifespan promised in the second option.

However, for long enough promised lifespans, the dilemma can be decomposed into a long chain of smaller steps in such a way that at each step, the agent gains a vastly longer life at the expense of only a tiny probability of dying. In this "garden path" formulation, it's suddenly the second option that seems more appealing.

The lifespan dilemma is related to the St. Petersburg paradox (which uses an infinite number of steps), to the "repugnant conclusion" (which involves large populations of "lives barely worth living", rather than a single long life), and to Pascal's mugging (where a probability is not explicitly specified).

Rejecting the Lifespan Dilemma seems to require either rejecting expected utility maximization, or using a bounded utility function.

Blog posts

External links

See also