# Difference between revisions of "Pascal's mugging"

From Lesswrongwiki

m |
|||

Line 1: | Line 1: | ||

− | '''Pascal's mugging''' refers to an apparent [[paradox]] in decision theory, named in analogy to [[Pascal's wager]]. An agent with an unbounded utility function | + | '''Pascal's mugging''' refers to an apparent [[paradox]] in decision theory, named in analogy to [[Pascal's wager]]. An agent with an unbounded utility function can potentially be exploited by bets offering tiny probabilities of vast utilities: describable utilities can get large faster than the probabilities of corresponding situations given by the [[Solomonoff induction|Solomonoff]]-like [[priors]] get small. The situation is dramatized by a mugger: |

{{Quote| | {{Quote| | ||

− | Now suppose someone comes to me and says, "Give me five dollars, or I'll use my magic powers from outside the Matrix to run a Turing machine that simulates and kills 3^^^^3 | + | Now suppose someone comes to me and says, "Give me five dollars, or I'll use my magic powers from outside the Matrix to run a Turing machine that simulates and kills [[3^^^^3]] people." |

|[http://lesswrong.com/lw/kd/pascals_mugging_tiny_probabilities_of_vast/ Pascal's Mugging: Tiny Probabilities of Vast Utilities]}} | |[http://lesswrong.com/lw/kd/pascals_mugging_tiny_probabilities_of_vast/ Pascal's Mugging: Tiny Probabilities of Vast Utilities]}} | ||

− | Intuitively, one is not inclined to acquiesce to the mugger's demands, and yet it's not clear how this intuition can be justified in decision theory. | + | Intuitively, one is not inclined to acquiesce to the mugger's demands, and yet it's not clear how this intuition can be justified in [[decision theory]]. |

==See also== | ==See also== | ||

Line 28: | Line 28: | ||

|pages=443-445 | |pages=443-445 | ||

}} ([http://www.nickbostrom.com/papers/pascal.pdf PDF]) | }} ([http://www.nickbostrom.com/papers/pascal.pdf PDF]) | ||

+ | |||

+ | [[Category:Decision theory]] | ||

+ | [[Category:Philosophy]] |

## Revision as of 03:18, 7 September 2009

**Pascal's mugging** refers to an apparent paradox in decision theory, named in analogy to Pascal's wager. An agent with an unbounded utility function can potentially be exploited by bets offering tiny probabilities of vast utilities: describable utilities can get large faster than the probabilities of corresponding situations given by the Solomonoff-like priors get small. The situation is dramatized by a mugger:

Now suppose someone comes to me and says, "Give me five dollars, or I'll use my magic powers from outside the Matrix to run a Turing machine that simulates and kills 3^^^^3 people."

Intuitively, one is not inclined to acquiesce to the mugger's demands, and yet it's not clear how this intuition can be justified in decision theory.

## See also

## Blog posts

## References

- Nick Bostrom (2009). "Pascal's Mugging".
*Analysis***69**(3): 443-445. (PDF)