The utility function is not up for grabs

From Lesswrongwiki
Revision as of 11:05, 5 May 2012 by Vladimir Nesov (talk | contribs) (beliefs about goals can be wrong in not accurately reflecting the goals, not just in not making sense in themselves)
Jump to: navigation, search

The constraints of decision theory are only there to help you win; they don't specify what constitutes a win. Rationality in and of itself cannot constrain what you want, except insofar as what you thought you wanted was different from what you actually wanted (or just plain inconsistent). Hence the saying: the utility function is not up for grabs.

Blog posts

See also