# Difference between revisions of "Evidential Decision Theory"

(→See also) |
|||

(4 intermediate revisions by 3 users not shown) | |||

Line 1: | Line 1: | ||

+ | {{Arbitallink|https://arbital.com/p/evidential_dt/|Evidential decision theories}} | ||

{{wikilink}} | {{wikilink}} | ||

− | '''Evidential Decision Theory''' – EDT | + | '''Evidential Decision Theory''' – EDT – is a branch of [[decision theory]] which advises an agent to take actions which, conditional on it happening, maximizes the chances of the desired outcome. As any branch of decision theory, it prescribes taking the action that maximizes [[utility]], that which utility equals or exceeds the utility of every other option. The utility of each action is measured by the [[expected utility]], the averaged by probabilities sum of the utility of each of its possible results. How the actions can influence the probabilities differ between the branches. [[Causal Decision Theory]] – CDT – says only through causal process one can influence the chances of the desired outcome <ref> http://plato.stanford.edu/entries/decision-causal/ </ref>. EDT, on the other hand, requires no causal connection, the action only have to be a [[Bayesian]] evidence for the desired outcome. Some critics say it recommends auspiciousness over causal efficacy<ref> Joyce, J.M. (1999), The foundations of causal decision theory, p. 146</ref>. |

One usual example where EDT and CDT commonly diverge is the [[Smoking lesion]]: | One usual example where EDT and CDT commonly diverge is the [[Smoking lesion]]: | ||

Line 7: | Line 8: | ||

CDT would recommend smoking since there is no causal connection between smoking and cancer. They are both caused by a gene, but have no causal direct connection with each other. EDT on the other hand wound recommend against smoking, since smoking is an evidence for having the mentioned gene and thus should be avoided. | CDT would recommend smoking since there is no causal connection between smoking and cancer. They are both caused by a gene, but have no causal direct connection with each other. EDT on the other hand wound recommend against smoking, since smoking is an evidence for having the mentioned gene and thus should be avoided. | ||

− | CDT uses probabilities of conditionals and contrafactual dependence to calculate the expected utility of an action – which track causal relations -, whereas EDT simply uses conditional probabilities. The probability of a conditional is the probability of the whole conditional being true, where the conditional probability is the probability of the consequent given the antecedent. A conditional probability of B given A - P(B|A) -, simply implies the Bayesian probability of the event B happening given we known A happened, it’s used in EDT. The probability of conditionals – P(A > B) - refers to the probability that the conditional 'A implies B' is true, it is the probability of the contrafactual ‘If A, then B’ be the case. Since contrafactual analysis is the key tool used to speak about causality, probability of conditionals are said to mirror causal relations. In most usual cases | + | CDT uses probabilities of conditionals and contrafactual dependence to calculate the expected utility of an action – which track causal relations -, whereas EDT simply uses conditional probabilities. The probability of a conditional is the probability of the whole conditional being true, where the conditional probability is the probability of the consequent given the antecedent. A conditional probability of B given A - P(B|A) -, simply implies the Bayesian probability of the event B happening given we known A happened, it’s used in EDT. The probability of conditionals – P(A > B) - refers to the probability that the conditional 'A implies B' is true, it is the probability of the contrafactual ‘If A, then B’ be the case. Since contrafactual analysis is the key tool used to speak about causality, probability of conditionals are said to mirror causal relations. In most usual cases these two probabilities are the same. However, David Lewis proved <ref>Lewis, D. (1976), "Probabilities of conditionals and conditional probabilities", The Philosophical Review (Duke University Press) 85 (3): 297–315</ref> its’ impossible to probabilities of conditionals to always track conditional probabilities. Hence evidential relations aren’t the same as causal relations and CDT and EDT will diverge depending on the problem. In some cases EDT gives a better answers then CDT, such as the [[Newcomb's problem]], whereas in the [[Smoking lesion]] problem where CDT seems to give a more reasonable prescription. |

==References== | ==References== | ||

{{Reflist|2}} | {{Reflist|2}} | ||

+ | |||

+ | ==Blog posts== | ||

+ | * [https://agentfoundations.org/item?id=1525 ''Smoking Lesion Steelman''] by Abram Demski | ||

+ | * [http://lesswrong.com/lw/gu1/decision_theory_faq/ ''Decision Theory FAQ''] by Luke Muehlhauser | ||

+ | * [https://casparoesterheld.files.wordpress.com/2016/12/almond_edt_1.pdf ''On Causation and Correlation Part 1''] by Paul Almond | ||

+ | * [http://lesswrong.com/lw/men/twoboxing_smoking_and_chewing_gum_in_medical/ ''Two-boxing, smoking and chewing gum in Medical Newcomb problems''] by Caspar Oesterheld | ||

+ | * [http://lesswrong.com/r/discussion/lw/oih/did_edt_get_it_right_all_along_introducing_yet/ ''Did EDT get it right all along? Introducing yet another medical Newcomb problem''] by Johannes Treutlein | ||

+ | * [https://casparoesterheld.com/2017/02/06/betting-on-the-past-by-arif-ahmed/ ''"Betting on the Past" by Arif Ahmed''] by Johannes Treutlein | ||

+ | * [https://agentfoundations.org/item?id=92 ''Why conditioning on "the agent takes action a" isn't enough''] by Nate Soares | ||

==See also== | ==See also== |

## Latest revision as of 09:37, 22 September 2017

**Evidential Decision Theory** – EDT – is a branch of decision theory which advises an agent to take actions which, conditional on it happening, maximizes the chances of the desired outcome. As any branch of decision theory, it prescribes taking the action that maximizes utility, that which utility equals or exceeds the utility of every other option. The utility of each action is measured by the expected utility, the averaged by probabilities sum of the utility of each of its possible results. How the actions can influence the probabilities differ between the branches. Causal Decision Theory – CDT – says only through causal process one can influence the chances of the desired outcome ^{[1]}. EDT, on the other hand, requires no causal connection, the action only have to be a Bayesian evidence for the desired outcome. Some critics say it recommends auspiciousness over causal efficacy^{[2]}.

One usual example where EDT and CDT commonly diverge is the Smoking lesion: “Smoking is strongly correlated with lung cancer, but in the world of the Smoker's Lesion this correlation is understood to be the result of a common cause: a genetic lesion that tends to cause both smoking and cancer. Once we fix the presence or absence of the lesion, there is no additional correlation between smoking and cancer. Suppose you prefer smoking without cancer to not smoking without cancer, and prefer smoking with cancer to not smoking with cancer. Should you smoke?” CDT would recommend smoking since there is no causal connection between smoking and cancer. They are both caused by a gene, but have no causal direct connection with each other. EDT on the other hand wound recommend against smoking, since smoking is an evidence for having the mentioned gene and thus should be avoided.

CDT uses probabilities of conditionals and contrafactual dependence to calculate the expected utility of an action – which track causal relations -, whereas EDT simply uses conditional probabilities. The probability of a conditional is the probability of the whole conditional being true, where the conditional probability is the probability of the consequent given the antecedent. A conditional probability of B given A - P(B|A) -, simply implies the Bayesian probability of the event B happening given we known A happened, it’s used in EDT. The probability of conditionals – P(A > B) - refers to the probability that the conditional 'A implies B' is true, it is the probability of the contrafactual ‘If A, then B’ be the case. Since contrafactual analysis is the key tool used to speak about causality, probability of conditionals are said to mirror causal relations. In most usual cases these two probabilities are the same. However, David Lewis proved ^{[3]} its’ impossible to probabilities of conditionals to always track conditional probabilities. Hence evidential relations aren’t the same as causal relations and CDT and EDT will diverge depending on the problem. In some cases EDT gives a better answers then CDT, such as the Newcomb's problem, whereas in the Smoking lesion problem where CDT seems to give a more reasonable prescription.

## References

- ↑ http://plato.stanford.edu/entries/decision-causal/
- ↑ Joyce, J.M. (1999), The foundations of causal decision theory, p. 146
- ↑ Lewis, D. (1976), "Probabilities of conditionals and conditional probabilities", The Philosophical Review (Duke University Press) 85 (3): 297–315

## Blog posts

*Smoking Lesion Steelman*by Abram Demski*Decision Theory FAQ*by Luke Muehlhauser*On Causation and Correlation Part 1*by Paul Almond*Two-boxing, smoking and chewing gum in Medical Newcomb problems*by Caspar Oesterheld*Did EDT get it right all along? Introducing yet another medical Newcomb problem*by Johannes Treutlein*"Betting on the Past" by Arif Ahmed*by Johannes Treutlein*Why conditioning on "the agent takes action a" isn't enough*by Nate Soares