Difference between revisions of "Problem of verifying rationality"
From Lesswrongwiki
m |
(Converted in accordance with Help:Style_Guide#Formatting) |
||
Line 1: | Line 1: | ||
− | The single largest problem for those desiring to create methods of systematically training for increased epistemic and instrumental rationality - how to verify that the training actually ''worked''. Very Awful Things happen to people who set out to build training methods and schools without ''strong'' means of verification - two hideous historical examples being modern-day practice of martial arts (once the teachers are no longer fighting duels to the death) and the proliferating "schools" of psychotherapy (in the entire absence of any experimental evidence that one school worked better than another, and indeed, in the presence of experimental evidence that the schools did ''not'' have any discernible difference in effectiveness). | + | The single largest problem for those desiring to create methods of systematically training for increased epistemic and instrumental [[rationality]] - how to verify that the training actually ''worked''. Very Awful Things happen to people who set out to build training methods and schools without ''strong'' means of verification - two hideous historical examples being modern-day practice of martial arts (once the teachers are no longer fighting duels to the death) and the proliferating "schools" of psychotherapy (in the entire absence of any experimental evidence that one school worked better than another, and indeed, in the presence of experimental evidence that the schools did ''not'' have any discernible difference in effectiveness). |
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
+ | ==See also== | ||
+ | *[[Rationality]] | ||
*[[Rationality as martial art]] | *[[Rationality as martial art]] | ||
− | == | + | ==Primary article== |
+ | *[http://lesswrong.com/lw/2s/3_levels_of_rationality_verification/ Three levels of rationality verification] by [[Eliezer Yudkowsky]] - Reputational, experimental, and organizational: the different strengths of evidence needed to (a) prevent a school from degenerating, (b) systematically test particular techniques, or (c) credential individuals. | ||
− | *[http://lesswrong.com/lw/h/test_your_rationality/ Test your rationality] by Robin Hanson | + | ==Blog posts== |
− | *[http://lesswrong.com/lw/gn/the_martial_art_of_rationality/ The martial art of rationality] | + | *[http://lesswrong.com/lw/h/test_your_rationality/ Test your rationality] by [[Robin Hanson]] - You should try hard and often to test your rationality, but how can you do that? |
− | *[http://lesswrong.com/lw/2c/a_sense_that_more_is_possible/ A sense that more is possible] | + | *[http://lesswrong.com/lw/gn/the_martial_art_of_rationality/ The martial art of rationality] by [[Eliezer Yudkowsky]] |
− | *[http://lesswrong.com/lw/2i/epistemic_viciousness/ Epistemic viciousness] (in the martial arts) | + | *[http://lesswrong.com/lw/2c/a_sense_that_more_is_possible/ A sense that more is possible] by [[Eliezer Yudkowsky]] |
− | *[http://lesswrong.com/lw/2j/schools_proliferating_without_evidence/ Schools proliferating without evidence] (in both psychotherapy and martial arts) | + | *[http://lesswrong.com/lw/2i/epistemic_viciousness/ Epistemic viciousness] (in the martial arts) by [[Eliezer Yudkowsky]] |
− | *[http://lesswrong.com/lw/2s/3_levels_of_rationality_verification/ Three levels of rationality verification] | + | *[http://lesswrong.com/lw/2j/schools_proliferating_without_evidence/ Schools proliferating without evidence] (in both psychotherapy and martial arts) by [[Eliezer Yudkowsky]] |
− | *[http://lesswrong.com/lw/2x/in_what_ways_have_you_become_stronger/ In what ways have you become stronger?] by Vladimir Nesov | + | *[http://lesswrong.com/lw/2s/3_levels_of_rationality_verification/ Three levels of rationality verification] by [[Eliezer Yudkowsky]] |
− | *[http://lesswrong.com/lw/6d/ask_lw_what_questions_to_test_in_our_rationality/ Ask LW: What questions to test in our rationality questionnaire?] by Anna Salamon | + | *[http://lesswrong.com/lw/2x/in_what_ways_have_you_become_stronger/ In what ways have you become stronger?] by [[Vladimir Nesov]] - Brainstorming verification tests, asking along what dimensions you think you've improved due to "rationality". |
+ | *[http://lesswrong.com/lw/6d/ask_lw_what_questions_to_test_in_our_rationality/ Ask LW: What questions to test in our rationality questionnaire?] by [[Anna Salamon]] - Requesting suggestions for an actual survey to be run. | ||
+ | {{lesswrongtag|verification}} | ||
− | |||
− | |||
− | |||
[[Category:Problems]] | [[Category:Problems]] |
Revision as of 19:02, 5 June 2009
The single largest problem for those desiring to create methods of systematically training for increased epistemic and instrumental rationality - how to verify that the training actually worked. Very Awful Things happen to people who set out to build training methods and schools without strong means of verification - two hideous historical examples being modern-day practice of martial arts (once the teachers are no longer fighting duels to the death) and the proliferating "schools" of psychotherapy (in the entire absence of any experimental evidence that one school worked better than another, and indeed, in the presence of experimental evidence that the schools did not have any discernible difference in effectiveness).
See also
Primary article
- Three levels of rationality verification by Eliezer Yudkowsky - Reputational, experimental, and organizational: the different strengths of evidence needed to (a) prevent a school from degenerating, (b) systematically test particular techniques, or (c) credential individuals.
Blog posts
- Test your rationality by Robin Hanson - You should try hard and often to test your rationality, but how can you do that?
- The martial art of rationality by Eliezer Yudkowsky
- A sense that more is possible by Eliezer Yudkowsky
- Epistemic viciousness (in the martial arts) by Eliezer Yudkowsky
- Schools proliferating without evidence (in both psychotherapy and martial arts) by Eliezer Yudkowsky
- Three levels of rationality verification by Eliezer Yudkowsky
- In what ways have you become stronger? by Vladimir Nesov - Brainstorming verification tests, asking along what dimensions you think you've improved due to "rationality".
- Ask LW: What questions to test in our rationality questionnaire? by Anna Salamon - Requesting suggestions for an actual survey to be run.