Valley of bad rationality
Then I finally reply that my experience so far - even in this realm of merely human possibility - does seem to indicate that, once you sort yourself out a bit and you aren't doing quite so many other things wrong, striving for more rationality actually will make you better off. The long road leads out of the valley and higher than before, even in the human lands.
It has been observed that when someone is just starting to learn rationality, they appear to be worse off than they were before. Others, with more experience at rationality, claim that after you learn more about rationality, you will be better off than you were before you started. The period before this improvement is known as "the valley of bad rationality".
- Knowing About Biases Can Hurt People
- Incremental Progress and the Valley
- Reason as memetic immune disorder by Phil Goetz
- Making your explicit reasoning trustworthy by Anna Salamon
- This comment by Yvain on Bayesians vs. Barbarians