Observation selection effect
A selection effect exists when some property of a thing is correlated with its being sampled. The classic example is a phone poll sampling only those people who have phones. Where only wealthy people have phones, such a poll would overestimate average wealth.
An observation selection effect exists when some property of a thing is correlated with the observer existing in the first place. The study of such effects is sometimes called "anthropic reasoning" or "anthropics", after the anthropic principle. For example, if intelligence hadn't evolved, we wouldn't exist. So it's not obvious that we can start from the observation that intelligence evolved here, and infer that such evolution is common, or that designing intelligence is easy.
Recent approaches to such effects have focused less on "anthropic principles" and more on candidate assumptions such as:
- The Self-Sampling Assumption, which performs a Bayesian update on the fact that you were randomly chosen out of the set of all observers.
- The Self-Indication Assumption, which favors theories in proportion to the number of observers they predict, because with more observers, you're more likely to exist at all. (Sometimes, people take this to include the Self-Sampling Assumption, using "SIA" as shorthand for "SSA+SIA".)
- Full Non-indexical Conditioning, which performs a Bayesian update on the fact that there exists someone with your exact experiences.
Such assumptions are needed to determine how we choose between theories predicting different sets of observers.
- Nick Bostrom's book Anthropic Bias
- A primer on the anthropic principle
- Anthropic reasoning in the great filter