Skip to content

Why Research Confirms You

asymmetric search; you look for the yes and never run the test that could say no

Study this properly

Free flashcard deck: Cognitive Biases - 100 cards

Start studying

Research confirms you because you build the test to confirm you. You do not study the full situation; you study the slice that matches your belief, and that slice always says yes.

The mechanism of a rigged test

Confirmation bias is not a single habit. It is three habits working together. Attention: you spot what you are looking for. Memory: you recall the times the belief came true and forget the times it did not. Interpretation: you accept a supporting instance as proof and explain away a contradicting one as luck, rudeness, or an exception.

Suppose you think a coworker is rude. Your mental test is “Is there an example of rudeness?” That test is almost impossible to fail, because a person who is occasionally abrupt will give you an example within a day. A fair test would be written in advance: “I will count rude and kind exchanges for one week. If rude is less than half, I will revise my belief.” Without that pre-commitment, the friendly mornings pass unseen and the one curt reply becomes the whole story.

A numerical feel for the trap

Say your coworker is late to meetings 20% of the time. Over ten meetings, they arrive on time eight times and late twice. If you are watching for lateness, you will see two late arrivals and conclude “they are always late.” The eight on-time arrivals are invisible because you never asked about them. If instead you had written down “on time” and “late” for all ten, the numbers would correct you. The same logic applies to any belief: the evidence you collect depends entirely on the question you record.

The misunderstanding that defeats the fix

The common misunderstanding is that trying to be balanced is enough. It is not. If you ask “Is my belief true?” you will still generate reasons why it is true. The only effective move is to ask the opposite question with equal effort: “What would have to happen for me to abandon this belief?” Then go look for that thing. If you search hard for disconfirmation and cannot find it, your belief has real supporting strength. If you find it, you have learned something far more useful than being right.

When this does not apply

The confirmation trap applies to claims about the world that can be wrong. It does not apply to personal taste, where there is no truth to test, or to unfalsifiable statements, where no conceivable observation would count as a no. And it is less urgent for decisions with tiny stakes: you do not need a pre-registered adversarial trial to choose a word in a crossword puzzle. But for beliefs that shape how you treat people, or conclusions that matter to your work, searching for the no is the only fair test.

Transcript

Cram If I think an idea is right, the fair move is to look for proof, right?

Rep That is the one search that can never surprise you. Hunt only for the yes and the no never shows up.

Cram So my research is tilted before it starts?

Rep Tilted is the point. You ask a question built to say you are right, and it always does.

Cram Show me one I can feel.

Rep You suspect a coworker is rude, so you watch for rudeness. Every curt reply proves it, the friendly mornings slip away.

Cram I focus on what fits and ignore what does not.

Rep Exactly. Memory helps. The match stands out, the miss does not stick. The test was designed to pass.

Cram So what does a fair test even look like?

Rep Write your question down first. Then go look for the opposite with the same energy. If no real no appears, your yes has meaning.

Cram And if I hunt hard and still find only support?

Rep Now that is evidence, not a feeling. Beliefs that survive a genuine no-search are the ones worth keeping.

Cram So the goal is to be honest, not to win.

Rep Winning was never the point. Ask what could break your belief and confirmation bias loses its grip on you.

More lessons