Scientists are plagued by confirmation bias (interpreting information in a way that confirms one's preexisting beliefs or hypotheses). The most basic requirement for scientific research is the unbiased interpretation of experimental results. Unfortunately, scientists are human, and as humans, susceptible to fooling themselves when looking at their investigational outcomes. American politics is rife with obvious examples of confirmation bias. Scientists are also particularly susceptible to confirmation bias because we create novel hypotheses and then experimentally test whether those ideas are correct.
Confirmation bias grows stronger as we invest more time and energy in our research, often making us the least objective person to interpret the results. Scientists understand the importance of having their science reviewed by experts who did not participate in the research, but peer review usually comes after they have decided their work is worthy of publication or funding. Peer review comments come at a time when confirmation bias is most likely to be applied and underlies the disturbing amount of research misconduct that occurs in responding to peer review. Everyone involved in the research enterprise is susceptible to confirmation bias (faculty, postdoctoral fellows, students, staff scientists and technologists).
To avoid being skewered by confirmation bias, it is necessary to structure your ongoing research practices to prevent bias from creeping into the analysis of results starting at the earliest stages of a research project. Jiangwei and I came up with five tips:
Structure an open and transparent research atmosphere where data and experimental design are examined and evaluated by everyone, especially those not working directly on the project.
Encourage and carefully consider critical views on the working hypothesis.
Ensure that all stakeholders examine the primary data. Do not rely on analysis and summary from a single individual.
Design experiments to actually test the hypothesis. The potential outcomes of an experiment should include the possibility to both prove and disprove the working hypothesis.
Before executing the experiment, setthe standard for what results support the hypothesis, what results disprove the hypothesis, and what results fail to provide useful information. This is an excellent safeguard against bias sneaking into the interpretation of results.
For more on the challenges in experimental science, readour review of Richard Harris'Rigor Mortis: How Sloppy Science Creates Worthless Cures, Crushes Hope, and Wastes Billions.
The hardest thing about defeating confirmation bias is that it requires someone to challenge their own logic, which is easier said than done. The simplest way to avoid confirmation bias is to look at a belief you hold, and search out ways in which you're wrong, rather than the ways in which you're right.
To minimize confirmation bias, researchers must continually reevaluate impressions of respondents and challenge preexisting assumptions and hypotheses.
Use proper randomization in your sampling methods with random sampling. Try out these four methods: simple random sampling, systematic sampling, stratified random sampling, and cluster sampling. Ensure subgroups are equivalent to the population (i.e. they share key characteristics)
Having participants validate your results gives you a clear picture of whether or not your findings are an accurate representation of their beliefs – ultimately helping you avoid bias in qualitative research.
Ensure that no important findings from your experiments are left out. Consider all possible outcomes while conducting your experiment. Make sure your methods and procedures are clean and correct. Seek the opinions of other scientists and allow them review you experiment.
Include questions in your survey that will allow easy interpretation of the results. The arrangement, order, and sequence of the questions should reflect the set of questions you have in mind. Please keep this in mind: Put in a lot of thought before you start your survey.
Introduction: My name is Dr. Pierre Goyette, I am a enchanting, powerful, jolly, rich, graceful, colorful, zany person who loves writing and wants to share my knowledge and understanding with you.
We notice you're using an ad blocker
Without advertising income, we can't keep making this site awesome for you.
