Bias Affects All Scientific Research

In a recent column at Nature, Daniel Sarewitz worries about the effect that systematic bias is having on science: “Beware the Creeping Cracks of Bias.” According to Sarewitz, scientists can no longer point the finger at traditional causes but now should “recognize bias is an inescapable element of research.” He finds biomedical research most susceptible to bias (his claim is echoed in the comments) but implies that even physical sciences suffer from bias. Sarewitz’s bold column raises some excellent issues.

Daniel Sarewitz’s recent column on bias.

What is bias? For Sarewitz bias is over-reporting of false positive results, which result from “a powerful cultural belief … that progress in science means the continual production of positive findings.” In the biomedical realm, false positive results cannot be replicated or turn out to be invalid when applied to more complex systems. “A biased scientific result is no different from a useless one.”

According to Sarewitz, bias is not a function of scientific research so much as a characterization of the results of that research. Useful, reproducible results are not biased. Useless and irreproducible results are biased and threaten to erode public trust in science and scientists.

Such an understanding of bias is naive. Bias shapes the construction of every experiment and the interpretation of every result. Such bias is not necessarily malicious but is inescapable. Bias produces not merely systematic errors or useless results. Bias often guides the very research questions, the construction of procedures thought useful in investigating those questions, and regularly produces useful results.

Equating bias with utility ignores history and the manifold ways bias has produced useful if sometimes harmful results. For a few more infamous examples, see “What are Science’s Ugliest Experiments.”

4 comments

  1. David Harley says:

    “Bias” is an unhelpful expression because it implies that there is a View From Nowhere available to us.

    People have viewpoints, as every historian should know. What they see depends on where they stand and who they are.

    THree blind men and elephant.

    If you’ve never seen a table, it’s not obvious what it’s for, so you might well classify it as a seat, a throne, or an altar.

    According to John Aubrey, who was a reasonably good source for this, Hobbes told Harvey that he was lucky to have lived long enough to see his theory generally accepted. It can take quite a while for the old categories to disappear. If the change is big enough, it usually takes until at least one generation dies out or retires.

    Maxwell’s electro-magnetism. Plate tectonics.

Comments are closed.