Half of the Facts You Know Are Probably Wrong

A review of The Half-Life of Facts: Why Everything We Know Has an Expiration Date by Samuel Arbesman.

Dinosaurs were cold-blooded. Vast increases in the money supply produce inflation. Increased K-12 spending and lower pupil/teacher ratios boosts public school student outcomes. Most of the DNA in the human genome is junk. Saccharin causes cancer and a high fiber diet prevents it. Stars cannot be bigger than 150 solar masses. And by the way, what are the ten most populous cities in the United States?

In the past half century, all of the foregoing facts have turned out to be wrong (except perhaps the one about inflation rates). We'll revisit the ten biggest cities question below. In the modern world facts change all of the time, according to Samuel Arbesman, author of The Half-Life of Facts: Why Everything We Know Has an Expiration Date.  

Arbesman, a senior scholar at the Kaufmann Foundation and an expert in scientometrics, looks at how facts are made and remade in the modern world. And since fact-making is speeding up, he worries that most of us don’t keep up to date and base our decisions on facts we dimly remember from school and university classes that turn out to be wrong.

The field of scientometrics – the science of measuring and analyzing science – took off in 1947 when mathematician Derek J. de Solla Price was asked to store a complete set of the Philosophical Transactions of the Royal Society temporarily in his house. He stacked them in order and he noticed that the height of the stacks fit an exponential curve. Price started to analyze all sorts of other kinds of scientific data and concluded in 1960 that scientific knowledge had been growing steadily at a rate of 4.7 percent annually since the 17th century. The upshot was that scientific data was doubling every 15 years.

In 1965, Price exuberantly observed, “All crude measures, however arrived at, show to a first approximation that science increases exponentially, at a compound interest of about 7 percent  per annum, thus doubling in size every 10–15 years, growing by a factor of 10 every half century, and by something like a factor of a million in the 300 years which separate us from the seventeenth-century invention of the scientific paper when the process began.” A 2010 study in the journal Scientometrics looked at data between 1907 and 2007 and concluded that so far the “overall growth rate for science still has been at least 4.7 percent per year.”

Since scientific knowledge is still growing by a factor of ten every 50 years, it should not be surprising that lots of facts people learned in school and universities have been overturned and are now out of date.  But at what rate do former facts disappear? Arbesman applies the concept of half-life, the time required for half the atoms of a given amount of a radioactive substance to disintegrate, to the dissolution of facts. For example, the half-life of the radioactive isotope strontium-90 is just over 29 years. Applying the concept of half-life to facts, Arbesman cites research that looked into the decay in the truth of clinical knowledge about cirrhosis and hepatitis. “The half-life of truth was 45 years,” reported the researchers.

In other words, half of what physicians thought they knew about liver diseases was wrong or obsolete 45 years later. As interesting and persuasive as this example is, Arbesman’s book would have been strengthened by more instances drawn from the scientific literature.

Facts are being manufactured all of the time, and, as Arbesman shows, many of them turn out to be wrong. Checking each by each is how the scientific process is supposed work, i.e., experimental results need to be replicated by other researchers. How many of the findings in 845,175 articles published in 2009 and recorded in PubMed, the free online medical database, were actually replicated? Not all that many. In 2011, a disheartening study in Nature reported that a team of researchers over ten years was able to reproduce the results of only six out of 53 landmark papers in preclinical cancer research.

In 2005, “Why Most Published Research Findings Are False” by physician and statistician John Ioannides appeared in the journal PLoS Medicine. Ioannides cataloged the flaws of much biomedical research, pointing out that reported studies are less likely to be true when they are small, the postulated effect is weak, research designs and endpoints are flexible, financial and nonfinancial conflicts of interest are present, and competition in the field is fierce. Ioannides concluded that “for many current scientific fields, claimed research findings may often be simply accurate measures of the prevailing bias.”  Still knowledge advances, spawning new facts and changing old ones.

Arbesman also delves into what he calls “hidden public knowledge.” Consider again that nearly 850,000 new articles dealing with biomedical research were published in 2009; lots of true information will be overlooked in that deluge. Arbesman illustrates the point with the case in which Harvard researchers decided to go back and actually look at all of the prior randomized control trials relating to heart attacks and the drug streptokinase between 1959 and 1988. In 1988, a big trial showed that intravenous streptokinase was effective in treating heart attacks.

Combing through the “hidden public knowledge” in the prior studies, the researchers concluded that the scientists could have found a statistically significant result in 1973 rather than in 1988. No doubt countless lives were lost because the knowledge of streptokinase’s efficacy remained hidden in the scientific literature for 15 years.  The good news is that better data dredging techniques, CoPub Discovery, and collaborative networking systems like Mendeley have been developed so that fewer facts will languish unused in the future.

People also cling to selected “facts” as a way to justify their beliefs about how the world works. Arbesman notes, “We persist in only adding facts to our personal store of knowledge that jibe with what we already know, rather than assimilate new facts irrespective of how they fit into our worldview.” All too true; confirmation bias is everywhere.

So is there anything we can do to keep up to date with changing facts (other than constantly reading Reason)? Arbesman suggests that simply knowing that our factual knowledge bases have a half-life should keep us humble and always seeking new information. Well, hope springs eternal. More daringly, Arbesman suggests, “Stop memorizing things and just give up. Our individual memories can be outsourced to the cloud.” Through the Internet, we can “search for any fact we need any time.” Really? The Web is great for finding a list of the ten biggest cities in the United States, but if the scientific literature is merely littered with wrong facts, then cyberspace is an enticing quagmire of falsehoods, propaganda, and just plain bunkum. There simply is no substitute for skepticism.

Toward the end, Arbesman suggests that eventually “exponential knowledge growth cannot continue forever.” Among the reasons he gives for the slow-down is that current growth rates imply that everyone on the planet would one day be a scientist. The 2010 study in Scientometrics mentioned above also mused about the growth rate in the number of scientists and offered a conjecture “that the borderline between science and other endeavors in the modern, global society will become more and more blurred.” Arbesman notes that “the number of neurons that can be recorded simultaneously has been growing exponentially, with a doubling time of about seven and a half years.” This suggests that brain/computer linkages will one day be possible. I, for one, am looking forward to updating my factual knowledge daily through a direct telecommunications link from my brain to digitized contents of the Library of Congress.  

Find this and hundreds of other interesting books at the Reason Shop, powered by Amazon.

Editor's Note: We invite comments and request that they be civil and on-topic. We do not moderate or assume any responsibility for comments, which are owned by the readers who post them. Comments do not represent the views of Reason.com or Reason Foundation. We reserve the right to delete any comment for any reason at any time. Report abuses.

  • ant1sthenes||

    I, for one, am looking forward to updating my factual knowledge daily through a direct telecommunications link from my brain to digitized contents of the Library of Congress.

    Cool, then the progtard university elite can just erase my memory of freedom so I don't miss it, as well as any crimethink.

  • NeonCat||

    You have the right attitude, citizen. You would go far if there were anywhere to go.

  • Almanian's Evil Twin||

    But the science is settled!

  • Tim||

    Yeah Bailey, imagine the day when we can post links directly into your brain.
    http://www.youtube.com/watch?v=OAX7af8CZwQ

  • Ron Bailey||

    Tim: That's what I'm talking about!

  • SugarFree||

    But do half the facts have any imperfections that would cause them to flip differently?

  • Fluffy||

    There's a positivist bias here that fails to take into account the fact that most of the data in question is irrelevant to my decision-making process.

    They can study whether bacon is good for me until the end of time, geometrically increasing the amount of hard data on the subject at ever-increasing rates, and it just won't matter. Because I don't care if bacon is good for me or not.

  • Ron Bailey||

    Fluffy: But knowing for a fact that it's not good for you would provide an extra frisson of pleasure as you indulged in your bacon-y vices.

  • BakedPenguin||

    Additionally, that information might lead you to eat bacon three meals a day, instead of only two.

  • Bernieyeball||

    You tell 'em fluff.
    I'll bet you don't care if gravity is good for you or not either.

  • Suki||

    So why was the inflation thingie included? Is it due to overprinting of fiat money or not? Or is it to to other possibilities in addition to over active printing press overlords?

  • ||

    The number one misconception about science that I come across is that science is about truth.

    Science isn't about truth, science is about facts. Facts are always dependent on certain assumptions, the truth is not.

  • mad libertarian guy||

    In the modern world facts change all of the time, according to Samuel Arbesman, author of The Half-Life of Facts: Why Everything We Know Has an Expiration Date.

    Except for Climatology, because THE SCIENCE IS FUCKING SETTLED.

  • ||

    I have one: Warty does NOT have the biggest penis in the universe.

  • Xerxes||

    Until the Mind machine link is a reality, it seems to me the idea of "outsourcing" all of your knowledge to online repositories is a step in the wrong direction. While it is understandable in cutting edge research, much creativity in science (as well as art!) come from the synthesis of different realms of knowledge ... sometimes unconsciously. Working at a university, I have seen the consequences of treating most of the human experience like random movie trivia to be accessed at will on IMDB.

  • Gabriel Hanna||

    Most of the DNA in the human genome is junk.

    It's not true at all that this has been overturned. The claim ENCODE is making is that 80% of the genome produces some kind of protein that has some kind of effect what goes on in the cell. This is how they choose to define "function". But it is not the same as saying 80% of the genome is phenotypically expressed, which is what the public--and creationists--are trying to take away from this.

    It's pretty easy to find qualified commentary on this. I don't include the link, T. Ryan Gregory sums it up this way.

    So, even the most rigorous efforts to find function for non-coding DNA in the human genome have come up with a figure of 80% at best, and only when they use a very flexible definition of “function”. 20% remains a more realistic number, and that would leave a heck of a lot of non-functional DNA in the human genome. If anyone should be pleased by these results, it’s those who maintain that a sizeable portion of the human genome is without a biological function at the level of the organism.

    Also, there’s this:

    These considerations suggest that up to 20% of the genome is actively used and the remaining 80+% is junk. But being junk doesn’t mean it is entirely useless. Common sense suggests that anything that is completely useless would be discarded. There are several possible functions for junk DNA.

    That was written by D.E. Comings in 1972, in the very first detailed discussion of “junk DNA”.

  • Gabriel Hanna||

    One of the authors, Ewan Birney, acknowledges this:

    Q.But are you most comfortable with the 10% to 20% figure for the hard-core functional bases? Why emphasize the 80% figure in the abstract and press release?

    A. (Sigh.) Indeed. Originally I pushed for using an “80% overall” figure and a “20% conservative floor” figure, since the 20% was extrapolated from the sampling. But putting two percentage-based numbers in the same breath/paragraph is asking a lot of your listener/reader – they need to understand why there is such a big difference between the two numbers, and that takes perhaps more explaining than most people have the patience for. We had to decide on a percentage, because that is easier to visualize, and we choose 80% because (a) it is inclusive of all the ENCODE experiments (and we did not want to leave any of the sub-projects out) and (b) 80% best coveys the difference between a genome made mostly of dead wood and one that is alive with activity.

  • Danno||

    "Vast increases in the money supply produce inflation"

    What is the author implying here? The money equation is "Money Level * Money Velocity = Price Level * Real GDP". So PL = ML * MV / RGDP. Therefore, ML can increase and MV can decrease resulting in no dramatic increase in PL. But here is the scary thought: if MV ignites due to kindling of price inflation for basic goods (say dollar crisis), watch out for PL to skyrocket since due to MV change.

GET REASON MAGAZINE

Get Reason's print or digital edition before it’s posted online

  • Progressive Puritans: From e-cigs to sex classifieds, the once transgressive left wants to criminalize fun.
  • Port Authoritarians: Chris Christie’s Bridgegate scandal
  • The Menace of Secret Government: Obama’s proposed intelligence reforms don’t safeguard civil liberties

SUBSCRIBE

advertisement