鶹ýɫƬ

Life in the Lab

COVID-19 retractions show that the science is working as it should

Mark R. O'Brian
July 12, 2020

Several high-profile papers on COVID-19 research have come under fire from people in the scientific community in recent weeks. Two articles addressing the safety of certain drugs when taken by COVID-19 patients were , and researchers are calling for the retraction of a third paper that evaluated behaviors that .

Some people are viewing the retractions as an . Certainly, the overturning of these papers is bad news, and there is plenty of blame to go around.

But despite these short-term setbacks, the scrutiny and subsequent correction of the papers actually show that science is working. Reporting of the pandemic is allowing people to see, many for the first time, the messy business of scientific progress.

Scientific community quickly responds to flawed research

In May, two papers were published on the safety of certain drugs for COVID-19 patients. The first, published in the New England Journal of Medicine, claimed that a particular heart medication , despite previous concerns. The second, published in The Lancet, claimed that the antimalarial drug when used to treat COVID-19.

The Lancet paper caused the World Health Organization to briefly for COVID-19 treatment.

Retraction-445x223.jpg
The Lancet/Mandeep R Mehra, Sapan S Desai, Frank Ruschitzka, Amit N Patel
The paper published in The Lancet claimed that hydroxychloroquine increased risk of death in COVID-19 patients, but was retracted when other scientists discovered the data used for the study was unreliable.

Within days, over 200 scientists signed an highly critical of the paper, noting that some of the findings were simply implausible. The database provided by the tiny company Surgisphere – whose website is no longer accessible – was unavailable during peer review of the paper or to scientists and the public afterwards, preventing anyone from evaluating the data. Finally, the letter suggested that it was unlikely this company was able to obtain the hospital records alleged to be in the database when no one else had access to this information.

[The Conversation’s science, health and technology editors pick their favorite stories. .]

By early June, both and articles were retracted, citing concerns about the integrity of the database the researchers used in the studies. A retraction is the withdrawal of a published paper because the data underlying the major conclusions of the work are found to be seriously flawed. These flaws are sometimes, but not always, due to intentional scientific misconduct.

The urgency to find solutions to the COVID-19 pandemic certainly contributed to the publication of . The quality control measures that minimize the publication of bad science failed miserably in these cases.

Imperfect and iterative

The retraction of the hydroxychloroquine paper in particular drew immediate attention not only because it placed science in a bad light, but also because as an effective treatment for COVID-19 despite the lack of strong evidence.

Responses in the media were harsh. The New York Times declared that “.” The Wall Street Journal accused the Lancet of “,” and the Los Angeles Times claimed that the retracted papers “.”

These headlines may have merit, but perspective is also needed. – only about 0.04% of published papers are withdrawn – but scrutiny, update and correction are common. It is how science is supposed to work, and it is happening in all areas of research relating to SARS-CoV-2.

Doctors have learned that the disease , not just the lungs as was initially thought. Scientists are still working on understanding whether COVID-19 patients to the disease. And to close the case on hydroxychloroquine, published after the Lancet retraction indicate that the malaria drug is indeed ineffective in preventing or treating COVID-19.

Science is self-correcting

Before a paper is published, it undergoes peer review by experts in the field who recommend to the journal editor whether it should be accepted for publication, rejected or reconsidered after modification. The reputation of the journal is dependent on high-quality peer review, and once a paper is published, it is in the public domain, where it can then be evaluated and judged by other scientists.

The publication of the Lancet and the New England Journal of Medicine papers failed at the level of peer review. But scrutiny by the scientific community – likely spurred on by the public spotlight on coronavirus research – caught the mistakes in record time.

The hydroxychloroquine article published in The Lancet was retracted only 13 days after it was published. By contrast, it took 12 years for the Lancet to retract the fraudulent article that .

It is not yet known whether these papers involved deliberate scientific misconduct, but mistakes and corrections are common, even for top scientists. For example, , who won the Nobel Prize for discovering the structure of proteins, later published an . It was subsequently corrected by . Mistakes and corrections are a hallmark of progress, not foul play.

Importantly, these errors were exposed by other scientists. They were not uncovered by some policing body or watchdog group.

This back-and-forth between academics is foundational to science. There is no reason to believe that scientists are more virtuous than anyone else. Rather, the mundane human traits of curiosity, competitiveness, self-interest and reputation come into play before and after publication are what allow science to regulate itself. A model based on robust evidence emerges while the weaker one is abandoned.

Living with uncertainty

From high school classes and textbooks, science seems like a body of well-known facts and principles that are straightforward and incontrovertible. These sources view science in hindsight and often make discoveries seem inevitable, even dull.

In reality, scientists learn as they go. Uncertainty is inherent to the path of discovery, and success is not guaranteed. that go through human clinical trials ultimately win FDA approval, with less than a 4% success rate for cancer drugs.

The process of science generally takes place below the radar of public awareness, and so this uncertainty is not generally in view. However, Americans are to the COVID-19 pandemic, and many are, for the first time, seeing the sausage as it is being made.

Although the recent retractions may be unappetizing, medical science has been very successful over the long run. Smallpox has been eradicated, infections are treated with antibiotics rather than amputation and pain management during surgery has advanced well beyond biting on a stick.

The system is by no means perfect, but it is pretty darned good.The Conversation

This article is republished from under a Creative Commons license. Read the .

Enjoy reading ASBMB Today?

Become a member to receive the print edition monthly and the digital edition weekly.

Learn more
Mark R. O'Brian

Mark R. O'Brian is a professor and the chair of the biochemistry department at the University of Buffalo's Jacobs School of Medicine and Biomedical Sciences.

Get the latest from ASBMB Today

Enter your email address, and we’ll send you a weekly email with recent articles, interviews and more.

Latest in Opinions

Opinions highlights or most popular articles

At a career crossroads: Exploring postdoc, faculty and industry paths
Essay

At a career crossroads: Exploring postdoc, faculty and industry paths

Sept. 19, 2024

“At the crossroads of an academic career, postdocs find ourselves grappling with a challenging decision … about defining our trajectory in academia and shaping the impact we want to have in the academic community.”

How do you help a biochemist find a career path?
Essay

How do you help a biochemist find a career path?

Sept. 18, 2024

Industry, academia and the ASBMB join forces to introduce students job options in the sciences with a panel, networking and cheese.

'Don’t be afraid to take a different path'
Profile

'Don’t be afraid to take a different path'

Sept. 11, 2024

In 2016, MOSAIC scholar Rebecca Ann Faulkner paused her career for four years to focus on her family, a decision she believes made her a more effective and empathetic scientist.

The perverse legacy of participation in human genomic research
Essay

The perverse legacy of participation in human genomic research

Sept. 7, 2024

The story of how one person became the majority source of DNA for the Human Genome Project encapsulates 20th-century researchers’ attitudes toward donor consent, the author says.

Announcing the winners of the 鶹ýɫƬ Motifs bioart competition
Contest

Announcing the winners of the 鶹ýɫƬ Motifs bioart competition

Sept. 3, 2024

The 12 winning works of art to be featured in the 2025 ASBMB calendar were selected from 37 entries received from scientists in both academia and industry at all career stages with submissions coming from as far away as Pakistan and Brazil.

The fourth third of my career: Living the dream
Essay

The fourth third of my career: Living the dream

Aug. 28, 2024

After a few decades of being a professor, Jonathan Monroe thought it would be fun to return to the life of a postdoc after retiring. Here’s how he did it.