鶹ýɫƬ

Life in the Lab

COVID-19 retractions show that the science is working as it should

Mark R. O'Brian
July 12, 2020

Several high-profile papers on COVID-19 research have come under fire from people in the scientific community in recent weeks. Two articles addressing the safety of certain drugs when taken by COVID-19 patients were , and researchers are calling for the retraction of a third paper that evaluated behaviors that .

Some people are viewing the retractions as an . Certainly, the overturning of these papers is bad news, and there is plenty of blame to go around.

But despite these short-term setbacks, the scrutiny and subsequent correction of the papers actually show that science is working. Reporting of the pandemic is allowing people to see, many for the first time, the messy business of scientific progress.

Scientific community quickly responds to flawed research

In May, two papers were published on the safety of certain drugs for COVID-19 patients. The first, published in the New England Journal of Medicine, claimed that a particular heart medication , despite previous concerns. The second, published in The Lancet, claimed that the antimalarial drug when used to treat COVID-19.

The Lancet paper caused the World Health Organization to briefly for COVID-19 treatment.

Retraction-445x223.jpg
The Lancet/Mandeep R Mehra, Sapan S Desai, Frank Ruschitzka, Amit N Patel
The paper published in The Lancet claimed that hydroxychloroquine increased risk of death in COVID-19 patients, but was retracted when other scientists discovered the data used for the study was unreliable.

Within days, over 200 scientists signed an highly critical of the paper, noting that some of the findings were simply implausible. The database provided by the tiny company Surgisphere – whose website is no longer accessible – was unavailable during peer review of the paper or to scientists and the public afterwards, preventing anyone from evaluating the data. Finally, the letter suggested that it was unlikely this company was able to obtain the hospital records alleged to be in the database when no one else had access to this information.

[The Conversation’s science, health and technology editors pick their favorite stories. .]

By early June, both and articles were retracted, citing concerns about the integrity of the database the researchers used in the studies. A retraction is the withdrawal of a published paper because the data underlying the major conclusions of the work are found to be seriously flawed. These flaws are sometimes, but not always, due to intentional scientific misconduct.

The urgency to find solutions to the COVID-19 pandemic certainly contributed to the publication of . The quality control measures that minimize the publication of bad science failed miserably in these cases.

Imperfect and iterative

The retraction of the hydroxychloroquine paper in particular drew immediate attention not only because it placed science in a bad light, but also because as an effective treatment for COVID-19 despite the lack of strong evidence.

Responses in the media were harsh. The New York Times declared that “.” The Wall Street Journal accused the Lancet of “,” and the Los Angeles Times claimed that the retracted papers “.”

These headlines may have merit, but perspective is also needed. – only about 0.04% of published papers are withdrawn – but scrutiny, update and correction are common. It is how science is supposed to work, and it is happening in all areas of research relating to SARS-CoV-2.

Doctors have learned that the disease , not just the lungs as was initially thought. Scientists are still working on understanding whether COVID-19 patients to the disease. And to close the case on hydroxychloroquine, published after the Lancet retraction indicate that the malaria drug is indeed ineffective in preventing or treating COVID-19.

Science is self-correcting

Before a paper is published, it undergoes peer review by experts in the field who recommend to the journal editor whether it should be accepted for publication, rejected or reconsidered after modification. The reputation of the journal is dependent on high-quality peer review, and once a paper is published, it is in the public domain, where it can then be evaluated and judged by other scientists.

The publication of the Lancet and the New England Journal of Medicine papers failed at the level of peer review. But scrutiny by the scientific community – likely spurred on by the public spotlight on coronavirus research – caught the mistakes in record time.

The hydroxychloroquine article published in The Lancet was retracted only 13 days after it was published. By contrast, it took 12 years for the Lancet to retract the fraudulent article that .

It is not yet known whether these papers involved deliberate scientific misconduct, but mistakes and corrections are common, even for top scientists. For example, , who won the Nobel Prize for discovering the structure of proteins, later published an . It was subsequently corrected by . Mistakes and corrections are a hallmark of progress, not foul play.

Importantly, these errors were exposed by other scientists. They were not uncovered by some policing body or watchdog group.

This back-and-forth between academics is foundational to science. There is no reason to believe that scientists are more virtuous than anyone else. Rather, the mundane human traits of curiosity, competitiveness, self-interest and reputation come into play before and after publication are what allow science to regulate itself. A model based on robust evidence emerges while the weaker one is abandoned.

Living with uncertainty

From high school classes and textbooks, science seems like a body of well-known facts and principles that are straightforward and incontrovertible. These sources view science in hindsight and often make discoveries seem inevitable, even dull.

In reality, scientists learn as they go. Uncertainty is inherent to the path of discovery, and success is not guaranteed. that go through human clinical trials ultimately win FDA approval, with less than a 4% success rate for cancer drugs.

The process of science generally takes place below the radar of public awareness, and so this uncertainty is not generally in view. However, Americans are to the COVID-19 pandemic, and many are, for the first time, seeing the sausage as it is being made.

Although the recent retractions may be unappetizing, medical science has been very successful over the long run. Smallpox has been eradicated, infections are treated with antibiotics rather than amputation and pain management during surgery has advanced well beyond biting on a stick.

The system is by no means perfect, but it is pretty darned good.The Conversation

This article is republished from under a Creative Commons license. Read the .

Enjoy reading ASBMB Today?

Become a member to receive the print edition four times a year and the digital edition weekly.

Learn more
Mark R. O'Brian

Mark R. O'Brian is a professor and the chair of the biochemistry department at the University of Buffalo's Jacobs School of Medicine and Biomedical Sciences.

Get the latest from ASBMB Today

Enter your email address, and we’ll send you a weekly email with recent articles, interviews and more.

Latest in Opinions

Opinions highlights or most popular articles

Where do we search for the fundamental stuff of life?
Essay

Where do we search for the fundamental stuff of life?

Dec. 1, 2024

Recent books by Thomas Cech and Sara Imari Walker offer two perspectives on where to look for the basic properties that define living things.

Scientists around the world report millions of new discoveries every year
Essay

Scientists around the world report millions of new discoveries every year

Nov. 24, 2024

Science is a collaborative endeavor, and international teams have contributed to a huge rise in scientific output.

Who decides when a grad student graduates?
Training

Who decides when a grad student graduates?

Nov. 15, 2024

Ph.D. programs often don’t have a set timeline. Students continue with their research until their thesis is done, which is where variability comes into play.

Redefining ‘what’s possible’ at the annual meeting
President's Message

Redefining ‘what’s possible’ at the annual meeting

Nov. 1, 2024

The ASBMB Annual Meeting is “a high-impact event — a worthwhile investment for all who are dedicated to advancing the field of biochemistry and molecular biology and their careers.”

鶹ýɫƬ impressions of water as cuneiform cascade*
Essay

鶹ýɫƬ impressions of water as cuneiform cascade*

Oct. 31, 2024

Inspired by "the most elegant depiction of H2O’s colligative features," Thomas Gorrell created a seven-tiered visual cascade of Sumerian characters beginning with the ancient sign for water.

Water rescues the enzyme
Essay

Water rescues the enzyme

Oct. 31, 2024

“Sometimes you must bend the rules to get what you want.” In the case of using water in the purification of calpain-2, it was worth the risk.