From the standpoint of the agency, he said, the study had answered the question it was designed to answer: The median time that hospitalized Covid-19 patients on remdesivir took to stop needing oxygen or exit the hospital was, at 11 days, four days shorter than those who were on placebo. “How many patients would we want to put at risk of dying,” he asked, for that last little bit of proof? Remdesivir, he noted, was not a home run, but is probably better than nothing.
Steven Nissen, a veteran trialist and cardiologist at the Cleveland Clinic, disagreed that giving placebo patients remdesivir was the right call. “I believe it is in society’s best interest to determine whether remdesivir can reduce mortality, and with the release of this information doing a placebo-controlled trial to determine if there is a mortality benefit will be very difficult,” he said. “The question is: Was there a route, or is there a route, to determine if the drug can prevent death?” The decision is “a lost opportunity,” he said.
Peter Bach, the director of the Center for Health Policy and Outcomes at Memorial Sloan Kettering Cancer Center, agreed with Nissen. “The core understanding of clinical research participation and clinical research conduct is we run the trial rigorously to provide the most accurate information about the right treatment,” he said. And that answer, he argued, should ideally have determined whether remdesivir saves lives.
The reason we have shut our whole society down, Bach said, is not to prevent Covid-19 patients from spending a few more days in the hospital. It is to prevent patients from dying. “Mortality is the right endpoint,” he said.
Most experts contacted by STAT expressed opinions that fell between Nissen and Lane, believing that the decision was a difficult case, with several defending the NIAID.
“I think it was a really tough call,” said Janet Wittes, a prominent statistician and the president of Statistics Collaborative.
When the remdesivir results were announced, the NIH said the data came from an “interim” analysis. This means that a study was stopped early because a drug’s benefit was so undeniable that it would be unethical to continue the study. But Lane said this was incorrect. The data come from a preliminary final analysis, a point at which the study would normally end.
Related:With remdesivir, Gilead finds itself at strategic crossroads, with its reputation (and far more) at stake
The ACTT study (short for Adaptive Covid-19 Treatment Trial) began in late February. The first patient dosed in the study was an American repatriated from the Diamond Princess, a British cruise ship where there was an outbreak of more than 800 Covid-19 cases. By the terms of the study, hospitalized patients were randomly assigned to receive either intravenous remdesivir or a placebo. On day 15, the study would score patients on a scale from 1 (dead) to 8 (not hospitalized, with no restrictions on activities).
As results from other Covid-19 studies conducted in China started to trickle in, Lane and his team began to worry that looking at the outcome on only the 15th day could lead the study to fail even if the drug was effective. On March 22, with only 77 patients enrolled in the study, members of the NIAID team had a conference call on which they decided to change the measure that would be used. Instead of measuring patients on an eight-point scale on one day, the study would measure the time until the patients scored one of the best three outcomes on the scale. This decision was finalized on April 2; it was posted to clinicaltrials.gov, a government registry of clinical trials, on April 16.
Ironically, Lane said, the study would still have been positive if the change had not been made. But the change in the study’s main goal also changed the way the study would be analyzed. Now, the NIAID decided, the analysis would be calculated when 400 patients out of the 1,063 patients the study enrolled had recovered. If remdesivir turned out to be much more effective than expected, “interim” analyses would be conducted at a third and two-thirds that number.