Ivermectin and COVID-19: Meta Analysis of 36 studies (February 2021)
At-A-Glance:
- 100% of the 36 studies to date report positive effects. Early treatment is more successful, with an estimated reduction of 82% in the effect measured using a random effects meta-analysis, RR 0.18 [0.10-0.34]. Prophylactic use also shows high effectiveness.
- 100% of the 18 Randomized Controlled Trials (RCTs) report positive effects, with an estimated reduction of 71%, RR 0.29 [0.17-0.50].
- The probability that an ineffective treatment generated results as positive as the 36 studies to date is estimated to be 1 in 69 billion (p = 0.000000000015).
Introduction
We analyze all significant studies concerning the use of ivermectin for COVID-19. Search methods, inclusion criteria, effect extraction criteria (more serious outcomes have priority), all individual study data, PRISMA answers, and statistical methods are detailed in Appendix 1. We present random effects meta-analysis results for all studies, for studies within each treatment stage, for mortality results only, and for Randomized Controlled Trials (RCTs) only.We also perform a simple analysis of the distribution of study effects. If treatment was not effective, the observed effects would be randomly distributed (or more likely to be negative if treatment is harmful). We can compute the probability that the observed percentage of positive results (or higher) could occur due to chance with an ineffective treatment (the probability of >= k heads in n coin tosses, or the one-sided sign test / binomial test). Analysis of publication bias is important and adjustments may be needed if there is a bias toward publishing positive results.
Figure 2 shows stages of possible treatment for COVID-19. Prophylaxis refers to regularly taking medication before becoming sick, in order to prevent or minimize infection. Early Treatment refers to treatment immediately or soon after symptoms appear, while Late Treatment refers to more delayed treatment.
Figure 2. Treatment Stages |
Results
Results by Treatment Stage |
Randomized Controlled Trials (RCTs)
RCT results are similar to non-RCT results. Evidence shows that non-RCT trials can also provide reliable results. [Concato] find that well-designed observational studies do not systematically overestimate the magnitude of the effects of treatment compared to RCTs. [Anglemyer] summarized reviews comparing RCTs to observational studies and found little evidence for significant differences in effect estimates. [Lee] shows that only 14% of the guidelines of the Infectious Diseases Society of America were based on RCTs. Evaluation of studies relies on an understanding of the study and potential biases. Limitations in an RCT can outweigh the benefits, for example excessive dosages, excessive treatment delays, or Internet survey bias could have a greater effect on results. Ethical issues may also prevent running RCTs for known effective treatments. For more on issues with RCTs see [Deaton, Nichol].Discussion
Publishing is often biased towards positive results, which we would need to adjust for when analyzing the percentage of positive results. For ivermectin, there is currently not enough data to evaluate publication bias with high confidence. One method to evaluate bias is to compare prospective vs. retrospective studies. Prospective studies are likely to be published regardless of the result, while retrospective studies are more likely to exhibit bias. For example, researchers may perform preliminary analysis with minimal effort and the results may influence their decision to continue. Retrospective studies also provide more opportunities for the specifics of data extraction and adjustments to influence results. While some effects are not statistically significant when considered alone, currently all ivermectin studies report positive effects. 24 of the 36 studies are prospective studies.
Typical meta analyses involve subjective selection criteria, effect extraction rules, and study bias evaluation, which can be used to bias results towards a specific outcome. In order to avoid bias we include all studies and use a pre-specified method to extract results from all studies. Every day that the approval of ivermectin is delayed results in thousands of deaths, so it is important to consider all available data. We note that the positive results to date are very consistent and are relatively insensitive to potential selection criteria, effect extraction rules, and/or bias evaluation.
Studies vary significantly in terms of treatment delay, treatment regimen, patients characteristics, and (for the pooled effects analysis) outcomes, as reflected in the high degree of heterogeneity. However the results consistently show a positive effect of treatment, and with the exception of some late treatment studies, the effect size is large.
Conclusion
Ivermectin is an effective treatment for COVID-19. The probability that an ineffective treatment generated results as positive as the 36 studies to date is estimated to be 1 in 69 billion (p = 0.000000000015). As expected for an effective treatment, early treatment is more successful, with an estimated reduction of 82% in the effect measured using a random effects meta-analysis, RR 0.18 [0.10-0.34].
We performed ongoing searches of PubMed, medRxiv, ClinicalTrials.gov, The Cochrane Library, Google Scholar, Collabovid, Research Square, ScienceDirect, Oxford University Press, the reference lists of other studies and meta-analyses, and submissions to the site c19ivermectin.com, which regularly receives submissions of studies upon publication. Search terms were ivermectin and COVID-19 or SARS-CoV-2, or simply ivermectin. Automated searches are performed every hour with notifications of new matches. All studies regarding the use of ivermectin for COVID-19 that report an effect compared to a control group are included in the main analysis. This is a living analysis and is updated regularly.
We extracted effect sizes and associated data from all studies. If studies report multiple kinds of effects then the most serious outcome is used in calculations for that study. For example, if effects for mortality and cases are both reported, the effect for mortality is used, this may be different to the effect that a study focused on. If symptomatic results are reported at multiple times, we used the latest time, for example if mortality results are provided at 14 days and 28 days, the results at 28 days are used. Mortality alone is preferred over combined outcomes. Outcomes with zero events in both arms were not used. Clinical outcome is considered more important than PCR testing status. For PCR results reported at multiple times, where a majority of patients recover in both groups, preference is given to results mid-recovery (after most or all patients have recovered there is no room for an effective treatment to do better). When results provide an odds ratio, we computed the relative risk when possible, or converted to a relative risk according to [Zhang]. Reported confidence intervals and p-values were used when available, using adjusted values when provided. If multiple types of adjustments are reported including propensity score matching (PSM), the PSM results are used. When needed, conversion between reported p-values and confidence intervals followed [Altman, Altman (B)], and Fisher's exact test was used to calculate p-values for event data. If continuity correction for zero values is required, we use the reciprocal of the opposite arm with the sum of the correction factors equal to 1 [Sweeting]. Results are all expressed with RR < 1.0 suggesting effectiveness. Most results are the relative risk of something negative. If studies report relative times, results are expressed as the ratio of the time for the ivermectin group versus the time for the control group. Calculations are done in Python (3.9.1) with scipy (1.5.4), pythonmeta (1.11), numpy (1.19.4), statsmodels (0.12.1), and plotly (4.14.1).
The forest plots are computed using PythonMeta [Deng] with the DerSimonian and Laird random effects model (the fixed effect assumption is not plausible in this case). The forest plots show simplified dosages for comparison, these are the total dose in the first two days for treatment, and the monthly dose for prophylaxis, for a 70kg person. For full dosage details see below.
We received no funding, this research is done in our spare time. We have no affiliations with any pharmaceutical companies or political parties.
We have classified studies as early treatment if most patients are not already at a severe stage at the time of treatment, and treatment started within 5 days after the onset of symptoms, although a shorter time may be preferable. Antivirals are typically only considered effective when used within a shorter timeframe, for example 0-36 or 0-48 hours for oseltamivir, with longer delays not being effective [McLean, Treanor].
Due to the much larger size of the control group in [Bernigaud], we limit the size of the control group to be the same as the treatment group for calculation of the number of patients.
A summary of study results is below. It is easy to propose excluding certain papers for various reasons. To avoid potential bias in evaluation we currently include all studies. Analysis excluding studies with major issues can be found in Appendix 2.
Effect extraction follows pre-specified rules as detailed above and gives priority to more serious outcomes. Only the first (most serious) outcome is used in calculations, which may differ from the effect a paper focuses on.
Effect extraction follows pre-specified rules as detailed above and gives priority to more serious outcomes. Only the first (most serious) outcome is used in calculations, which may differ from the effect a paper focuses on.
Prophylaxis (Prevention)
Effect extraction follows pre-specified rules as detailed above and gives priority to more serious outcomes. Only the first (most serious) outcome is used in calculations, which may differ from the effect a paper focuses on.
References
Afsar et al., SSRN, Ivermectin Use Associated with Reduced Duration of COVID-19 Febrile Illness in a Community Setting, https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3734478.
Ahmed et al., International Journal of Infectious Diseases, doi:10.1016/j.ijid.2020.11.191, A five day course of ivermectin for the treatment of COVID-19 may reduce the duration of illness, https://www.sciencedirect.com/science/article/pii/S1201971220325066.
Alam et al., European Journal ofMedical and Health Sciences, doi:10.24018/ejmed.2020.2.6.599, Ivermectin as Pre-exposure Prophylaxis for COVID-19 among Healthcare Providers in a Selected Tertiary Hospital in Dhaka – An Observational Study, https://ejmed.org/index.php/ejmed/article/view/599.
Altman, D., BMJ, doi:10.1136/bmj.d2304, How to obtain the P value from a confidence interval, https://www.bmj.com/content/343/bmj.d2304.
Altman (B) et al., BMJ, doi:10.1136/bmj.d2090, How to obtain the confidence interval from a P value, https://www.bmj.com/content/343/bmj.d2090.
Anglemyer et al., Cochrane Database of Systematic Reviews 2014, Issue 4, doi:10.1002/14651858.MR000034.pub2, Healthcare outcomes assessed with observational study designs compared with those assessed in randomized trials, https://www.cochranelibrary.com/cd..0.1002/14651858.MR000034.pub2/full.
Asghar et al., NCT04392713, Efficacy of Ivermectin in COVID-19, https://clinicaltrials.gov/ct2/show/NCT04392713.
Babalola et al., medRxiv, doi:10.1101/2021.01.05.21249131, Ivermectin shows clinical benefits in mild to moderate Covid19 disease: A randomised controlled double blind dose response study in Lagos, https://www.medrxiv.org/content/10.1101/2021.01.05.21249131v1.
Behera et al., medRxiv, doi:10.1101/2020.10.29.20222661v1, Role of ivermectin in the prevention of COVID-19 infection among healthcare workers in India: A matched case-control study, https://www.medrxiv.org/content/10.1101/2020.10.29.20222661v1.
Bernigaud et al., Annals of Dermatology and Venereology, doi:10.1016/j.annder.2020.09.231, Ivermectin benefit: from scabies to COVID-19, an example of serendipity, https://www.sciencedirect.com/science/article/pii/S015196382030627X.
Budhiraja et al., medRxiv, doi:10.1101/2020.11.16.20232223, Clinical Profile of First 1000 COVID-19 Cases Admitted at Tertiary Care Hospitals and the Correlates of their Mortality: An Indian Experience, https://www.medrxiv.org/content/10.1101/2020.11.16.20232223v1.
Cadegiani et al., medRxiv, doi:10.1101/2020.10.31.20223883, Early COVID-19 Therapy with Azithromycin Plus Nitazoxanide, Ivermectin or Hydroxychloroquine in Outpatient Settings Significantly Reduced Symptoms Compared to Known Outcomes in Untreated Patients, https://www.medrxiv.org/content/10.1101/2020.10.31.20223883v1.
Camprubà et al., PLoS ONE, 15:11, doi:10.1371/journal.pone.0242184, Lack of efficacy of standard doses of ivermectin in severe COVID-19 patients, https://journals.plos.org/plosone/..le?id=10.1371/journal.pone.0242184.
Carvallo et al., medRxiv, doi:10.1101/2020.09.10.20191619, Safety and Efficacy of the combined use of ivermectin, dexamethasone, enoxaparin and aspirin against COVID-19, https://www.medrxiv.org/content/10.1101/2020.09.10.20191619v1.
Carvallo (B) et al., Journal of Biomedical Research and Clinical Investigation, doi:10.31546/2633-8653.1007, Study of the Efficacy and Safety of Topical Ivermectin + Iota-Carrageenan in the Prophylaxis against COVID-19 in Health Personnel, https://medicalpressopenaccess.com/upload/1605709669_1007.pdf.
Carvallo (C) et al., NCT04425850, Usefulness of Topic Ivermectin and Carrageenan to Prevent Contagion of Covid 19 (IVERCAR), https://clinicaltrials.gov/ct2/show/results/NCT04425850.
Chaccour et al., EClinicalMedicine, doi:10.1016/j.eclinm.2020.100720 (preprint 12/7), The effect of early treatment with ivermectin on viral load, symptoms and humoral response in patients with non-severe COVID-19: A pilot, double-blind, placebo-controlled, randomized clinical trial, https://www.sciencedirect.com/science/article/pii/S2589537020304648.
Chachar et al., International Journal of Sciences, 9:31-35, doi:10.18483/ijSci.2378, Effectiveness of Ivermectin in SARS-CoV-2/COVID-19 Patients, https://www.ijsciences.com/pub/article/2378.
Chala et al., NCT04701710, Prophylaxis Covid-19 in Healthcare Agents by Intensive Treatment With Ivermectin and Iota-carrageenan (Ivercar-Tuc), https://clinicaltrials.gov/ct2/show/NCT04701710.
Concato et al., NEJM, 342:1887-1892, doi:10.1056/NEJM200006223422507, https://www.nejm.org/doi/full/10.1056/nejm200006223422507.
Deaton et al., Social Science & Medicine, 210, doi:10.1016/j.socscimed.2017.12.005, Understanding and misunderstanding randomized controlled trials, https://www.sciencedirect.com/science/article/pii/S0277953617307359.
Elgazzar et al., Research Square, doi:10.21203/rs.3.rs-100956/v2, Efficacy and Safety of Ivermectin for Treatment and prophylaxis of COVID-19 Pandemic, https://www.researchsquare.com/article/rs-100956/v3.
Elgazzar (B) et al., Research Square, doi:10.21203/rs.3.rs-100956/v2, Efficacy and Safety of Ivermectin for Treatment and prophylaxis of COVID-19 Pandemic, https://www.researchsquare.com/article/rs-100956/v3.
Espitia-Hernandez et al., Biomedical Research, 31:5, Effects of Ivermectin-azithromycin-cholecalciferol combined therapy on COVID-19 infected patients: A proof of concept study, https://www.biomedres.info/biomedi..-proof-of-concept-study-14435.html.
Gorial et al., medRxiv, doi:10.1101/2020.07.07.20145979, Effectiveness of Ivermectin as add-on Therapy in COVID-19 Management (Pilot Trial), https://www.medrxiv.org/content/10.1101/2020.07.07.20145979v1.
Hashim et al., medRxiv, doi:10.1101/2020.10.26.20219345, Controlled randomized clinical trial on using Ivermectin with Doxycycline for treating COVID-19 patients in Baghdad, Iraq, https://www.medrxiv.org/content/10.1101/2020.10.26.20219345v1.
Hellwig et al., International Journal of Antimicrobial Agents, doi:10.1016/j.ijantimicag.2020.106248, A COVID-19 Prophylaxis? Lower incidence associated with prophylactic administration of Ivermectin, https://www.sciencedirect.com/science/article/pii/S0924857920304684.
Hill et al., Research Square, doi:10.21203/rs.3.rs-148845/v1, Meta-analysis of randomized trials of ivermectin to treat SARS-CoV-2 infection, https://www.researchsquare.com/article/rs-148845/v1.
Khan et al., Archivos de BronconeumologÃa, doi:10.1016/j.arbres.2020.08.007, Ivermectin treatment may improve the prognosis of patients with COVID-19, https://www.archbronconeumol.org/e..ognosis-articulo-S030028962030288X.
Kirti et al., medRxiv, doi:10.1101/2021.01.05.21249310, Ivermectin as a potential treatment for mild to moderate COVID-19: A double blind randomized placebo-controlled trial, https://www.medrxiv.org/content/10.1101/2021.01.05.21249310v1.
Kory et al., FLCCC Alliance, Review of the Emerging Evidence Demonstrating the Efficacy of Ivermectin in the Prophylaxis and Treatment of COVID-19, https://covid19criticalcare.com/wp..axis-and-treatment-of-COVID-19.pdf.
Krolewiecki et al., SSRN, Antiviral Effect of High-Dose Ivermectin in Adults with COVID-19: A Pilot Randomised, Controlled, Open Label, Multicentre Trial, https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3714649.
Lawrie et al., Preprint, Ivermectin reduces the risk of death from COVID-19 – a rapid review and meta-analysis in support of the recommendation of the Front Line COVID-19 Critical Care Alliance, https://b3d2650e-e929-4448-a527-4e..b655bd21b1448ba6cf1f4c59f0d73d.pdf.
Lee et al., Arch Intern Med., 2011, 171:1, 18-22, doi:10.1001/archinternmed.2010.482, Analysis of Overall Level of Evidence Behind Infectious Diseases Society of America Practice Guidelines, https://jamanetwork.com/journals/j..nternalmedicine/fullarticle/226373.
Mahmud et al., Clinical Trial Results, NCT04523831, Clinical Trial of Ivermectin Plus Doxycycline for the Treatment of Confirmed Covid-19 Infection, https://clinicaltrials.gov/ct2/show/results/NCT04523831?view=results.
McLean et al., Open Forum Infect. Dis. September 2015, 2:3, doi:10.1093/ofid/ofv100, Impact of Late Oseltamivir Treatment on Influenza Symptoms in the Outpatient Setting: Results of a Randomized Trial, https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4525010/.
Mohan et al., Ivermectin in mild and moderate COVID-19 (RIVET-COV): a randomized, placebo-controlled trial, https://www.researchsquare.com/article/rs-191648/v1.
Niaee et al., Research Square, doi:10.21203/rs.3.rs-109670/v1, Ivermectin as an adjunct treatment for hospitalized adult COVID-19 patients: A randomized multi-center clinical trial, https://www.researchsquare.com/article/rs-109670/v1.
Nichol et al., Injury, 2010, doi: 10.1016/j.injury.2010.03.033, Challenging issues in randomised controlled trials, https://www.injuryjournal.com/article/S0020-1383(10)00233-0/fulltext.
OkumuÅŸ et al., NCT04646109, Ivermectin for Severe COVID-19 Management, http://www.metaevidence.org/viewStudy.aspx?study=6449.
Podder et al., IMC J. Med. Science, 14:2, July 2020, Outcome of ivermectin treated mild to moderate COVID-19 cases: a single-centre, open-label, randomised controlled study, http://imcjms.com/registration/journal_abstract/353.
Raad et al., ChiCTR2000033627, In vivo use of ivermectin (IVR) for treatment for corona virus infected patients (COVID-19): a randomized controlled trial, http://www.chictr.org.cn/showprojen.aspx?proj=54707.
Rajter et al., Chest, doi:10.1016/j.chest.2020.10.009, Use of Ivermectin is Associated with Lower Mortality in Hospitalized Patients with COVID-19 (ICON study), https://www.sciencedirect.com/science/article/pii/S0012369220348984.
Rezai et al., IRCT20111224008507N3, Effectiveness of Ivermectin in the Treatment of Coronavirus Infection in Patients admitted to Educational Hospitals of Mazandaran in 2020, https://en.irct.ir/trial/49174.
Shouman et al., Journal of Clinical and Diagnostic Research, doi:10.7860/JCDR/2020/46795.0000, Use of Ivermectin as a Potential Chemoprophylaxis for COVID-19 in Egypt: A Randomised Clinical Trial, https://www.researchgate.net/publi.._Egypt_A_Randomised_clinical_trial.
Soto-Becerra et al., medRxiv, doi:10.1101/2020.10.06.20208066, Real-World Effectiveness of hydroxychloroquine, azithromycin, and ivermectin among hospitalized COVID-19 patients: Results of a target trial emulation using observational data from a nationwide Healthcare System in Peru, https://www.medrxiv.org/content/10.1101/2020.10.06.20208066v1.
Spoorthi et al., IAIM, 2020, 7:10, 177-182, Utility of Ivermectin and Doxycycline combination for the treatment of SARSCoV-2, http://iaimjournal.com/wp-content/..oads/2020/10/iaim_2020_0710_23.pdf.
Sweeting et al., Statistics in Medicine, doi:10.1002/sim.1761, What to add to nothing? Use and avoidance of continuity corrections in meta‐analysis of sparse data, https://onlinelibrary.wiley.com/doi/10.1002/sim.1761.
Treanor et al., JAMA, 2000, 283:8, 1016-1024, doi:10.1001/jama.283.8.1016, Efficacy and Safety of the Oral Neuraminidase Inhibitor Oseltamivir in Treating Acute Influenza: A Randomized Controlled Trial, https://jamanetwork.com/journals/jama/fullarticle/192425.
Vallejos et al., Trials, doi:10.1186/s13063-020-04813-1, Ivermectin to prevent hospitalizations in patients with COVID-19 (IVERCOR-COVID19): a structured summary of a study protocol for a randomized controlled trial, https://trialsjournal.biomedcentra..rticles/10.1186/s13063-020-04813-1.
52. Zhang et al., JAMA, 80:19, 1690, doi:10.1001/jama.280.19.1690, What's the relative risk? A method of correcting the odds ratio in cohort studies of common outcomes, https://jamanetwork.com/journals/jama/fullarticle/188182.SOURCE: https://ivmmeta.com
Comments
Post a Comment