Abstract
Multiplex panel tests identify many individual pathogens at once, using a set of component tests. In some panels the number of components can be large. If the panel is detecting causative pathogens for a single syndrome or disease then we might estimate the burden of that disease by combining the results of the panel, for example determining the prevalence of pneumococcal pneumonia as caused by many individual pneumococcal serotypes. When we are dealing with multiplex test panels with many components, test error in the individual components of a panel, even when present at very low levels, can cause significant overall error. Uncertainty in the sensitivity and specificity of the individual tests, and statistical fluctuations in the numbers of false positives and false negatives, will cause large uncertainty in the combined estimates of disease prevalence. In many cases this can be a source of significant bias. In this paper we develop a mathematical framework to characterise this issue, present novel statistical methods that adjust for this bias and quantify uncertainty, and use simulation to test these methods. As multiplex testing becomes more commonly used for screening in routine clinical practice, accumulation of test error due to the combination of large numbers of test results needs to be identified and corrected for.
Author summary During analysis of pneumococcal incidence data obtained from serotype specific multiplex urine antigen testing, we identified that despite excellent test sensitivity and specificity, the small error rate in each individual serotype test has the potential to compound and cause large uncertainty in the resulting estimates of pneumococcal prevalence, obtained by combining individual results. This limits the accuracy of estimates of the burden of disease caused by vaccine preventable pneumococcal serotypes, and in certain situations can produce marked bias.
Competing Interest Statement
CH is Principal Investigator of the AvonCAP study which is an investigator-led University of Bristol study funded by Pfizer. AF is a member of the Joint Committee on Vaccination and Immunization (JCVI). He receives research funding from Pfizer as Chief Investigator of the AvonCAP study and he leads another project investigating transmission of respiratory bacteria in families jointly funded by Pfizer and the Gates Foundation. RC, AC, GQ, GO, RK, and LD receive research funding from Pfizer via the AvonCAP study.
Funding Statement
We would like to acknowledge the help and support of the JUNIPER partnership (MRC grant no MR/X018598/1) which RC and LD and are affiliated with. KTA gratefully acknowledges the financial support of the Engineering and Physical Sciences Research Council (EPSRC) via grant EP/T017856/1. CH was funded by the National Institute for Health Research (NIHR) via an Academic Clinical Fellowship (ACF-2015-25-002). The views expressed are those of the authors. Funding for the AvonCAP study was provided by Pfizer, however, the manuscript development and the analysis that is the subject of this manuscript were conducted independently of Pfizer.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.
Yes
Data Availability
All data and code produced are available online at https://github.com/bristol-vaccine-centre/testerror
