Abstract
Background and objective Diagnosis of P. jirovecii pneumonia (PJP) is by PCR on lower respiratory tract specimens, the collection of which is not always well-tolerated and requires trained staff and costly equipment not usually available in low-resource settings. We aimed to evaluate P. jirovecii PCR performed on nasopharyngeal swabs (NPS) as a diagnostic test for PJP, as well as the impact of specimen quality on test performance.
Methods Patients with clinically-suspected PJP in public hospitals in Queensland, Australia, who had quantitative P. jirovecii PCR performed on lower respiratory tract specimens from 1 January 2015 to 31 December 2016, and also had NPS collected by healthcare staff within seven days of lower respiratory tract specimen collection were included in this retrospective cohort study. Quantitative P. jirovecii PCR was performed, and sensitivity, specificity, and positive and negative predictive values were calculated. Specimen quality was assessed by quantifying endogenous retrovirus 3 (ERV3) loads, with higher values indicating better specimen quality.
Results One hundred and eleven patients were included. The sensitivity of NPS P. jirovecii PCR was 0.66 and specificity was 1.0. The positive predictive value was 1.0 and the negative predictive value was 0.63. Median ERV3 loads in lower respiratory tract specimens and NPS were not significantly different in true positive vs. true negative patients, but was significantly higher in true positives vs. false negatives (7.55×102 vs. 3.67×102; P=0.05).
Conclusion P. jirovecii PCR on NPS was highly specific but poorly sensitive. Proper specimen collection is essential to ensure adequate quality and prevent misclassification.
Summary at a Glance Using nasopharyngeal swabs instead of lower respiratory tract specimens for PCR to diagnose P. jirovecii pneumonia (PJP) may be better tolerated and improve diagnostic accessibility. In this two-year retrospective cohort study of patients with clinically-suspected PJP from Queensland, Australia, P. jirovecii PCR on NPS had high specificity but low sensitivity.
Introduction
The unicellular fungus Pneumocystis jirovecii is an opportunistic pathogen causing pneumonia in immunocompromised hosts,1 such as those with HIV/AIDS.2 It is also the commonest fungal cause of pneumonia in non-HIV infected children under 5 years.3 Despite global improvements in HIV prevention and treatment, the burden of P. jirovecii pneumonia (PJP) remains considerable due to the increasing use of immunosuppressive agents for transplantation, malignancy, and autoimmune disorders, along with sub-optimal control of the HIV/AIDS epidemic in developing countries.4, 5
Because P. jirovecii is not culturable in vitro, polymerase chain reaction (PCR) is the gold standard diagnostic method in many countries.6, 7 P. jirovecii PCR is generally performed on lower respiratory tract specimens, such as induced sputum or broncho-alveolar lavage fluid. However, patients may be too frail, young, or hypoxic to undergo such procedures, especially fibre-optic bronchoscopy which may result in unintended morbidity and mortality.8 Lower respiratory tract specimen collection may be invasive and carries a risk of patient discomfort, such as bronchospasm from sputum induction.9 It also requires trained staff as well as costly equipment and facilities, such as negative pressure rooms, resulting in service inequity for patients in rural or remote locations and developing countries.7, 8
There is, therefore, a need for specimens obtainable via low-cost, minimally invasive methods on which P. jirovecii PCR can be performed, but which do not compromise test performance. Nasopharyngeal swabs may be such an alternative. Nevertheless, to our knowledge, the only evidence comparing nasopharyngeal and lower respiratory tract specimens comes from children in a developing country high HIV prevalence setting published over a decade ago,10 indicating a gap in the contemporary evidence. In this study, we aimed to evaluate P. jirovecii PCR performed on nasopharyngeal swabs as a diagnostic test for PJP, as well as the impact of specimen quality on test performance.
Methods
Study design
Retrospective cohort study. The study STROBE checklist can be found in Supporting Document S1.
Setting and participants
Queensland is an Australian state with an estimated HIV prevalence of 0.14%.11 Eligible patients were those with clinically suspected PJP in public sector hospitals who had P. jirovecii PCR performed on lower respiratory tract specimens (either induced sputum or broncho-alveolar lavage fluid) over two years from 1 January 2015 to 31 December 2016, and also had nasopharyngeal swabs collected by healthcare staff within seven days of lower respiratory tract specimen collection. Patients were identified through a state-wide computerized database (AUSLAB; Citadel Health, Canberra, Australia), which contains records of all laboratory investigations requested in public sector healthcare facilities.
PCR method
P. jirovecii PCR was performed on lower respiratory tract specimens and nasopharyngeal swabs on two PCR platforms; a positive result was returned if either detected P. jirovecii DNA.
The PCR detection and subsequent quantification of P.jirovecii was performed using an in-house real-time method on a Rotor-Gene instrument (QIAGEN NV, Venlo, The Netherlands). The mix was prepared using the QIAGEN QuantiTect PCR kit (QIAGEN NV, Venlo, The Netherlands) incorporating specific primers and probe targeting the 5s ribosomal RNA gene, details of which are as follows: forward primer (PCP-TM-5s-F) AGTTACGGCGATACCTCAGAGAATATAC; reverse primer (PCP-TM-5s-R) GCTACAGCACGTCGTATTCCCATA; probe (PCP-TM-5s-probe) FAM-TCACCCACTATAGTACTGACGACGCCCTT-BHQ.
The control and quantitative standards were prepared in-house using extracted patient material with high copy numbers. The standard for the qualitative assay was prepared at 2.5×1010 copies/ml, while four standards were prepared to provide a standard curve with the range 8.0×104 to 8.0×107 copies/ml for the quantitative assay. The standard curve was plotted with the supplied Rotor-Gene software using the quantitation option, and quantitative results for samples were determined from this plot by the software. Results were expressed as copies/ml.
Assessment of specimen quality
Specimen quality was assessed through human DNA quantification using endogenous retrovirus 3 (ERV3) as a surrogate marker, per the method of Alsaleh et al.12 Because each diploid human cell contains two copies of this retrovirus, ERV3 PCR allows accurate quantification of the number of human cells present in a sample; the higher the ERV3 load, the better the quality of the specimen. Its use for this purpose is well-established, with high analytical sensitivity and specificity.13
Statistical analysis
Patients for whom nasopharyngeal swab P. jirovecii PCR results were unavailable were excluded from the analysis. Of the remaining patients, only those with non-missing values of ERV3 load were included in the assessment of specimen quality. Patients who tested negative for ERV3 i.e., had an ERV3 load of zero, were not considered to have missing values for ERV3 load.
The diagnostic sensitivity and specificity, as well as the positive and negative predictive values (PPV and NPV), of nasopharyngeal swabs for PJP were calculated.
To assess the impact of specimen quality, ERV3 loads were compared as follows: in lower respiratory tract specimens in patients with and without PJP (i.e., true positives and true negatives); in nasopharyngeal swab specimens from true positives and true negatives; and in nasopharyngeal swabs from true positives and false negatives, using Mann-Whitney U tests.
Analyses were performed using Stata 17 (StataCorp, College Station, USA). P values ≤0.05 were considered significant. Raw data are available upon request from the corresponding author.
Ethical approval
Ethical approval was obtained from the Royal Brisbane and Women’s Hospital Ethics Committee (HREC/14/QRBW/19).
Funding
This research was funded by a Study, Education, and Research Trust Fund grant from Pathology Queensland. RC was supported by the UK Government through a Commonwealth Scholarship and the Royal Australasian College of Physicians through the Bushell Travelling Fellowship in Medicine or the Allied Sciences. The funders had no role in study design, data collection, data analysis, data interpretation, or writing of the manuscript.
Results
One hundred and eleven patients met the inclusion criteria; their characteristics are summarized in Table 1. Data on ERV3 loads in lower respiratory tract specimens and nasopharyngeal swabs were missing in 3/111 (2.7%) and 13/111 (11.7%) patients, respectively.
From the data in Table 1, the diagnostic sensitivity of nasopharyngeal swab P. jirovecii PCR was 0.66, while its specificity was 1.0. The positive predictive value was 1.0 and the negative predictive value was 0.63.
Median ERV3 loads in lower respiratory tract specimens were not significantly different in true positive and true negative patients (4.25×103 vs. 8.56×103; P=0.06). Median nasopharyngeal swab ERV3 loads were also not significantly different between these two groups (6.20×102 vs. 1.71×103; P=0.07). However, the median ERV3 load in nasopharyngeal swabs from true positives was significantly higher than in false negatives (7.55×102 vs. 3.67×102; P=0.05).
Discussion
We found nasopharyngeal swabs for diagnosis of P. jirovecii PCR to be highly specific but poorly sensitive for diagnosing PJP compared to lower respiratory tract specimens. Given the absence of false positives, therefore, this indicates that a positive PCR on nasopharyngeal swab is sufficient to diagnose PJP. It follows also that our results suggest that colonization of the upper respiratory tract by P. jirovecii is not a barrier to performing PCR on nasopharyngeal swabs for this purpose in adults.
Additionally, we showed that false negative nasopharyngeal swabs contained significantly lower ERV3 loads than true positives, demonstrating the importance of proper specimen collection to ensure adequate quality and prevent misclassification.14 One method of improving the chances of adequate specimen collection is to collect more than one swab for testing in parallel. This has the added benefit of increasing sensitivity, since the sensitivity would be expected to increase to 88% with two swabs and to 96% with three. Such augmentation of the performance of low-sensitivity assays with multiple testing has been demonstrated with SARS-CoV-2 rapid antigen tests in a real-world population during the current COVID-19 pandemic.15
To our knowledge, this is the first study of the use of P. jirovecii PCR on nasopharyngeal swabs for PJP diagnosis in immunosuppressed adult patients living in a developed country, low HIV prevalence setting. Another benefit of using nasopharyngeal swabs is the ability to test for concurrent or alternative diagnoses simultaneously e.g., with a multiplex PCR panel; in our cohort, 12/71 patients with PJP and 6/41 without PJP also had a PCR-confirmed viral respiratory infection.
Our results are not generalizable to children, as none featured in our dataset. The number of patients in this study was small which, together with its observational nature focused on patients with high pre-test probabilities for PJP, are potential sources of bias. This risk was mitigated by including patients fitting the inclusion criteria from all Queensland public hospitals over the span of two years. While we expect P. jirovecii PCR on nasopharyngeal swabs to perform similarly in adult patients from other low HIV prevalence settings, this hypothesis should be tested as part of future research. Ideally this would be a prospective study including all patients clinically suspected of having PJP in a wider range of settings and patient demographics, with paired lower respiratory tract specimens and two to three NP swabs collected from each patient using the correct technique on the same day.
In conclusion, our hypothesis-generating study demonstrates the potential utility of NP swabs for the diagnosis of PJP and lends support for a large-scale prospective study to address this important question, the answer to which will have immediate clinical impact.
Data availability
The data that support the findings of this study are available on request from the corresponding author. The data are not publicly available due to privacy or ethical restrictions.
Footnotes
Conflicts of interest All authors declare no competing interests.