ABSTRACT
Rationale C-reactive protein (CRP)-based tuberculosis (TB) screening is recommended for people with HIV (PWH). However, its performance among people without HIV and in diverse settings is unknown.
Objectives In a multi-country study, we aimed to determine whether CRP meets the minimum accuracy targets (sensitivity ≥90%, specificity ≥70%) for an effective TB triage test.
Methods/Measurements Consecutive outpatient adults with cough ≥2 weeks from five TB endemic countries in Africa and Asia had baseline blood collected for point-of-care CRP testing and HIV and diabetes screening. Sputum samples were collected for Xpert MTB/RIF Ultra (Xpert) testing and culture. CRP sensitivity and specificity (5 mg/L cut-point) was determined in reference to sputum test results and compared by country, sex, and HIV and diabetes status. Variables affecting CRP performance were identified using a multivariate receiver operating characteristic (ROC) regression model.
Results Among 2904 participants, of whom 613 (21%) had microbiologically-confirmed TB, CRP sensitivity was 84% (95% CI: 81-87%) and specificity was 61% (95% CI: 59-63%). CRP accuracy varied geographically, with higher sensitivity in African countries (≥91%) than Asian countries (64-82%). Sensitivity was higher among men than women (87% vs. 79%, difference +8%, 95% CI: 1-15%) and specificity was higher among people without HIV than PWH (64% vs. 45%, difference +19%, 95% CI: 13-25%). ROC regression identified country and measures of TB disease severity as predictors of CRP performance.
Conclusions Overall, CRP did not achieve the minimum accuracy targets and its performance varied by setting and in some sub-groups, likely reflecting population differences in mycobacterial load.
Introduction
Each year, one-third (4 million) of all individuals with active tuberculosis (TB) are not diagnosed or reported, leading to unfavorable outcomes for people with TB and ongoing TB transmission within communities.1 New approaches are urgently needed to reach the “missing 4 million” and reduce TB incidence worldwide. Triage testing can help prioritize higher risk individuals for confirmatory testing and an effective non-sputum triage test is considered among the highest priority needs for TB diagnostics.2 Modeling studies have shown that an effective TB triage test – defined as a simple-to-perform, point-of-care, low-cost test with a minimum sensitivity and specificity of 90% and 70%, respectively – could increase TB case detection while reducing unnecessary confirmatory testing by 40-60%.3
TB triage testing options are limited. Chest x-ray (CXR) has high accuracy but requires expensive infrastructure, has high per test costs, and requires either trained personnel or computer-aided detection algorithms for interpretation.4–6 No other tests meet the accuracy targets and operational characteristics of an effective TB triage test.
C-reactive protein (CRP), a non-specific marker of inflammation, was recently recommended by World Health Organization (WHO) as a TB screening tool to facilitate intensified case finding among people living with HIV (PWH) based on multiple diagnostic accuracy studies and an individual patient meta-analysis.7 However, data on CRP as a triage test among all people with presumptive TB are limited and findings inconsistent. A meta-analysis of prospective studies evaluating CRP as a triage test among outpatients with presumptive TB demonstrated variability in accuracy by geography and HIV status.8 Similar results were found in a multi-country study analyzing CRP from banked plasma, but a more recent study from South Africa reported similar accuracy by HIV status.9,10
To better characterize the utility of CRP as a TB triage test, we performed a prospective, multi-country study among outpatient adults with presumptive TB in five high TB burden settings in Uganda, South Africa, the Philippines, Vietnam, and India. Our objectives were to 1) determine whether the sensitivity and specificity of CRP, measured at the point-of-care from capillary blood, meets or exceeds minimum accuracy targets for a TB triage test; 2) determine whether CRP performance differs by country, HIV status, diabetes status and/or sex and, 3) identify factors that most impact CRP performance.
Methods
Study Participants
We screened adults (age ≥18 years) presenting to outpatient clinics in Kampala, Uganda; Cape Town, South Africa; Desmariñas City, Philippines; Hanoi, Vietnam; and Vellore, India for new or worsening cough ≥2 weeks. We excluded people who received treatment for TB infection or disease in the prior 12 months, took other medications with anti-mycobacterial activity (e.g., fluoroquinolones) in the past 2 weeks, lived more than 20 km from the study site or expressed unwillingness to return for follow-up.
Procedures
Trained study personnel collected demographic and clinical data using a standardized questionnaire and assessed participants for presence and duration of TB symptoms. CRP concentrations were measured at enrollment from whole blood obtained from fingerprick using a US Food and Drug Administration-approved standard sensitivity point-of-care assay (ichroma CRP rapid test, Boditech, South Korea) and a dedicated fluorescence-based immunoassay analyzer (ichromaTM II, Boditech, South Korea) that provided quantitative CRP results (range: 2.5-300 mg/L) in three minutes. Participants provided two to three spot sputum specimens (≥1 mL each; induced with nebulized 3%-10% NaCl solution, if necessary) upon study entry for reference standard TB testing by trained laboratory technicians blinded to clinical and demographic data (including CRP levels), in quality-assured mycobacteriology laboratories. TB testing included Xpert MTB/RIF Ultra (Ultra; Cepheid, CA, USA), inclusive of repeat testing if the initial result was trace or invalid, and liquid mycobacterial culture x2 (for participants without positive Ultra results), as described previously.11
Definitions
We defined a priori a point-of-care CRP concentration of ≥5 mg/L as a positive result in accordance with WHO guidelines for TB screening among PWH.2 We considered participants to be “TB-positive” by our microbiologic reference standard (MRS) if they had ≥1 positive sputum Xpert result (defined as semi-quantitative result of “very low” or higher), two “trace” sputum Xpert results, or M. tuberculosis isolated from ≥1 sputum culture. We required participants to have two negative culture results (and not meet the criteria above) to be “TB-negative”. Participants with insufficient data to classify TB status were excluded from analysis. To assess performance of CRP triage testing in routine settings where culture is typically not available, we also evaluated CRP accuracy in reference to sputum Xpert results (SXRS) alone.
Statistical Analysis
A statistical analysis plan including reference standard definitions was finalized prior to analysis. We planned for a minimum sample size of 1500 participants (N=300 per country/year) such that the width of the 95% confidence interval (CI) would be less than ±9.4% if test sensitivity was ≥80% and less than ±5.6% if observed test specificity was ≥60%, assuming a TB prevalence of 20%. To enable sub-group analyses, we continued enrollment beyond our planned sample size of 1500 participants.
We summarized categorical and continuous variables for enrolled participants. We calculated the point estimates and 95% confidence intervals (CIs) for the sensitivity and specificity of CRP (using a 5 mg/L cut-point) using both reference standards. We used Chi-squared tests to compare differences in sensitivity and specificity between countries and pre-defined sub-groups including PWH, people living with diabetes (PWD), and by sex. We performed receiver operating characteristic (ROC) curve analysis and calculated area under the curve (AUC) with 95% CIs overall, by country and for each sub-group. We used De Long’s method to compare AUC between countries and between sub-groups. To identify factors impacting AUC, we built a parametric multivariate ROC regression model using maximum likelihood estimation. We included variables selected a priori (age, sex, country, HIV positive with CD4 count ≤200, diabetes, measures of TB disease severity) and additional variables with p<0.2 in the unadjusted models. For each variable, we evaluated the magnitude and direction (positive or negative) of the beta-coefficients in order to identify the variables having the greatest influence on CRP performance. We also used tobit regression to assess whether any demographic or clinical characteristics were associated with elevated CRP. Analyses were conducted using Stata Version 17 (StataCorp, College Station, Texas, USA).
Ethics
The study was approved by institutional review boards at the University of California San Francisco (USA), University of Heidelberg (Germany), Makerere University (Uganda), Stellenbosch University (South Africa), Christian Medical College (India), National Lung Hospital (Vietnam) and De La Salle Medical and Health Sciences Institute (Philippines). This manuscript adheres to guidelines for reporting of diagnostic accuracy studies.12
Results
Study population/Patient demographic and clinical characteristics
From April 2021 to October 2023, we screened 4264 outpatient adults with cough ≥2 weeks and enrolled 3232 (76%) meeting study eligibility criteria (Figure 1). Of these, we excluded 105 (3%) participants for whom CRP testing was not performed and 223 (7%) participants with missing or incomplete TB test results from the analysis. Baseline characteristics of the remaining 2904 varied across countries (Table 1). The proportions of individuals reporting a prior history of TB ranged from 13% in Uganda to 31% in South Africa, with HIV ranged from 1% in Vietnam to 38% in South Africa, with diabetes ranged from 5% in South Africa to 22% in India (Supplementary Table S1 describes baseline diabetes characteristics of PWD). The proportion of individuals with elevated CRP concentrations (≥5 mg/L) was lowest (26%) in the Philippines and highest (67%) in South Africa, and median CRP concentration was lowest (2.5 mg/L) in the Philippines and highest (10.7 mg/L) in Uganda (Table 1).
Overall, 613 (21%) patients had confirmed TB by the MRS including 562 (92%) with positive sputum Xpert results and 51 (8%) with positive sputum culture results only. TB prevalence varied across countries; prevalence was lowest in India (9%) and highest in Uganda (33%).
Diagnostic accuracy of CRP overall and by country
When compared to MRS, the AUC for CRP was 0.81 (95% CI: 0.79-0.83) (Figure 2). We observed higher AUC for CRP (0.82-0.83) for African countries and lower AUC (0.76-0.80) for Asian countries.
Using the WHO-recommended cut-point (≥5 mg/L), sensitivity of CRP was 84% (95% CI: 81-87%) and specificity was 61% (95% CI: 59-63%) (Table 2). Sensitivity was highest in African countries (91-93%) and lowest in Asian countries (64-82%) (Table S2, p<0.01). Specificity was highest in Asian countries (62-78%), exceeding 70% in the Philippines only, and lowest in African countries (39-58%) (p<0.01). Sensitivity and specificity estimates were similar overall and for each country when using sputum Xpert results alone as the reference standard (Table S3).
Diagnostic accuracy of CRP in sub-populations
Figure 3 shows the ROC for CRP in reference to MRS overall and for key sub-groups (PWH, PWD) and by sex. There was no difference in CRP accuracy by HIV status, diabetes status, or sex (AUC comparison p-value ≥0.10 for all 3 sub-groups, Table S4). Supplementary tables S5, S6 and S7 describe the sensitivity and specificity of CRP in reference to MRS and SXRS, by HIV status, diabetes status, and sex, respectively. At a 5 mg/L cut-point, CRP did not achieve the minimum 90% target for sensitivity or 70% target for specificity in any sub-population in reference to MRS but sensitivity reached 90% among PWH in reference to sputum Xpert results alone. Among PWD, sensitivity of CRP exceeded 90% among certain diabetes sub-groups, including those with newly diagnosed diabetes and those with HbA1c <7% (Table S8).
CRP sensitivity was higher in men than women (87% vs. 79%, difference +8% [95% CI: 1 to 15%], p=0.02) and specificity was higher in people without HIV than PWH (64% vs. 45%, difference +19% [95% CI: 13 to 25%], p<0.01). There was no evidence of a difference in sensitivity and specificity by any other sub-group.
ROC regression
In univariable models, country, multiple markers of disease or illness severity (HIV-positive with CD4 count ≤200, heart rate [HR], weight loss, and body mass index [BMI]) and a marker of TB disease severity (Xpert semi-quantitative grade) were associated with the diagnostic accuracy of CRP. In the multivariable model, only country, HIV-positive with CD4 count ≤200, HR, BMI and Xpert semi-quantitative grade were significantly associated with CRP accuracy (p<0.05, Table S9), of which, beta-coefficients (absolute value) were largest for the following variables: PWH with CD4 count ≤200, country and Xpert semi-quantitative grade. The direction of the beta-coefficient indicated the directional impact of the variable on CRP accuracy. Asian countries were associated with reduced CRP accuracy, as evidenced by negative beta-coefficients (Philippines B=-0.38, 95% CI: -0.71 to -0.04 and Vietnam B=-0.32, 95% CI: -0.60 to -0.05). High HR (B=0.01, 95% CI: +0.002 to +0.013), low BMI (B=0.04, 95% CI: +0.02 to +0.07), and PWH with CD4 count ≤200 (B=0.43, 95% CI: +0.02 to +0.84) were associated with increased CRP accuracy. Among those with active TB, higher mycobacterial burden, which was more common among African countries, increased CRP accuracy (medium/high Xpert semi-quantitative grade B=0.44, 95% CI: +0.27 to +0.62). Other variables such as diabetes was associated with elevated CRP levels in tobit regression (Table S10) but was not associated with change in CRP accuracy in the ROC regression (Table S9).
Discussion
CRP was recently endorsed by the WHO as a new TB screening tool for PWH, based mostly on data from sub-Saharan Africa.2,7 However, the usefulness of CRP for TB triage testing among symptomatic individuals with and without HIV and from other settings is unknown. In this multi-country evaluation among outpatient adults with cough ≥2 weeks, we found that CRP did not meet the minimum sensitivity (90%) or specificity targets (70%) recommended by the WHO for an effective TB triage test overall (sensitivity 84% and specificity 63%, in reference to MRS). Although CRP performed better in some countries and sub-groups, there was no country or sub-group where CRP met the minimum targets for both sensitivity and specificity. These results suggest that CRP is unlikely to be broadly useful for TB triage testing.
Our study is the first multi-country prospective evaluation of CRP-based TB triage testing and the first study to evaluate the diagnostic accuracy of CRP using the WHO-recommended 5 mg/L cut-point, a priori. To-date, prior studies evaluating CRP TB triage testing have been limited to case-control studies and one prospective study.9,10 We found that while CRP did not meet the minimum WHO targets for sensitivity or specificity overall, CRP demonstrated substantial geographic variability such that sensitivity exceeded 91% in reference to MRS in Africa but was much lower (64-82%) in Asia, where specificity was highest. These geographic differences in CRP sensitivity, which have also been reported by prior studies, correlated with observed geographic differences in mycobacterial load.8,9,13 Consistent with the prior multi-national study using stored specimens9, CRP sensitivity in our study was lower in Asia (where 36-44% of Xpert-positive participants had a semi-quantitative result of “medium” or “high”) than in Africa (where 50-70% of Xpert-positive participants had a semi-quantitative result of “medium” or “high”). These results suggest that factors affecting mycobacterial load in a population are likely to have substantial impact on CRP accuracy.
The diagnostic accuracy of any test is sensitive to differences in the characteristics of the population in which the test is evaluated, particularly differences in the spectrum of disease severity. For TB, the spectrum of clinical disease severity is associated with mycobacterial load14–19, and multiple measurements of mycobacterial load (e.g., smear status, Xpert semi-quantitative grade, time-to-culture positivity) have been correlated with CRP levels.9,20–24 Other patient factors (e.g., biologic characteristics, behaviors) and health system factors can influence the mycobacterial load in a population. Biologic characteristics such as HIV and diabetes are known to affect mycobacterial load and therefore TB test accuracy by influencing disease susceptibility and severity.25,26 Mycobacterial load is also susceptible to factors leading to delays in TB diagnosis, such as patient health-seeking behavior and accessibility of TB diagnostic services. To better understand the factors affecting the diagnostic accuracy of CRP, we evaluated CRP accuracy by HIV status, diabetes status and sex. Additionally, we performed a ROC regression to identify additional factors, including measures of mycobacterial load, that may contribute to differences in CRP performance.
When we evaluated the diagnostic accuracy of CRP triage testing by HIV status, we found no difference in sensitivity in reference to both MRS and SXRS by HIV status but found that specificity was substantially lower among PWH relative to people without HIV (-19% difference in reference to MRS). Our results differ from an earlier study that enrolled more immunosuppressed PWH (lower median CD4 counts, smaller proportion of PWH on ART) and found HIV infection to be associated with increased CRP sensitivity.9 However, our results are similar to a more recent study with similar demographics for PWH as our study (high median CD4 count and high proportion of PWH on ART) which also found no difference in CRP sensitivity by HIV status.10 Combined, these studies suggest that HIV infection may have less of an impact on CRP performance when there are less differences in TB risk between people with and without HIV (i.e., due to less immunosuppression among PWH) and may explain why HIV infection with CD4 count >200 was not associated with CRP accuracy in our ROC regression. As median pre-ART CD4 count and ART coverage increases, fewer settings are likely to report differences in CRP sensitivity by HIV status but differences in specificity may persist due to the increased susceptibility to other non-TB diseases associated with HIV infection (e.g., bacterial pneumonia), regardless of CD4 count.
Alternatively, for people with known HIV infection, CRP could be used to screen unselected PWH or PWH who screen-positive by screening strategies more sensitive than cough ≥2 weeks (i.e., WHO 4-part symptom screen, CXR), and in these scenarios, CRP can be expected to have higher specificity than reported here.7,20
Like HIV, diabetes is also associated with increased susceptibility to infections including pulmonary TB and more severe TB disease.27,28 However, in our study we found no differences in CRP sensitivity or specificity by diabetes status, perhaps due to the modest effect of diabetes on infectious disease risk, and no difference in CRP accuracy among different diabetic sub-groups. Larger studies are needed to better understand factors that may impact CRP performance among PWD. When we compared CRP accuracy by sex, we found that sensitivity was significantly higher among men (+8% difference in reference to MRS) but still failed to reach the minimum 90% sensitivity target when either MRS or SXRS was used as the reference standard. The higher sensitivity of CRP among men could at least partly be explained by sex differences in mycobacterial load, which many studies have largely attributed to delayed healthcare-seeking behavior.29,30 For men and people living in areas where time-to-TB diagnosis is delayed (populations expected to have higher mycobacterial load at diagnosis), our results suggest that CRP triage testing can be expected to detect the majority of those individuals with active TB who are at highest risk for poor outcomes from later TB diagnosis. However, a greater number of confirmatory tests may need to be performed per TB case detected, as the prevalence of non-TB disease causing elevations in CRP is also likely increased. In such settings or populations, additional triage testing (e.g., CXR) may help improve overall specificity.
Conversely, our results also suggests that CRP triage testing is likely to miss a greater proportion of individuals with active TB in areas where the spectrum of clinical disease severity is milder and mycobacterial load is lower at diagnosis. Sensitivity of CRP was lowest in the Philippines, where TB appeared to be diagnosed at an earlier stage than other countries; participants in the Philippines with active TB reported the fewest number of symptoms, had the lowest median CRP levels and lowest mycobacterial load. Although study procedures were the same for all sites, some settings may be diagnosing TB earlier than other settings by, for example, routinely screening individuals for active TB or ensuring most of the population has access to high quality TB diagnostic services. In such settings, more sensitive TB diagnostics will be needed to increase TB case detection.
Our study has several strengths. First, ours is the largest study to-date to report the diagnostic accuracy of CRP as a triage test for pulmonary TB and our consecutive cohort of outpatients enrolled from five TB endemic countries with diverse TB, HIV and diabetes epidemiology ensures the generalizability of our findings. Second, diagnostic accuracy of CRP was evaluated in reference to both a robust microbiologic and a pragmatic reference standard that is routinely used in most high burden settings. Third, CRP concentrations were measured using a commercially available, simple, and low-cost point-of-care assay. As such, CRP is available for immediate scale-up for clinics wishing to implement CRP-based TB triage testing and further strengthen its evidence base.
Our study also has important limitations. First, we did not assess all variables that may contribute to differences in mycobacterial load and thus, CRP performance. Although prior studies have confirmed the association of certain patient and health system factors on measures of mycobacterial load 31–33 and, separately, studies have correlated mycobacterial load with CRP levels, 9,20–24 future studies should consider including variables that affect mycobacterial load in their data collection to more directly evaluate the extent to which these factors affect test performance. Second, we screened all prospective participants for cough ≥2 weeks, including PWH. Future studies should evaluate the performance and yield of CRP-based TB triage testing in combination with more sensitive screening tools such as the WHO 4-part symptom screen and CXR. Third, we identified individuals with active TB by evaluating sputum only and did not perform additional testing to evaluate for extrapulmonary TB or non-TB disease; studies assessing the causes and significance of elevated CRP levels among individuals with non-TB disease are particularly needed. Additionally, future studies should consider evaluating the impact of Mtb strain-type on TB test performance, as one prior study found an association between Mtb strain-type and host CRP response to TB.13
In conclusion, CRP in our study was not the one-size-fits-all TB triage test clinicians, researchers, and policymakers alike, were hoping for. We found that CRP performance varied greatly by setting and in some sub-groups, most likely reflecting population differences in mycobacterial load and the spectrum of clinical disease severity. More sensitive and specific tests with similar operational characteristics to CRP are needed for scale-up of TB triage testing in TB endemic settings.
Supplement
This article has an online data supplement (10 Supplementary Tables).
Funding
Research reported in this publication was supported by the National Institute of Allergy and Infectious Diseases of the US National Institutes of Health under award number U01AI152087. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Conflict of interest
William Worodria, Charles Yu, Nhung Viet Nguyen, Devasahayam Jesudas Christopher, Grant Theron, Patrick P.J. Philips, Payam Nahid, Claudia M. Denkinger, Adithya Cattamanchi, and Christina Yoon declare support from the underlying R2D2 TB Network to their institutions from the National Institute of Allergy and Infectious Diseases (NIAID) of the US National Institutes of Health (NIH). CMD also declares research grants from the German Ministry of Education and Research, German Alliance for Global Health Research, US Agency for International Development, FIND, German Center for Infection Research, and WHO. AC declares research funding to his institution from NIH, Bill and Melinda Gates Foundation, and Global Health Labs. CY declares research grants from NIH/NIAID and NIH/National Heart Lung Blood Institute, with CRP test strips and analyzers donated by Boditech Med Inc, South Korea. CY serves as a a Scientific Advisory Board member for an EDCTP-funded cluster randomized trial. All other authors declare no competing interests.
CRP test strips and analyzer were donated by Boditech Med Inc, South Korea.