Copyright ©ERS Journals Ltd 2008 Comparison of T-Spot.TB and tuberculin skin test among silicotic patients1 Tuberculosis and Chest Service, Centre for Health Protection, Dept of Health, 2 Dept of Microbiology and Centre of Infection, University of Hong Kong, and 3 Tuberculosis and Chest Unit, Grantham Hospital, Hong Kong, China. CORRESPONDENCE: C. C. Leung, Pneumoconiosis Clinic, 4/F, 8 Chai Wan Road, Shaukeiwan, Hong Kong, China. Fax: 86 85229775940. E-mail: cc_leung{at}dh.gov.hk Keywords: Latent tuberculosis infection, silicosis, smoking
Received: May 7, 2007
In the present study, T-Spot.TB and the tuberculin skin test (TST) were compared in the screening of latent tuberculosis infection among silicotic patients. A conditional probability model was used to compare the potential clinical utilities of T-Spot.TB and TST performed on 134 silicotic subjects from December 1, 2004 to January 31, 2007. Data from a historical cohort were also reanalysed for further comparison.
Agreement with T-Spot.TB was best using a TST cut-off of 10 mm. Age T-Spot.TB is likely to perform better than tuberculin test in the screening of latent tuberculosis infection among silicotic subjects. Silicotic subjects are at a high risk of developing tuberculosis (TB). Two previous studies in Hong Kong quantified the annual risk of TB in silicotic subjects, which is in the range of 3–5% per annum 1, 2. Tuberculin skin test (TST; tuberculin test) has been in regular use for the diagnosis of latent tuberculosis infection (LTBI) for many years. A positive reaction can result from infection by Mycobacterium tuberculosis, previous bacillus Calmette–Guérin (BCG) vaccination, or cross-reaction caused by nontuberculous mycobacteria 3. Most of the silicotic patients in the present study, with a mean age of 60 yrs, were born before a large-scale BCG vaccination was introduced in Hong Kong, but little data is available on the impact of other environmental mycobacteria. A cut-off point of 10 mm has regularly been employed to diagnose LTBI. The actual sensitivity is unknown because of the absence of a gold standard. Reduced sensitivity of tuberculin with age has been reported among residents of residential homes 4 and elderly patients with culture-confirmed TB 5. Smoking, alcohol use and body mass index have been found to be independent predictors of a positive tuberculin reaction among silicotic subjects 6, but this could reflect either higher prevalence of LTBI or underlying differences in the immune status. Interferon (IFN)- release blood assays have been introduced in recent years. Based on specific antigens identified through genomic research, they are less likely to be affected by previous BCG vaccination and infections with nontuberculous mycobacteria 7. In the absence of a gold standard for LTBI, estimation of diagnostic sensitivity was primarily based on the test-positive rate among patients with culture-confirmed TB, and estimation of specificity on the test-negative rate among individuals with low risk of exposure in a low TB incidence area 3, 8. Preliminary evidence suggests a higher sensitivity and specificity of these tests than the traditional TST 8–11. In the targeted screening for LTBI, comparison between these tests has mainly been performed using various measures of agreement, such as concordance/discordance or kappa measure, with or without correlation with exposure gradient 7–11. However, the actual significance of such measures is difficult to interpret in day-to-day clinical practice, especially outside the contact settings. Therefore, the present authors conducted a study comparing an enzyme-linked immunospot assay, T-Spot.TB (Oxford Immunotec Ltd, Abingdon, UK), with TST in the targeted screening of silicotic subjects, and employed a simple conditional model to examine how measurements of agreement could translate into clinically relevant performance characteristics in the target population.
All confirmed silicotic patients with profusion of opacities at category 1 or above, without past history or current suspicion of active TB and not having been offered targeted screening and treatment of LTBI, were offered both TST and T-Spot.TB test when they attended the Pneumoconiosis Clinic (Hong Kong, China), the only compensation assessment centre for pneumoconiosis in Hong Kong. Background sociodemographic and clinical information was obtained together with checking old BCG scars and measurement of baseline body weight and height. After consent, TST was carried out by the Mantoux technique with two units of purified protein derivative-RT23 on one of the forearms, which was read after 48–72 h. In addition, 8 mL of fresh blood was taken by venipuncture for T-Spot.TB, which was conducted and interpreted according to the suppliers protocol as detailed in the online supplementary data (E1).
The TST results, as defined by cut-off values of To facilitate the interpretation of comparison results, a simple deterministic model using conditional probabilities (supplementary data, E2) was employed to calculate the sensitivity, specificity, positive likelihood ratio, negative likelihood ratio 12, positive predictive value (PPV) and negative predictive value (NPV) of the T-Spot.TB test and TST as applied to the study cohort as follows. 1) Assuming the existing surrogate measures of sensitivity and specificity are valid, the following parameters for T-Spot.TB test (as based on a recently published meta-analysis 8) were input into the model. Sensitivity (for adult population): 92% (95% confidence interval (CI) 88–95%); specificity: 92.5% (95% CI 86–99%). 2) The positive and negative likelihood ratios of T-Spot.TB were calculated directly from the assumed sensitivity and specificity as previously described 12. 3) The PPV and NPV of T-Spot.TB were calculated through the given assumptions of sensitivity and specificity and the distribution of positive and negative results among the test cohort by solving a set of simultaneous equations (supplementary data, E2). 4) The derived PPV and NPV of T-Spot.TB were then used as conditional probabilities for a true-positive or a true-negative for a positive and negative T-Spot.TB test, respectively, for the calculation of the sensitivity, specificity, positive likelihood ratio, negative likelihood ratio, PPV and NPV of the TST through a two-by-two table of these two tests. 5) The calculations were then repeated for sensitivity analysis, using upper and lower 95% confidence limits of the current estimates of T-Spot.TB sensitivity and specificity. The positive likelihood ratio reflects the relative likelihood of LTBI among test-positive subjects versus test-negative subjects 12. In the presence of a low proportion (20–24%) of TB cases, due to recent transmission in the local population 13, 14, it should indirectly reflect the relative risk of developing active TB for test-positive and test-negative subjects. Prospective data comparing the relative risk of active TB in test-positive with that in test-negative subjects are still pending for the new IFN-release assays 8. For the TST, a study involving a prospective follow-up of a cohort of 435 tuberculin-tested silicotic patients in the same location was recently published; details of the cohort have previously been described 6. Largely because of patient refusal, a significant proportion of tuberculin-positive subjects were not treated for LTBI, thus allowing comparison of TB risk between tuberculin-negative and untreated tuberculin-positive subjects during an average follow-up of 5 yrs. After re-categorisation of active TB cases found in that cohort by baseline tuberculin and treatment status, the relative TB risks between different groups were compiled and compared with the predictions of the above model.
Statistical analysis Approval for the study was obtained from the Ethics Committee of the Dept of Health of Hong Kong SAR. The T-Spot.TB test kits were supplied at a reduced price by Oxford Immunotec Ltd.
From December 1, 2004 to January 31, 2007, 134 patients underwent both T-Spot.TB test and TST with an uptake rate of 50% among patients offered the tests during the course of clinic attendance. Only six (4.3%) subjects showed an indeterminate T-Spot.TB test because of low cell counts after separation of the mononuclear cells. Repeat blood testing yielded a determinate result. There were no significant differences in age, presence of comorbidity and final result between those requiring and not requiring a repeat test (two tailed exact test, all p>0.05). The subjects background characteristics, as stratified by age (<65 versus 65 yrs), are summarised in table 1 10 mm and a positive T-Spot.TB test (68.7 versus 64.2%; McNemar test, p = 0.391). A higher proportion of subjects aged <65 yrs had a positive tuberculin reaction ( 10 mm) as compared with those aged 65 yrs (p = 0.01), but no significant association was observed between T-Spot.TB test status and age (table 1
Table 2 10 mm (81.3 versus 64.7%; p = 0.078) and a positive T-Spot.TB test (78.1 versus 59.3%; p = 0.059), but the differences just failed to reach statistical significance. On multiple logistic regression analysis using predictor variables associated with test outcomes (p<0.20) in univariate analysis (table 2 65 yrs remained an independent predictor of a negative tuberculin reaction <10 mm (odds ratio (OR) 3, 95% CI 1.38–6.55; p = 0.006), but not a negative T-Spot.TB response (OR 1.57, 95% CI 0.74–3.55; p = 0.636), while current smoking did not significantly predict a positive tuberculin response 10 mm (OR 2.10, 95% CI 0.77–5.82; p = 0.146) or a positive T-Spot.TB test (OR 2.27, 95% CI 0.89–5.78; p = 0.085).
The median (interquartile range) tuberculin reaction sizes were 0 (0.0–6.3) mm and 16 (14–20) mm for subjects with a tuberculin reaction size <10 and 10 mm, respectively. Of the 86 subjects with a positive T-Spot.TB test, 29 (33.7%) had a net spot count (peptides well count–control well count) of six or more for the early secretary antigenic target (ESAT)6 peptides well alone, 18 (20.9%) for the culture filtrate protein (CFP)10 peptides well alone, and 39 (45.3%) for both. The median (interquartile range) net spot counts for the ESAT6 peptides well and CFP10 peptides well were 16.5 (6.0–32.0) and 10.5 (2.8–52.0), respectively (Wilcoxon signed ranks test, p = 0.830). Higher tuberculin reaction sizes (median 15.0 versus 10.0 mm; Mann-Whitney U-test, p = 0.001), but not net ESAT6 well spot counts (median 6.0 versus 4.0; Mann-Whitney U-test, p = 0.920) or CFP10 well spot counts (median 3.0 versus 2.0; Mann-Whitney U-test, p = 0.300), were observed among subjects aged <65 yrs in comparison to those aged 65 yrs. Higher tuberculin reaction sizes (median 16.0 versus 12.5 mm; Mann-Whitney U-test, p = 0.016) and net ESAT6 well spot counts (median 15.5 versus 4.0; Mann-Whitney U-test, p = 0.013), but not CFP10 well spot counts (median 4.0 versus 3.0; Mann-Whitney U-test, p = 0.243), were observed among current smokers in comparison to among never- or ex-smokers. Table 3
Table 4 65 yrs, current smokers, and never- and ex-smokers), the kappa measurement for agreement between T-Spot.TB and the TST was at a maximum with a cut-off reaction size of 10 mm for the TST. For all cut-offs, the kappa measurements of agreement between TST and T-Spot.TB test were similar but greater for subjects aged <65 yrs than those aged 65 yrs. Much lower kappa measurements were observed for current smokers in contrast with those for never- and ex-smokers.
Table 5
From a separate historical cohort of 435 silicotic patients who were tuberculin tested between August 1, 1995 and December 31, 2002 5, 17 (14.4%) out of 118 patients with a TST <10 mm, 45 (20.8%) out of 216 untreated patients with a TST 10 mm, and 11 (10.9%) out of 101 patients with a TST 10 mm and treated for LTBI (either 6 months of isoniazid or 2 months of rifampicin and pyrazinamide at a treatment completion rate of 70%) developed active TB after 5.2±2.3 yrs of follow-up until the end of 2005. The corresponding TB incidence rates were 2,596 (tuberculin-negative subjects), 3,778 (untreated tuberculin-positive subjects) and 2,582 (treated tuberculin-positive subjects) per 100,000 person-yrs, respectively. The TB incidence ratios were observed to be 0.69 (2,596 out of 3,778) between tuberculin-negative and untreated tuberculin-positive subjects, and 0.68 (2,582 out of 3,778) between treated and untreated tuberculin-positive subjects. The relatively low risk differential between tuberculin-negative and untreated tuberculin-positive subjects was generally in line with the low positive likelihood ratios of TST as estimated from the conditional probability model (table 5
In the present study, moderate agreement was found between T-Spot.TB and the TST using 10 mm as a cut-off point among a high-risk cohort of silicotic subjects in Hong Kong (table 4
A lower sensitivity of TST among elderly subjects is well reported in previous studies 4, 5, 15. In the current study, the lower percentage of tuberculin-positive subjects among those aged
The association between smoking and a positive tuberculin reaction is also well reported in the literature 6, 16, 17. However, in contrast to the effect of age, it is usually assumed to indicate a higher LTBI prevalence, likely to be as a result of increased exposure. In the present study, significantly higher tuberculin reaction sizes and net ESAT6 well counts were observed among current smokers, in contrast with never- and ex-smokers. It is noteworthy that the association of smoking and tuberculin-positivity, as observed in the present and an earlier silicotic cohort 6, was seen predominantly among current smokers, with ex-smokers at a much lower risk. The total number of cigarette pack-yrs did not increase the risk of a positive response (table 2
The agreement between T-Spot.TB and TST was at a maximum using a cut-off of 10 mm (table 4
As shown in table 5
Silicotic patients in high TB prevalence areas are a well-known high-risk group for targeted screening of LTBI. Although the study was based on a convenient sample of silicotic patients attending a compensation assessment centre, this is the usual clinical setting where such targeted screening is offered. The absence of a gold standard remains a major problem in the comparison of diagnostic tests for LTBI. Similar to other studies 7–11, 21–24, no direct information was provided as to how well the new IFN- Notwithstanding all the potential limitations, the present study highlighted potentially major differences in performance between the T-Spot.TB test and the tuberculin skin test among silicotic patients in a high tuberculosis prevalence setting. Further studies are needed to identify an optimal strategy for targeted screening of latent tuberculosis infection in such situations.
This work is supported by research grants from the Pneumoconiosis Compensation Fund Board and from the University of Hong Kong UDF Project-Research Centre of Emerging Infection Diseases (both Hong Kong, China).
None declared.
This manuscript has supplementary data which is accessible from www.erj.ersjournals.com
This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||