A new lung donor score to predict short and long-term survival in lung transplantation
Introduction
Organ shortage and a growing demand for lung transplantations force several centers to increasingly use extended donor lungs. In 2003 the International Society for Heart and Lung Transplantation (ISHLT) released a consensus report (1) defining an ideal donor lung based on 5 variables: age <55, smoking history <20 pack years, uncompromised chest X-ray, clear bronchoscopy and pulmonary arterial oxygen tension/fraction of inspired oxygen-ratio >300 mmHg.
In the meantime, several attempts were made to further specify and identify potential extended criteria. In 2007 Oto et al. (2) at the University of Melbourne suggested a score based on the ISHLT-criteria to predict donor selection and early post-lung-transplant outcome. In 2011 the Oto-Score was modified by the European allocation organization Eurotransplant (3) to a new score serving the same purpose. In 2016 the University of Minnesota (4) created a new, complex, consensus-based lung scoring system to predict lung offer acceptance and usability for transplantation. However, the University of Maryland (5) identified donor risk factors based on United Network for Organ Sharing (UNOS) data and created a single point score that was associated with one-year survival, based on just four simple risk factors. Lately, the University of Louisville (6) identified almost identical four risk factors in the same data base and showed an association with 1 and 5-year survival.
To date, only the Oto-Donor-Score has been externally validated with inconsistent results (4,7). Except for the Louisville-UNOS donor score, nothing is known about the utility of any of these scores to predict long-term survival.
The goal of the current study was first, to validate the short- and long-term predictive ability of five published scores based on our centers transplant pool and second, to develop a new and simple donor score for survival that includes donor parameters prior to procurement. We present the following article in accordance with the TRIPOD reporting checklist (available at http://dx.doi.org/10.21037/jtd-20-2043).
Methods
We performed a retrospective study of all adult recipients and their corresponding donors transplanted at the University Hospital of Zurich between 11/1992 and 12/2015, with last follow-up in 10/2019. Donor and recipient data were collected retrospectively from prospectively entered medical records. For donor variables, the values at the time of donor acceptance, prior to procurement were used. Infection suspected on radiological findings in the contralateral lung were ignored in cases where only unilateral transplants were performed. The collected donor variables were compared to findings in the donor report at the time of procurement. The study has been approved by the Cantonal Ethics Committee Zurich (KEK-ZH-Nr.2013-0624), and the need to obtain informed consent was waived because of the retrospective observational nature of the study. This study was conducted in accordance with the Declaration of Helsinki (as revised in 2013).
Outcomes
The primary outcome was survival after lung transplantation. Secondary outcomes were primary graft dysfunction grade 3 (PGD3) (8), defined as PaO2/FiO2-ratio <200 mmHg and the presence of diffuse parenchymal infiltrates in the allograft on chest radiograph at 72 hours after transplantation (binary outcome); as well as severe bronchiolitis obliterans syndrome grade III (BOS-III) (9), defined as a persistent decline of forced expiratory volume in 1 second (FEV1) ≤50% and an obstructive physiology (time-to-event).
Definition of predictor variables
Variables of the existing donor scores
The variables of the five existing donor scores are shown in Tables S1-S5. Oto-Score (2) consists of 5 subdivided donor criteria based on the ISHLT-Consensus Report (1). Eurotransplant-Score (3) is a simplified version of Oto-Score with the addition of a compromised history. The University of Minnesota-Donor-Lung quality index (4) includes 17 subdivided factors of which one factor represents the recipient specific American Lung Allocation Score (LAS). As LAS is not used in Switzerland, we excluded LAS for this score but adjusted for recipient and surgical procedure variables subsequently. To make the results of the evaluation of the Minnesota score comparable to the results of the other scores, the scale was reversed such that higher values are associated with higher risk for mortality. University of Maryland-UNOS-data donor score (5) and Louisville-UNOS-data score (6) are very simple scores based on the same 4 variables, except that the later uses different breaks for age.
Development of the Zurich-Donor-Score for prediction of mortality
A larger and preliminary set of potential risk variables was defined consisting of all variables of the five existing donor scores (Tables S1-S5) and availability. A preselection of variables was performed according to the estimated hazard ratios (HR) and P values from univariate Cox regression models with outcome survival. If the corresponding HR was ≥1.2 and P value <0.2, the predictor variable was assumed to be relevant for risk prediction (10). The final set of variables used to develop the new donor score included the following variables: significant pulmonary infection, diabetes mellitus, PaO2/FiO2-ratio, smoking history in pack years, and donor age. The three continuous variables were categorized by the study team according to multiple non-linear graphical assessment using splines and consideration of the recent literature. After categorization of the continuous variables, all variables were coded as factor variables and their association with survival was assessed in a multiple Cox model. Resulting estimated beta-coefficients were shrinked globally to account for overfitting. Shrinkage is a statistical technique used in regression analysis, to avoid overfitting (11). Subsequently, the new score’s values were assigned following the rule that estimated beta-coefficients of 0.1 to 0.2 were assigned two points, such of 0.3 three points, such of 0.4 four points, and higher beta-coefficients five points. Score points were assigned in monotonous fashion with increasing category of risk factor.
Definition of recipient- and surgical procedure variables
To consider the impact of recipient and surgical procedure variables on post-transplant survival, we adjusted our models for the following risk factors that are well known from the literature and also present in our cohort: unilateral transplantation (12), retransplantation (12), idiopathic pulmonary fibrosis as underling disease (12), preoperative intensive care unit stay (12), recipient age (12), and for the comorbidity profile the age independent Charlson-Deyo Index (13). No additional impact was observed by adjusting for up to 3 different transplant eras.
Statistical methods
Kaplan-Meier method was used to estimate survival as well as time to development of BOS-III.
To estimate short and long-term predictive accuracy for each score, time dependent receiver operating characteristic curves (ROC) were applied, accounting for the fact that censoring was present. The time points shown in figures were 1 month, and 1, 5 and 10 years after transplantation. Areas under the ROC curves (AUC) were estimated at each of the pre-specified time points. To compare models’ goodness of fit, Akaike’s information criterion (AIC) was used, with lower AIC indicating better model fit. The AIC can be interpreted in such a way that a reduction of more than 2 points in the comparison of nested models would indicate a significantly better model fit, corresponding to a likelihood-ratio test.
For the development of a new score, multiple Cox proportional hazards models were used. The number of predictors allowed to be simultaneously in the multiple Cox models was based on the number of events (deaths). The general rule of ten events per variable in the prediction model was considered (14). To address the problem of over-fitting, the estimated coefficients of the Cox model were shrinked globally, with a shrinkage factor estimated with the DFBETA method (15). In this context, global shrinkage means that the same amount of shrinkage was applied to all estimated parameters. The assessment of the shrinkage factor with the DFBETA method corresponds to leave-one-out cross-validation (LOOCV) but is computationally more efficient. This aspect is of relevance especially when the number of observations is large as in this study (16). The closer the shrinkage factor to 1, the less shrinkage is required and the less over-fitting was determined. The Cox proportional hazards (PH) assumption was evaluated with a score test based on Schoenfeld residuals. In case that the proportional hazards assumption for a variable was violated, a suitable cut-off for the variable was derived, and the proportional hazards assumption was re-evaluated.
For secondary outcomes, BOS-III was addressed with a Cox model in which non-survivors were censored, and the binary outcome PGD3 was addressed with a logistic regression model. All estimated coefficients were shown with 95% confidence intervals. All analyses were carried out with the statistical programming language R [R Core Team (2019)], version 3.6.0, and time-dependent ROC curves were fitted with the R-package “timeROC”. Shrinkage was performed with R-package “shrink”.
The results of this study were presented in accordance with the TRIPOD guidelines (17) for reporting of clinical prediction models.
Results
In our cohort, there were 454 adult recipients with lung transplantation between 1991 and 2015, and with at least 4 years follow-up. Of these, 320 recipients (70.5%) died. Median follow-up time was 14.2 years (95% confidence interval 12.4 to 16.0 years). No loss to follow-up occurred. Detailed descriptive statistics of recipient-, donor-, intra- and post-operative characteristics are shown in Table 1. More than 72% of all donors were non-ideal donors according to ISHLT consensus criteria (1) (Table 1).
Full table
Validation of the five existing donor scores in our cohort
Factors for Oto-Donor-Score (2), Eurotransplant-Score (3), Minnesota-Donor-Lung quality index (4), Maryland-UNOS-data donor score (5) and Louisville-UNOS-data donor score (6) are illustrated in Tables S1-S5, respectively.
Akaike’s information criterion revealed best model fit for predictability for Maryland-UNOS-data donor score with an AIC value of 3,414.4, followed by lower fit for Louisville-UNOS-data donor score (AIC 3,414.9), Minnesota-Donor-Lung quality index (AIC 3,417.8), Oto-Donor-Score (AIC 3,425.1) and finally the lowest fit for Eurotransplant-Score (AIC 3,426.3).
Development of the Zurich-Donor-Score
A multiple Cox model was used to evaluate the weight of significant pulmonary infection, diabetes mellitus, PAO2/FiO2-ratio (in categories with breaks at 300 and 150 mmHg), smoking history (in categories with breaks at 20 and 50 pack years), and donor age (with breaks at 50 and 70 years). The breaks in the continuous variables were justified from fitting multiple non-linear Cox models using splines (Figure 1) and by the literature. After the multiple Cox model was fitted based on the categorical variables, there was some indication for overfitting, resulting in a global estimated shrinkage factor of 0.82. The new score varied between 0 (low mortality risk) and 12 (high mortality risk) in our sample, whereas mean and median of the new score were 3.3 and 3. Details can be found in Table 2. Figure 2A and Table 3 show the results of a time-dependent ROC analysis of the new Zurich-Donor-Score as compared to the existing donor scores. The AIC value of the Zurich-Donor-Score was 3,398.9, which was lower than those of all existing donor score, indicating better model fit.
Full table
Full table
Assessing the predictive accuracy of all donor scores while adjusting for recipient and surgical procedure variables
Recipient and surgical procedure variables included unilateral transplantation, retransplantation, idiopathic pulmonary fibrosis as underling disease, preoperative intensive care unit stay, recipient age, and age independent Charlson-Deyo Index. Figure 2B showed that recipient and surgical procedure variables are crucial in order to make predictions of survival over time. After one month, donor and receiver information seem to be almost equally important, but as time passes, recipient and surgical procedure information from baseline become more important, leading to a substantially improved AUC for all scores at 10 years follow-up time. In a multiple Cox model with adjustment for recipient and surgical procedure variables, the estimated hazard ratio for the new score was 1.14 (95% CI: 1.09 to 1.19, P<0.001) per point increase.
Secondary outcomes: time to BOS-III and PGD3
Although the new donor score was originally developed for the short- and long-term prediction of mortality after lung transplantation, the score may also be evaluated for the secondary outcomes BOS-III and PGD3. BOS-III was developed by 168 (37%) of the recipients. In a multiple Cox model with adjustment for recipient and surgical procedure variables, the estimated hazard ratio for the new score was 1.14 (95% CI: 1.07 to 1.21, P<0.001) per point increase. Seventy-five percent recipients (17%) experienced PGD3. When the new score was evaluated in a multiple logistic regression model with PGD3 as outcome, again adjusting for recipient and surgical procedure variables, the estimated odds ratio was 1.13 (95% CI: 1.03 to 1.23, P=0.01).
Discussion
Our study validates five existing donor scores in terms of short- and long-term survival, which were originally developed to simplify donor selection and to predict short- to mid-term survival. In addition, we propose a new and simple scoring system that is well adapted for the current urge of extended donor use and shows higher discriminative ability for short- to long-term survival.
Our transplant center in Switzerland has long-term experience in utilizing extended criteria donor lungs (18). The recent lung acceptance rate of 46% is higher than in most other European centers and the United States, but the long-term survival results are comparable (19). More than 70% of all recipients in our study received a not ideal donor lung based on the ISHLT-consensus criteria (1), offering good conditions for validation of existing donor scores and the derivation of a new scoring system.
Qualitative summary of the existing donor scores
The relatively complex donor scoring systems of Oto (2), Eurotransplant (3) and Minnesota (4), which were originally created to predict donor selection, lead to a slightly poorer prediction of short- and long-term survival as did the simple Maryland-UNOS-data (5) and Louisville-UNOS-data score (6), which were derived to predict short-term survival and mid-term survival, respectively.
Qualitative summary of the Zurich-Donor-Score
For our new and simple extended donor prediction score, we identified and weighted five donor risk factors that are available at the time of donor selection: age (breaks at ≥50 and ≥70 years), smoking history (breaks at ≥20 and ≥50 pack years), significant pulmonary infection, insulin dependent diabetes mellitus and PaO2/FiO2-ratio (breaks at ≤300 and ≤150 mmHg).
Increasing donor age has an increasing negative impact on survival according to our findings which is comparable with the recent ISHLT-Registry Report (12). Our lower break of 50 or more years fits the start of risk of a large study using the UNOS-Database (20).
The observed increasing risk with increasing donor smoking history fits the idea of the donor scoring systems of Oto (2). The lower break of 20 or more pack years is in agreement with the ISHLT-consensus criteria (1) and a recent study using UNOS-Data (4).
Our risk factor of a significant pulmonary infection includes radiological findings suspicious of pneumonia, bronchoscopic signs of severe bronchitis and history of aspiration. These were defined as extended criteria according to ISHLT-consensus report (1). We combined and reduced these criteria, as their impact is to a certain extent controversial. Some studies have pointed out that lungs with radiological hints of pulmonary infiltrates did not affect transplant survival (21,22). Other studies showed that radiological abnormalities and additional purulent bronchoscope secretion (23) and radiological abnormalities and additional reduced gas exchange (18) did increase mortality.
Donor diabetes mellitus is a widely accepted (5,12) risk factor, even though the pathophysiology is not yet clearly known (24).
Our detected risk of a declining PaO2/FiO2-ratio form 300 mmHg downwards fits the recommendation of the ISHLT-consensus criteria (1). While a multicenter study found an impact (25), data from UNOS (26) suggest partial pressure of oxygen levels of lower than 200 mmHg do not affect graft survival. That’s why we weighted this factor proportionally low in our score.
Our final Zurich-Donor-Score showed better prediction of 1 to 10-year survival in comparison to the five existing scores.
Although this new donor score was originally developed for the short- and long-term prediction of mortality after lung transplantation, the score also showed predictability for development of BOS-III and PGD3. This may be explained to a certain extent by the incorporated risk factors of age and smoking history. Older age was identified as a risk factor for BOS-III in some studies (27,28), while it is still controversial in causing PGD3 (29,30). Any donor smoking was reported to have an association with BOS-III (27) and a negative impact on PGD3 (31). The significance of donor lung infection for PGD3 is not yet understood (32).
Limitations and strengths
This study has several limitations. It is a retrospective single-center study over more than two decades, however without an era effect in univariable and multiple analyses, even though we stratified in different models up to 3 eras. All donor variables and subsequent calculation of scores are based on pre-procurement parameters. Although we did not find any discrepancies between these values and the donor lung reports at the time of retrieval, the values might not account for exact results of the physical examination of the lung at the time of retrieval (33). We acknowledge that variables such as the interpretations of chest X-ray and bronchoscopy are to some extent subjective. As our data collection is limited, there might have been some other important donor variables, which were not found to be important, because their prevalence was low in our setting. For example, we were not able to include data from the African race, a variable which is part of the Maryland- and Louisville-UNOS-data donor score. We also acknowledge that performance of the original Minnesota-Donor-Lung quality index including LAS might have been superior to our compensative adjustment for recipient and surgical procedure variables. Our study has several strengths: we used shrinkage of estimated coefficients prior to the development of the new score, a method to reduce overfitting that would otherwise lead to low predictive performance in new data sets. Consequently, this approach of shrinkage manages to already preclude optimism of the score without the need of a separate validation cohort.
Conclusions
The proposed Zurich-Donor-Score is a simple scoring system of five objective and easily available pre-procurement donor variables. The new score shows higher discriminative ability when compared to existing donor scores regarding short- to long-term survival. This score is not yet evaluated for organ acceptance; this is currently being studied. In the reality of severe organ shortage and urge for more extended grafts, our proposed new score may be useful for clinical decision making in donor selection, allocation to specific recipient populations, comparison of data across centers, and thereby maximize the donor pool.
Acknowledgments
Funding: None.
Footnote
Reporting Checklist: The authors have completed the TRIPOD reporting checklist. Available at http://dx.doi.org/10.21037/jtd-20-2043
Data Sharing Statement: Available at http://dx.doi.org/10.21037/jtd-20-2043
Conflicts of Interest: All authors have completed the ICMJE uniform disclosure form (available at http://dx.doi.org/10.21037/jtd-20-2043). The authors have no conflicts of interest to declare.
Ethical Statement: The authors are accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. The study has been approved by the Cantonal Ethics Committee Zurich (KEK-ZH-Nr. 2013-0624), and the need to obtain informed consent was waived because of the retrospective observational nature of the study. This study was conducted in accordance with the Declaration of Helsinki (as revised in 2013).
Open Access Statement: This is an Open Access article distributed in accordance with the Creative Commons Attribution-NonCommercial-NoDerivs 4.0 International License (CC BY-NC-ND 4.0), which permits the non-commercial replication and distribution of the article with the strict proviso that no changes or edits are made and the original work is properly cited (including links to both the formal publication through the relevant DOI and the license). See: https://creativecommons.org/licenses/by-nc-nd/4.0/.
References
- Orens JB, Boehler A. A review of lung transplant donor acceptability criteria. J Heart Lung Transplant 2003;22:1183-200. [Crossref] [PubMed]
- Oto T, Levvey BJ, Whitford H, et al. Feasibility and Utility of a Lung Donor Score: Correlation With Early Post-Transplant Outcomes. Ann Thorac Surg 2007;83:257-63. [Crossref] [PubMed]
- Smits JM, van der Bij W, Van Raemdonck D, et al. Defining an extended criteria donor lung: an empirical approach based on the Eurotransplant experience. Transpl Int 2011;24:393-400. [Crossref] [PubMed]
- Loor G, Radosevich DM, Kelly RF, et al. The University of Minnesota Donor Lung Quality Index: A Consensus-Based Scoring Application Improves Donor Lung Use. Ann Thorac Surg 2016;102:1156-65. [Crossref] [PubMed]
- Mulligan MJ, Sanchez PG, Evans CF, et al. The use of extended criteria donors decreases one-year survival in high-risk lung recipients: A review of the United Network of Organ Sharing Database. J Thorac Cardiovasc Surg 2016;152:891-8.e2. [Crossref] [PubMed]
- Whited WM, Trivedi JR, van Berkel VH, et al. Objective Donor Scoring System for Lung Transplantation. Ann Thorac Surg 2019;107:425-9. [Crossref] [PubMed]
- Porro GA, Valenza F, Coppola S, et al. Use of the Oto Lung Donor Score to Analyze the 2010 Donor Pool of the Nord Italia Transplant Program. Transplant Proc 2012;44:1830-4. [Crossref] [PubMed]
- Snell GI, Yusen RD, Weill D, et al. Report of the ISHLT Working Group on Primary Lung Graft Dysfunction, part I: Definition and grading—A 2016 Consensus Group statement of the International Society for Heart and Lung Transplantation. J Heart Lung Transplant 2017;36:1097-103. [Crossref] [PubMed]
- Meyer KC, Raghu G, Verleden GM, et al. An international ISHLT/ATS/ERS clinical practice guideline: diagnosis and management of bronchiolitis obliterans syndrome. Eur Respir J 2014;44:1479-503. [Crossref] [PubMed]
- Sauerbrei W. The use of resampling methods to simplify regression models in medical statistics. J R Stat Soc Ser C Appl Stat 1999;48:313-29. [Crossref]
- Dunkler D, Sauerbrei W, Heinze G. Global, Parameterwise and Joint Shrinkage Factor Estimation. J Stat Softw 2016;69:19. [Crossref]
- Chambers DC, Cherikh WS, Harhay MO, et al. The International Thoracic Organ Transplant Registry of the International Society for Heart and Lung Transplantation: Thirty-sixth adult lung and heart-lung transplantation Report-2019; Focus theme: Donor and recipient size match. J Heart Lung Transplant 2019;38:1042-55. [Crossref] [PubMed]
- Deyo RA, Cherkin DC, Ciol MA. Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases. J Clin Epidemiol 1992;45:613-9. [Crossref] [PubMed]
- Ogundimu EO, Altman DG, Collins GS. Adequate sample size for developing prediction models is not simply related to events per variable. J Clin Epidemiol 2016;76:175-82. [Crossref] [PubMed]
- Verweij PJ, Van Houwelingen HC. Cross-validation in survival analysis. Stat Med 1993;12:2305-14. [Crossref] [PubMed]
- Dunkler D, Sauerbrei W, Heinze G. Global, parameterwise and joint shrinkage factor estimation. J Stat Softw 2016;96:1-19. [Crossref]
- Collins GS, Reitsma JB, Altman DG, et al. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. BMJ 2015;350:g7594. [Crossref] [PubMed]
- Lardinois D, Banysch M, Korom S, et al. Extended donor lungs: eleven years experience in a consecutive series. Eur J Cardiothorac Surg 2005;27:762-7. [Crossref] [PubMed]
- International figures on donation and transplantation 2014 [database on the Internet]2014. Available online: https://www.edqm.eu/sites/default/files/newsletter_transplant_2015.pdf. Accessed: Mai 1, 2020
- Grimm JC, Valero V 3rd, Magruder JT, et al. A novel risk score that incorporates recipient and donor variables to predict 1-year mortality in the current era of lung transplantation. J Heart Lung Transplant 2015;34:1449-54. [Crossref] [PubMed]
- Sundaresan S, Semenkovich J, Ochoa L, et al. Successful outcome of lung transplantation is not compromised by the use of marginal donor lungs. J Thorac Cardiovasc Surg 1995;109:1075-9. [Crossref] [PubMed]
- Bhorade SM, Vigneswaran W, McCabe MA, et al. Liberalization of donor criteria may expand the donor pool without adverse consequence in lung transplantation. J Heart Lung Transplant 2000;19:1199-204. [Crossref] [PubMed]
- Pierre AF, Sekine Y, Hutcheon MA, et al. Marginal donor lungs: a reassessment. J Thorac Cardiovasc Surg 2002;123:421-7; discussion 427-8. [Crossref] [PubMed]
- Reyes KG, Mason DP, Thuita L, et al. Guidelines for donor lung selection: time for revision? Ann Thorac Surg 2010;89:1756-64; discussion 1764-5. [Crossref] [PubMed]
- Thabut G, Mal H, Cerrina J, et al. Influence of donor characteristics on outcome after lung transplantation: a multicenter study. J Heart Lung Transplant 2005;24:1347-53. [Crossref] [PubMed]
- Zafar F, Khan MS, Heinle JS, et al. Does donor arterial partial pressure of oxygen affect outcomes after lung transplantation? A review of more than 12,000 lung transplants. J Thorac Cardiovasc Surg 2012;143:919-25. [Crossref] [PubMed]
- De Perrot M, Waddell TK, Shargall Y, et al. Impact of donors aged 60 years or more on outcome after lung transplantation: results of an 11-year single-center experience. J Thorac Cardiovasc Surg 2007;133:525-31. [Crossref] [PubMed]
- Hennessy SA, Hranjec T, Swenson BR, et al. Donor factors are associated with bronchiolitis obliterans syndrome after lung transplantation. Ann Thorac Surg 2010;89:1555-62. [Crossref] [PubMed]
- Liu Y, Liu Y, Su L, et al. Recipient-related clinical risk factors for primary graft dysfunction after lung transplantation: a systematic review and meta-analysis. PLoS One 2014;9:e92773. [Crossref] [PubMed]
- Baldwin MR, Peterson ER, Easthausen I, et al. Donor age and early graft failure after lung transplantation: a cohort study. Am J Transplant 2013;13:2685-95. [Crossref] [PubMed]
- Diamond JM, Lee JC, Kawut SM, et al. Clinical risk factors for primary graft dysfunction after lung transplantation. Am J Respir Crit Care Med 2013;187:527-34. [Crossref] [PubMed]
- Morrison MI, Pither TL, Fisher AJ. Pathophysiology and classification of primary graft dysfunction after lung transplantation. J Thorac Dis 2017;9:4084-97. [Crossref] [PubMed]
- Martens A, Neyrinck A, Van Raemdonck D. Accepting donor lungs for transplant: let Lisa and Bob finish the job! Eur J Cardiothorac Surg 2016;50:832-3. [Crossref] [PubMed]