Improvement in the predictive ability of the Intermountain Mortality Risk Score by adding routinely collected laboratory tests such as albumin, bilirubin, and white cell differential count
-
Heidi T. May
, Jeffrey L. Anderson
Abstract
Background:
The Intermountain Mortality Risk Score (IMRS), a sex-specific mortality-prediction metric, has proven to be effective in various populations. IMRS is comprised of the complete blood count (CBC), basic metabolic panel (BMP), and age. Whether the addition of factors from the comprehensive metabolic panel (CMP) and white blood cell (WBC) differential count improves risk stratification is unknown.
Methods:
Patients with baseline complete metabolic panel (CMP) and IMRS measurements were randomly assigned (60%/40%) to independent derivation (n=84,913) and validation (n=56,584) populations. A sex-specific risk score based on IMRS methods was computed in the derivation population using adjusted multivariable regression weights from all significant and noncollinear CMP [expanded IMRS (eIMRS)] and, when available, WBC differential components (eIMRS+diff).
Results:
Age averaged 67±16 years for females and 67±15 years for males. Receiver operator characteristic (ROC) c-statistics for 30-day death showed marked improvement for the eIMRS compared to the IMRS in both females [0.895 (0.882, 0.908) vs. 0.865 (0.850, 0.880)] and males [0.861 (0.847, 0.876) vs. 0.824 (0.807, 0.841)]. These results persisted for 1-year death: females [0.854 (0.847, 0.862) vs. 0.828 (0.819, 0.836)] and males [0.835 (0.826, 0.844) vs. 0.796 (0.789, 0.808)]. In addition, the eIMRS significantly improved risk reclassification. Further precision was seen when WBC differential components were included.
Conclusions:
The addition of the CMP components to the IMRS improved risk prediction. WBC differential also improved risk score predictive ability. These results suggest that the eIMRS may function even better than IMRS as a tool in patient care, risk-adjustment, and clinical research settings for predicting outcomes.
Author contributions: All the authors have accepted responsibility for the entire content of this submitted manuscript and approved submission.
Research funding: None declared.
Employment or leadership: Ms. Ronnow and Drs. May, Horne, and Anderson have a risk score licensing contract for the Intermountain Risk Score with Scriplogix, Inc.
Honorarium: None declared.
Competing interests: The funding organization(s) played no role in the study design; in the collection, analysis, and interpretation of data; in the writing of the report; or in the decision to submit the report for publication.
References
1. Ringquist I, Fisher LD, Mock M, Davis KB, Wedel H, Chaitman BR, et al. Prognostic value of angiographic indices of coronary artery disease from the Coronary Artery Surgery Study (CASS). J Clin Invest 1983;71:1854–66.10.1172/JCI110941Search in Google Scholar
2. Liao L, Kong DF, Shaw LK, Sketch MH Jr, Milano CA, Lee KL, et al. A new anatomic score for prognosis after cardiac catheterization in patients with previous bypass surgery. J Am Coll Cardiol 2005;46:1684–92.10.1016/j.jacc.2005.06.074Search in Google Scholar
3. Ananthakrishnan AN, McGinley EL, Binion DG, Saeian K. A novel risk score to stratify severity of Crohn’s disease hospitalizations. Am J Gastroenterol 2010;105:1799–807.10.1038/ajg.2010.105Search in Google Scholar
4. Sianos G, Morel MA, Kappetein AP, Morice MC, Colombo A, Dawkins K, et al. The SYNTAX Score: an angiographic tool grading the complexity of coronary artery disease. EuroInterv 2005;1:219–27.Search in Google Scholar
5. Zimmerman JE, Kramer AA, McNair DS, Malila FM. Acute physiology and chronic health evaluation (APACHE) IV: hospital mortality assessment for today’s critically ill patients. Crit Care Med 2006;34:1297–310.10.1097/01.CCM.0000215112.84523.F0Search in Google Scholar
6. Edwards FH, Grover FL, Shroyer AL, Schwartz M, Bero J. The Society of Thoracic Surgeons national cardiac surgery database: current risk assessment. Ann Thorac Surg 1997;63:903–8.10.1016/S0003-4975(97)00017-9Search in Google Scholar
7. Rothwell PM, Giles MF, Flossmann E, Lovelock CE, Redgrave JN, Warlow CP, et al. A simple score (ABCD) to identify individuals at high early risk of stroke after transient ischaemic attack. Lancet 2005;366:29–36.10.1016/S0140-6736(05)66702-5Search in Google Scholar
8. Palmerini T, Genereux P, Caixeta A, Cristea E, Lansky A, Mehran R, et al. A new score for risk stratification of patients with acute coronary syndromes undergoing percutaneous coronary intervention. The ACUITY-PCI (Acute Catheterization and Urgent Intervention Triage Strategy-Percutaneous Coronary Intervention) Risk Score. J Am Coll Cardiol Interv 2012;5:1108–16.10.1016/j.jcin.2012.07.011Search in Google Scholar PubMed
9. Fine MJ, Auble TE, Yealy DM, Hanusa BH, Weissfeld LA, Singer DE, et al. A prediction rule to identify low-risk patients with community-acquired pneumonia. N Engl J Med 1997;336:243–50.10.1056/NEJM199701233360402Search in Google Scholar PubMed
10. Wilson PW, D’Agostino RB, Levy D, Belanger AM, Silbershatz H, Kannel WB. Prediction of coronary heart disease using risk factor categories. Circulation 1998;97:1837–47.10.1161/01.CIR.97.18.1837Search in Google Scholar
11. Lip GY, Nieuwlaat R, Pisters R, Lane DA, Crijns HJ. Refining clinical risk stratification for predicting stroke and thromboembolism in atrial fibrillation using a novel risk factor-based approach. Chest 2010;137:263–72.10.1378/chest.09-1584Search in Google Scholar PubMed
12. Malinchoc M, Kamath PS, Gordon FD, Peine CJ, Rank J, ter Borg PC. A model to predict poor survival in patients undergoing transjugular intrahepatic portosystemic shunts. Hepatology 2000;31:864–71.10.1053/he.2000.5852Search in Google Scholar PubMed
13. Halkin A, Singh M, Nikolsky E, Grines CL, Tcheng JE, Garcia E, et al. Prediction of mortality after primary percutaneous coronary intervention for acute myocardial infaction: the CADILLAC Risk Score. J Am Coll Cardiol 2005;45:1397–405.10.1016/j.jacc.2005.01.041Search in Google Scholar PubMed
14. Morrow DA, Antman EM, Charlesworth A, Cairns R, Murphy SA, Lemos JA de, et al. TIMI risk score for ST-elevation myocardial infarction: a convenient, bedside, clinical score for risk assessment at presentation an intravenous nPA for treatment of infracting myocardium early II trial substudy. Circulation 2000;102:2031–7.10.1161/01.CIR.102.17.2031Search in Google Scholar PubMed
15. Granger CB, Goldberg RJ, Dabbous O, Pieper KS, Eagle KA, Cannon CP, et al. Predictors of hospital mortality in the global registry of acute coronary events. Arch Intern Med 2003;163:2345–53.10.1001/archinte.163.19.2345Search in Google Scholar PubMed
16. Horne BD, May HT, Muhlestein JB, Ronnow BS, Lappé DL, Renlund DG, et al. Exceptional predictive ability for all-cause mortality of risk scores arising from ubiquitous clinical laboratory tests. Am J Med 2009;122:550–8.10.1016/j.amjmed.2008.10.043Search in Google Scholar PubMed
17. Horne BD, Muhlestein JB, Lappé DL, Brunisholz KD, May HT, Kfoury AG, et al. The Intermountain Risk Score predicts incremental age-specific long-term survival and life expectancy. Transl Res 2011;158:307–14.10.1016/j.trsl.2011.06.004Search in Google Scholar PubMed
18. Horne BD, Lappé DL, Muhlestein JB, May HT, Ronnow BS, Brunisholz KD, et al. Repeated measurement of the Intermountain Risk Score enhances prognostication for mortality. PLoS One 2013;8:e69160.10.1371/journal.pone.0069160Search in Google Scholar PubMed PubMed Central
19. Horne BD, Anderson JL, Muhlestein JB, Ridker PM, Paynter NP. The complete blood count risk score and its components including the RDW are associated with mortality in the JUPITER Trial. Eur J Prev Cardiol 2015;22:519–26.10.1177/2047487313519347Search in Google Scholar PubMed
20. Horne BD, May HT, Kfoury AG, Renlund DG, Muhlestein JB, Lappé DL, et al. The Intermountain Risk Score (including the red cell distribution width) predicts heart failure and other morbidity endpoints. Eur J Heart Fail 2010;12:1203–13.10.1093/eurjhf/hfq115Search in Google Scholar PubMed
21. Lappé JM, Horne BD, Shah SH, May HT, Muhlestein JB, Lappé DL, et al. Red cell distribution width, C-reactive protein, the complete blood count, and mortality in patients with coronary disease and a normal comparison population. Clin Chim Acta 2011;412:2094–9.10.1016/j.cca.2011.07.018Search in Google Scholar PubMed
22. Johnson EG, Anderson JL, Lappé DL, Muhlestein JB, May HT, Bair TL, et al. The Intermountain Risk Score predicts mortality and cardiovascular events among coronary disease patients treated by percutaneous or medical interventions. Circulation 2012;126(21 suppl):A13381.Search in Google Scholar
23. Johnson EG, Lappé DL, Anderson JL, Muhlestein JB, May HT, Bair TL, et al. Patient mortality following coronary bypass surgery is strongly predicted by the Intermountain Risk Score. J Am Coll Cardiol 2013;61(suppl A):A397.10.1016/S0735-1097(13)61606-XSearch in Google Scholar
24. Brunisholz KD, Kfoury AG, Gilbert EM, Alharethi R, Anderson JL, Stehlik J, et al. The Intermountain Risk Score predicts post-transplant survival when calculated from pre-transplant clinical laboratory values. J Heart Lung Transplant 2011;30:S47–8.10.1016/j.healun.2011.01.128Search in Google Scholar
25. Mannem SR, Horne BD, Saeed O, Kfoury AG, Gunda S, Salamon J, et al. The red cell distribution width and the CBC Risk Score measured prior to left ventricular assist device implantation predict post-implant survival. J Am Coll Cardiol 2014;63(12_S):A220.10.1016/S0735-1097(14)60899-8Search in Google Scholar
26. Brunisholz KD, Kfoury AG, Alharethi R, Budge D, Rasmusson KD, James B, et al. The Intermountain Risk Score stratifies mortality risk in heart failure patients receiving an internal cardiovertor defibrillator based on pre-implant laboratory values. J Card Fail 2011;17(suppl):S74.10.1016/j.cardfail.2011.06.248Search in Google Scholar
27. Majercik S, Knight S, Horne BD. The Intermountain risk score predicts mortality in trauma patients. J Crit Care 2014;29:882.e1–4.10.1016/j.jcrc.2014.03.016Search in Google Scholar PubMed
28. Horne BD, Hegewald M, Muhlestein JB, Huggins E, May HT, Bair TL, et al. Pulmonary-specific Intermountain Risk Score: derivation and validation of risk scores for mortality among patients undergoing pulmonary function testing. Chest 2012;142(4, meeting abstracts):785A.10.1378/chest.1390727Search in Google Scholar
29. Horne BD, Anderson JL, John JM, Weaver A, Bair TL, Jensen KR, et al. Which white blood cell subtypes predict increased cardiovascular risk? J Am Coll Cardiol 2005;45:1638–43.10.1016/j.jacc.2005.02.054Search in Google Scholar PubMed
30. Pencina MJ, D’Agostino Sr RB, D’Agostino Jr RB, Vasan RS. Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat Med 2008;27:157–72.10.1002/sim.2929Search in Google Scholar PubMed
31. Pencina JM, D’Agostino RB Sr, Steyerberg E. Extension of net reclassification improvement calculations to measure usefulness of new biomarkers. Stat Med 2011;30:11–21.10.1002/sim.4085Search in Google Scholar PubMed PubMed Central
32. Pencina MJ, D’Agostino RB, Vasan RS. Statistical methods for assessment of added usefulness of new biomarkers. Clin Chem Lab Med 2010;48:1703–11.10.1515/CCLM.2010.340Search in Google Scholar PubMed PubMed Central
33. Leening MJ, Vedder MM, Witteman JC, Pencina MJ, Steyerberg EW. Net reclassification improvement: computation, interpretation, and controversies. Ann Intern Med 2014;160:122–31.10.7326/M13-1522Search in Google Scholar PubMed
34. Annesi I, Moreasu T, Lellouch J. Efficiency of the logistic regression and Cox proportional hazards models in longitudinal studies. Stat Med 1989;8:1515–21.10.1002/sim.4780081211Search in Google Scholar PubMed
35. D’Agostino RB, Lee ML, Belanger AJ. Relation of pooled logistic regression to time dependent Cox regression analysis: the Framingham Heart Study. Stat Med 1990;9:1501–15.10.1002/sim.4780091214Search in Google Scholar PubMed
Supplemental Material:
The online version of this article (DOI: 10.1515/cclm-2015-1258) offers supplementary material, available to authorized users.
©2016 Walter de Gruyter GmbH, Berlin/Boston
Articles in the same Issue
- Frontmatter
- Editorial
- Serum myoglobin immunoassays: obsolete or still clinically useful?
- Reviews
- Kounis syndrome: an update on epidemiology, pathogenesis, diagnosis and therapeutic management
- What do we know about homocysteine and exercise? A review from the literature
- Mini Review
- Osteocalcin as a potential risk biomarker for cardiovascular and metabolic diseases
- Opinion Paper
- Statistical approach for optimization of external quality assurance (EQA) studies of molecular and serological viral diagnostics
- EFLM Article
- Sample collections from healthy volunteers for biological variation estimates’ update: a new project undertaken by the Working Group on Biological Variation established by the European Federation of Clinical Chemistry and Laboratory Medicine
- General Clinical Chemistry and Laboratory Medicine
- Analyte stability during the total testing process: studies of vitamins A, D and E by LC-MS/MS
- Improvement in the predictive ability of the Intermountain Mortality Risk Score by adding routinely collected laboratory tests such as albumin, bilirubin, and white cell differential count
- Cystatin C provides a better estimate of the effect of glomerular filtration rate on serum human epididymis protein 4 concentrations
- Verification of the harmonization of human epididymis protein 4 assays
- Clinical utility of urinary liver-type fatty acid binding protein measured by latex-enhanced turbidimetric immunoassay in chronic kidney disease
- Comparison of three analytical platforms for quantification of the neurofilament light chain in blood samples: ELISA, electrochemiluminescence immunoassay and Simoa
- Reference Values and Biological Variations
- Distribution of antiphospholipid antibodies in a large population-based German cohort
- Cardiovascular Diseases
- Serum protein S100 as marker of postoperative delirium after off-pump coronary artery bypass surgery: secondary analysis of two prospective randomized controlled trials
- Infectious Diseases
- Copeptin predicts 10-year all-cause mortality in community patients: a 10-year prospective cohort study
- Clinical and laboratory findings in the diagnosis of right lower quadrant abdominal pain: outcome analysis of the APPAC trial
- Letters to the Editor
- Why a new algorithm using high-sensitivity cardiac troponins for the rapid rule-out of NSTEMI is not adapted to routine practice
- Optimal collection tubes for plasma glucose determination: confusion reigns supreme
- Long-term stability of serum samples positive for carbohydrate deficient transferrin (CDT) routinely stored at −20 °C
- Seasonal variations in plasma free metanephrine concentrations are not evident in the West of Ireland
- Potential errors in the determination of urinary ammonium by formol titration
- Interference by biological anti-cancer drugs in electrophoretic and immunofixation techniques
- A point mutation in the thiopurine S-methyltransferase gene that led to exon 5 deletion in the transcribed mRNA
- Detection of the heterozygote of hemoglobin Constant Spring by α-thalassemia immunochromatographic strip test
- Automated CH50 liposome-based immunoassay: consideration in dilution and validation of reference interval
- Theranos phenomenon – Part 5: Theranos’ presentation at the American Association for Clinical Chemistry Annual Conference 2016
- Congress Abstracts
- 58th National Congress of the Hungarian Society of Laboratory Medicine
- The 4th Joint EFLM-UEMS Congress “Laboratory Medicine at the Clinical Interface” Warsaw, Poland, 21th–24th September, 2016
- Congress of Clinical Chemistry and Laboratory Medicine
Articles in the same Issue
- Frontmatter
- Editorial
- Serum myoglobin immunoassays: obsolete or still clinically useful?
- Reviews
- Kounis syndrome: an update on epidemiology, pathogenesis, diagnosis and therapeutic management
- What do we know about homocysteine and exercise? A review from the literature
- Mini Review
- Osteocalcin as a potential risk biomarker for cardiovascular and metabolic diseases
- Opinion Paper
- Statistical approach for optimization of external quality assurance (EQA) studies of molecular and serological viral diagnostics
- EFLM Article
- Sample collections from healthy volunteers for biological variation estimates’ update: a new project undertaken by the Working Group on Biological Variation established by the European Federation of Clinical Chemistry and Laboratory Medicine
- General Clinical Chemistry and Laboratory Medicine
- Analyte stability during the total testing process: studies of vitamins A, D and E by LC-MS/MS
- Improvement in the predictive ability of the Intermountain Mortality Risk Score by adding routinely collected laboratory tests such as albumin, bilirubin, and white cell differential count
- Cystatin C provides a better estimate of the effect of glomerular filtration rate on serum human epididymis protein 4 concentrations
- Verification of the harmonization of human epididymis protein 4 assays
- Clinical utility of urinary liver-type fatty acid binding protein measured by latex-enhanced turbidimetric immunoassay in chronic kidney disease
- Comparison of three analytical platforms for quantification of the neurofilament light chain in blood samples: ELISA, electrochemiluminescence immunoassay and Simoa
- Reference Values and Biological Variations
- Distribution of antiphospholipid antibodies in a large population-based German cohort
- Cardiovascular Diseases
- Serum protein S100 as marker of postoperative delirium after off-pump coronary artery bypass surgery: secondary analysis of two prospective randomized controlled trials
- Infectious Diseases
- Copeptin predicts 10-year all-cause mortality in community patients: a 10-year prospective cohort study
- Clinical and laboratory findings in the diagnosis of right lower quadrant abdominal pain: outcome analysis of the APPAC trial
- Letters to the Editor
- Why a new algorithm using high-sensitivity cardiac troponins for the rapid rule-out of NSTEMI is not adapted to routine practice
- Optimal collection tubes for plasma glucose determination: confusion reigns supreme
- Long-term stability of serum samples positive for carbohydrate deficient transferrin (CDT) routinely stored at −20 °C
- Seasonal variations in plasma free metanephrine concentrations are not evident in the West of Ireland
- Potential errors in the determination of urinary ammonium by formol titration
- Interference by biological anti-cancer drugs in electrophoretic and immunofixation techniques
- A point mutation in the thiopurine S-methyltransferase gene that led to exon 5 deletion in the transcribed mRNA
- Detection of the heterozygote of hemoglobin Constant Spring by α-thalassemia immunochromatographic strip test
- Automated CH50 liposome-based immunoassay: consideration in dilution and validation of reference interval
- Theranos phenomenon – Part 5: Theranos’ presentation at the American Association for Clinical Chemistry Annual Conference 2016
- Congress Abstracts
- 58th National Congress of the Hungarian Society of Laboratory Medicine
- The 4th Joint EFLM-UEMS Congress “Laboratory Medicine at the Clinical Interface” Warsaw, Poland, 21th–24th September, 2016
- Congress of Clinical Chemistry and Laboratory Medicine