American Heart Journal
Volume 155, Issue 1 , Pages 114-120 , January 2008

Risk-adjusted sequential probability ratio test control chart methods for monitoring operator and institutional mortality rates in interventional cardiology

  • Michael E. Matheny, MD, MS, MPH

      Affiliations

    • Decision Systems Group, Department of Radiology, Brigham and Women's Hospital, MA
    • Division of General Medicine, Brigham and Women's Hospital, Boston, MA
    • Division of Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, MA
    • Corresponding Author InformationReprint requests: Michael E. Matheny, MD, MS, MPH, Division of General Internal Medicine and Public Health, Vanderbilt University, Suite 6000, Medical Center East North Tower, 1215 Twenty-first Avenue South, Nashville, TN 37232-8300.
    • ,
  • Lucila Ohno-Machado, MD, PhD

      Affiliations

    • Decision Systems Group, Department of Radiology, Brigham and Women's Hospital, MA
    • Division of Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, MA
    • ,
  • Frederic S. Resnic, MD, MS

      Affiliations

    • Decision Systems Group, Department of Radiology, Brigham and Women's Hospital, MA
    • Division of Cardiology, Brigham and Women's Hospital, Boston, MA
    • Division of Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, MA

Received 6 February 2007 ,Accepted 20 August 2007.

References 

  1. Birkmeyer JD, Siewers AE, Finlayson EV, et al. Hospital volume and surgical mortality in the United States. N Engl J Med. 2002;346:1128–1137
  2. Green J, Wintfeld N. Report cards on cardiac surgeons. Assessing New York State's approach. N Engl J Med. 1995;332:1229–1232
  3. Massachusetts Data Analysis Center . http://www.massdac.org/Last Accessed 2007/05/30
  4. Learning from Bristol: the report of the public inquiry into children's heart surgery at the Bristol Royal Infirmary 1984-1995. London, England: The Stationary Office; 2001;
  5. Ellis SG, Weintraub W, Holmes D, et al. Relation of operator volume and experience to procedural outcome of percutaneous coronary revascularization at hospitals with high interventional volumes. Circulation. 1997;95:2479–2484
  6. Vakili BA, Kaplan R, Brown DL. Volume-outcome relation for physicians and hospitals performing angioplasty for acute myocardial infarction in New York state. Circulation. 2001;104:2171–2176
  7. Hannan EL, Wu C, Walford G, et al. Volume-outcome relationships for percutaneous coronary interventions in the stent era. Circulation. 2005;112:1171–1179
  8. Shahian DM, Torchiana DF, Normand SL. Implementation of a cardiac surgery report card: lessons from the Massachusetts experience. Ann Thorac Surg. 2005;80:1146–1150
  9. Lilford R, Mohammed MA, Spiegelhalter D, et al. Use and misuse of process and outcome data in managing performance of acute medical care: avoiding institutional stigma. Lancet. 2004;363:1147–1154
  10. Poloniecki J, Sismanidis C, Bland M, et al. Retrospective cohort study of false alarm rates associated with a series of heart operations: the case for hospital mortality monitoring groups. BMJ. 2004;328:375
  11. Lawrance RA, Dorsch MF, Sapsford RJ, et al. Use of cumulative mortality data in patients with acute myocardial infarction for early detection of variation in clinical practice: observational study. BMJ. 2001;323:324–327
  12. Morton AP, Whitby M, McLaws ML, et al. The application of statistical process control charts to the detection and monitoring of hospital-acquired infections. J Qual Clin Pract. 2001;21:112–117
  13. Cook DA, Steiner SH, Cook RJ, et al. Monitoring the evolutionary process of quality: risk-adjusted charting to track outcomes in intensive care. Crit Care Med. 2003;31:1676–1682
  14. Steiner SH, Cook RJ, Farewell VT. Risk-adjusted monitoring of binary surgical outcomes. Med Decis Making. 2001;21:163–169
  15. Lovegrove J, Valencia O, Treasure T, et al. Monitoring the results of cardiac surgery by variable life-adjusted display. Lancet. 1997;350:1128–1130
  16. de Leval MR, Francois K, Bull C, et al. Analysis of a cluster of surgical failures. Application to a series of neonatal arterial switch operations. J Thorac Cardiovasc Surg. 1994;107:914–923[discussion 923-914]
  17. Rogers CA, Reeves BC, Caputo M, et al. Control chart methods for monitoring cardiac surgical performance and their interpretation. J Thorac Cardiovasc Surg. 2004;128:811–819
  18. Matheny ME, Ohno-Machado L, Resnic FS. Discrimination and calibration of mortality risk prediction models in interventional cardiology. J Biomed Inform. 2005;38:367–375
  19. Spiegelhalter D, Grigg O, Kinsman R, et al. Risk-adjusted sequential probability ratio tests: applications to Bristol, Shipman and adult cardiac surgery. Int J Qual Health Care. 2003;15:7–13
  20. Woodall WH. The use of control charts in health-care and public-health surveillance. J Qual Technol. 2006;38:88–103
  21. Barnard G. Control charts and stochastic processes. J Roy Stat Soc Ser B. 1959;21:239–271
  22. Cannon CP, Battler A, Brindis RG, et al. American College of Cardiology key data elements and definitions for measuring the clinical management and outcomes of patients with acute coronary syndromes. J Am Coll Cardiol. 2001;38:2114–2130
  23. Steiner SH, Cook RJ, Farewell VT, et al. Monitoring surgical performance using risk-adjusted cumulative sum charts. Biostatistics. 2000;1:441–452
  24. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143:29–36
  25. Lemeshow S, Hosmer DW. A review of goodness of fit statistics for use in the development of logistic regression models. Am J Epidemiol. 1982;115:92–106
  26. Wald A. Sequential tests in industrial statistics. Ann Math Stat. 1945;6:117–186
  27. Grigg OA, Farewell VT, Spiegelhalter DJ. Use of risk-adjusted CUSUM and RSPRT charts for monitoring in medical contexts. Stat Methods Med Res. 2003;12:147–170
  28. Rogers CA, Ganesh JS, Banner NR, et al. Cumulative risk adjusted monitoring of 30-day mortality after cardiothoracic transplantation: UK experience. Eur J Cardiothorac Surg. 2005;27:1022–1029
  29. Matheny ME, Ohno-Machado L, Resnic FS. Monitoring device safety in interventional cardiology. J Am Med Inform Assoc. 2006;13:180–187

 This research was supported in part by grants 1-T15-LM-07092 and R01-LM-08142-04 from the National Library of Medicine, Bethesda, MD of the National Institutes of Health, Bethesda, MD. The authors have no conflict of interests to disclose.

PII: S0002-8703(07)00708-9

doi: 10.1016/j.ahj.2007.08.022

American Heart Journal
Volume 155, Issue 1 , Pages 114-120 , January 2008

Article Tools

* Image Usage & Resolution