Advertisement
Research Article| Volume 25, ISSUE 6, P1349-1354, June 2016

Why Clinicians Prognosticate Stroke Patients Poorly: Results from the Clinician Judgment versus Risk Score to Predict Stroke Outcomes Randomized Study

  • Nav Persaud
    Correspondence
    Address correspondence to Nav Persaud, MSc, MD, Department of Family and Community Medicine, St. Michael's Hospital, 80 Bond Street, Toronto, Ontario M5B 1X2, Canada.
    Affiliations
    Department of Family and Community Medicine, St. Michael's Hospital, Toronto, Canada

    Department of Family and Community Medicine, University of Toronto, Toronto, Canada

    Li Ka Shing Knowledge Institute, St. Michael's Hospital, Toronto, Canada
    Search for articles by this author
  • Kevin E. Thorpe
    Affiliations
    Applied Health Research Centre, St. Michael's Hospital, Toronto, Canada

    Dalla Lana School of Public Health, University of Toronto, Toronto, Canada
    Search for articles by this author
  • Stavroula R. Raptis
    Affiliations
    Li Ka Shing Knowledge Institute, St. Michael's Hospital, Toronto, Canada

    Applied Health Research Centre, St. Michael's Hospital, Toronto, Canada
    Search for articles by this author
  • Gustavo Saposnik
    Affiliations
    Li Ka Shing Knowledge Institute, St. Michael's Hospital, Toronto, Canada

    Dalla Lana School of Public Health, University of Toronto, Toronto, Canada

    Stroke Research Unit, Mobility Program, St. Michael's Hospital, Toronto, Canada

    Department of Medicine, Institute of Health Policy, Management and Education, University of Toronto, Toronto, Canada

    Cardiovascular Research Program, Institute for Clinical Evaluative Sciences, Toronto, Canada
    Search for articles by this author
  • on behalf of theStroke Outcomes Research Working Group (SORCan—www.sorcan.ca)

      Background

      Prognostication after a stroke has important implications for care and for decisions made by patients and their families. It is not clear why clinicians, even experienced stroke neurologists, poorly estimate the risk of disability and death following stroke.

      Methods

      We analyzed the results from the Clinician Judgment versus Risk Score to predict Stroke Outcomes study in which each clinician estimated the risk of death and the risk of death or disability in 5 case-based ischemic stroke scenarios. We employed a mixed-effect linear model to disentangle the ability of clinicians to discriminate between poor and good prognosis cases (slope) from the calibration of quantitative estimates (intercept), and to assess for any effect of anchoring in the death or disability condition (through a comparison with the death condition).

      Results

      One hundred eleven clinicians made 1665 predictions. Clinicians were able to discriminate between cases with low and high risks of death (slope of .81, 95% confidence interval [CI] .70-.93), but the quantitative estimates were not well calibrated (intercept of 5.14, 95% CI 3.97-6.33). The discrimination was poorer (slope of .67, 95% CI .60-.75), but the calibration was better (intercept of −.34, 95% CI −5.43 to 4.98) in the death or disability estimates.

      Conclusion

      Poor stroke prognostication can be explained by poor calibration and an anchoring effect, which are both amenable to specific training interventions.

      Key Words

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Journal of Stroke and Cerebrovascular Diseases
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Strbian D.
        • Meretoja A.
        • Ahlhelm F.J.
        • et al.
        Predicting outcome of IV thrombolysis-treated ischemic stroke patients: the DRAGON score.
        Neurology. 2012; 78: 427-432
        • Saposnik G.
        • Kapral M.K.
        • Liu Y.
        • et al.
        IScore: a risk score to predict death early after hospitalization for an acute ischemic stroke.
        Circulation. 2011; 123: 739-749
        • Saposnik G.
        • Cote R.
        • Mamdani M.
        • et al.
        JURaSSiC: accuracy of Clinician vs Risk Score Prediction of Ischemic Stroke Outcomes.
        Neurology. 2013; 81: 448-455
        • Swets J.A.
        Measuring the accuracy of diagnostic systems.
        Science. 1988; 240: 1285-1293
        • McFall R.M.
        • Treat T.A.
        Quantifying the information value of clinical assessments with signal detection theory.
        Annu Rev Psychol. 1999; 50: 215-241
        • Swets J.A.
        ROC analysis applied to the evaluation of medical imaging techniques.
        Invest Radiol. 1979; 14: 109-121
        • Holtgraves T.S.J.
        Cognitive biases in playing the lottery: estimating the odds and choosing the numbers.
        J Appl Soc Psychol. 1992; 22: 934-952
        • Kapral M.K.S.F.
        • Richards J.A.
        • Lindsay M.P.
        • et al.
        Registry of the Canadian Stroke Network—Progress Report 2001-2005.
        (Institute for Clinical Evaluative Sciences)2005
        • Adams Jr, H.P.
        • Bendixen B.H.
        • Kappelle L.J.
        • et al.
        Classification of subtype of acute ischemic stroke. Definitions for use in a multicenter clinical trial. TOAST. Trial of Org 10172 in Acute Stroke Treatment.
        Stroke. 1993; 24: 35-41
        • Grau A.J.
        • Weimar C.
        • Buggle F.
        • et al.
        Risk factors, outcome, and treatment in subtypes of ischemic stroke: the German stroke data bank.
        Stroke. 2001; 32: 2559-2566
        • Adams Jr, H.P.
        • Davis P.H.
        • Leira E.C.
        • et al.
        Baseline NIH Stroke Scale score strongly predicts outcome after stroke: a report of the Trial of Org 10172 in Acute Stroke Treatment (TOAST).
        Neurology. 1999; 53: 126-131
        • Saposnik G.
        • Raptis S.
        • Kapral M.K.
        • et al.
        The iScore predicts poor functional outcomes early after hospitalization for an acut e ischemic stroke.
        Stroke. 2011; 42: 3421-3428
        • Saposnik G.
        • Guzik A.K.
        • Reeves M.
        • et al.
        Stroke Prognostication using Age and NIH Stroke Scale: SPAN-100.
        Neurology. 2013; 80: 21-28