PATIENT EXPERIENCE IS NOT PATIENT SATISFACTION

Transcription

1 PATIENT EXPERIENCE IS NOT PATIENT SATISFACTION Understanding the fundamental differences Subashnie Devkaran, PhD, FACHE, MScHM, CPHQ, BScPT Manager- Accreditation, Quality and Patient Safety Institute Cleveland Clinic Abu Dhabi

2 PRESENTATION OBJECTIVES Review the conceptual flaws of patient satisfaction Understand the differences between patient satisfaction and patient experience. Patient experience and its relationship to patient safety and patient centered care 2

3 THEN AND NOW Low tech-high touch First assisted take-off flight by the Wright Brothers, December 17, 1903 High tech-low touch What's next?

4 FROM DISEASE CENTERED TO PATIENT-CENTERED CARE Where we have been Where we are going Fragmented care Coordinated Care Provider centered care Patient centered Paper Patients as passive participants Facility based visits What's the matter with you? Electronic Patients are fully engaged Innovative care delivery strategies What matters to you? *Barry MJ, Edgeman-Levitan S, Shared Decision Making- The Pinnacle of Patient-Centered Care. N Engl. J Med. 366; 9.pp

5 Patient experience and satisfaction is the No. 1 priority for healthcare executives above clinical quality, cost reduction, and many other burning issues, HealthLeaders Media Industry Survey

6 17 to 25 people in one episode of care 6

7 The difference between patient satisfaction and patient experience How many collect patient satisfaction data? In some circumstances high levels of patient satisfaction supply evidence of high quality medical care, where in others they supply evidence of low expectations or unnecessary treatments. (Greaves et al., 2012; Fenton et al., 2012) 7

8 THE PITFALLS OF PATIENT SATISFACTION Improvements in patient satisfaction have not been linked to quality improvement No evidence as how patient satisfaction data is best used for quality improvement Lack of lack of a universally accepted definition or measure makes comparison difficult 1.Carr-Hill RA. The measurement of patient satisfaction. J Public Health Med 1992; 14: pmid: Crow R, Gage H, Hampson S, Hart J, Kimber A, Storey L, et al., et al. The measurement of satisfaction with healthcare: implications for practice from a systematic review of the literature. Health Technol Assess 2002; 6: pmid: Hudak PL, Wright JG. The characteristics of patient satisfaction measures. Spine 2000; 25: doi: / pmid: Ross CK, Stewart CA, Sinacore JM. A comparative study of seven measures of patient satisfaction. Med Care 1995; 33: doi: / pmid: Sitzia J, Wood N. Patient satisfaction: a review of issues and concepts. Soc Sci Med 1997; 45: doi: /S (97) pmid: Sofaer S, Firminger K. Patient perceptions of the quality of health services. Annu Rev Public Health 2005; 26: doi: 8

9 Patient satisfaction 1. Satisfaction is seen as a judgment about whether expectations were met, it is influenced by varying standards, different expectations, the patient s disposition, time since care, and previous experience 2. None the less, qualitative research shows that patients will give positive satisfaction ratings even in the face of a negative experience unless they believe that the poor care is under the direct control of the person they are evaluating- For example, they may be unhappy about hurried communication with their doctor but still give an adequate rating because they attribute this to time constraints not a lack of intrinsic skills. 3. Consequently, positive satisfaction ratings include both true positives and false positives. 4. High satisfaction ratings indicate that care is adequate not that it is of superior quality; low ratings indicate problems and should not be masked by reporting average scores. 9

10 Patient experience is a more reliable tool The study found that when patients were asked a single question about how satisfied overall they were with their practice, only 4.6% of the variance in their satisfaction ratings was a result of differences between practices; the remaining variance resulted from differences between patients plus random error. In contrast, when asked to report on their experience with usual time they had to wait for an appointment, more than 20% of the variance in responses was a result of differences between practices. The authors conclude that for the purpose of discriminating performance between practices, it is better to ask patients to report on their experience rather than ask for satisfaction ratings Salisbury C, Wallace M, Montgomery A. Patient experience and satisfaction in primary care: secondary analysis using multilevel modelling. BMJ2010;341:c

11 Criticisms of patient satisfaction Patient satisfaction is sometimes treated as an outcome measure (satisfaction with health status following treatment) and sometimes as a process measure (satisfaction with the way in which care was delivered). Clearly patient satisfaction measurement is the application to healthcare of customer satisfaction, a concept coming both from quality management and marketing It is an important evolution from industrialist metrics, focusing mainly on productivity and efficiency. In the 80s, with the upcoming of the so called service economy, customer satisfaction appeared to an important metric too. As healthcare was defined as a service, quality programs in clinics included also patient satisfaction. Yet the value of measuring patient satisfaction has been limited. Mainly because, as in other industries and sectors, surveys have tended to focus on managers and clinician s agendas; not on questions meaningful to patients, that can be translated into actions. 12

12 Patient satisfaction surveys tend to ask patients subjective questions about their satisfaction with their care. How do you rate your doctor s caring and concern for you? How satisfied are you with the appointment system in your health center? Is it easy for you to get medical care when you need it? Multiple choice answers to satisfaction questions are also more subjective, such as: Strongly agree, agree, neutral, disagree, strongly disagree Very good, good, fair, poor 13

13 Experience questions relate to the patient s actual, more objective experiences in the health center and aim to avoid value judgments and the effects of existing expectations. Examples of experience questions include: In the last 12 months, how many days did you usually have to wait for an appointment when you needed care right away? In the last 6 months, how often did you see your provider within 15 minutes of your appointment time? In the last 12 months, did anyone in your provider s office talk with you about specific goals for your health? Multiple choice answers to experience questions are more objective, such as: Same day, 1 day, 2-3 days, 4-7 days, more than 7 days Never, sometimes, usually, always 14

14 The word is empathy There is a clear difference between a nurse acting according best quality standards and a nurse working with empathy caring for the patient s experience. In the first case, the nurse performs her work in an excellent manner, asks the polite questions when it is defined, smiles in a routine way, is also polite in a routine way and at the end it is difficult to distinguish her friendliness from the automated friendliness of a cash dispenser. To the contrary, nurses able to empathize with the patient, get into the storm of emotions anxious patients suffer and yet, not losing the clinical point of view, will really look for solutions for patient problems, speak the patient s language, challenge doctors and change their agendas if necessary, risking eventually an argument. Patients value this. The physician comforted us and acknowledged what a difficult journey we had. 16

15 Key concepts of patient experience Patient experience goes beyond satisfaction and making patients happy. You may have a negative outcome but still have a positive patient experience. You may have a positive outcome but a negative patient experience. Patient experience is linked employee engagement Patients judge healthcare providers not only on clinical outcomes, but also compassionate and excellent, patientcentered care. 17

16 Actionable data For instance, knowing that 10% valuate their care as poor or the waiting times as fair does not help very much. Instead, knowing precise details about what went wrong during the care (communication, understanding of medication, etc.) makes a difference because here there is a call for action. Thus, the difference between patient satisfaction and patient experience is what the values are prioritized: the organization s and management priorities or patient needs? 18

17 Percentage THE TRADITIONAL MEASURE Percentage of patients that rated nursing services as excellent 90.00% 80.00% 70.00% 60.00% 50.00% 40.00% 30.00% A satisfaction-rating instrument cannot tell you what to do if patients are dissatisfied 20.00% 10.00% 0.00% May-13 Jun-13 Jul-13 Aug-13 Sep-13 Oct-13 May-13 Jun-13 Jul-13 Aug-13 Sep-13 Oct-13 Service improvement activity requires specific data about what Nurse Courtesy 58.25% 56.75% 64.24% 64.75% 85.50% 73.00% Attitude 58.25% 57.00% 64.56% 64.50% 85.50% 72.75% Appearance what 58.25% happened.(berwick 57.00% et 65.19% al., 2003) 64.75% 85.50% 72.75% Efficiency of Service 58.25% 57.25% 64.87% 64.75% 85.25% 73.00% Attention to your needs 58.25% 57.00% 64.87% 64.75% 85.25% 73.00% actually happened, not just data on whether patients were satisfied with

18 Percentage YOUR CARE FROM NURSES Indicators 1.Did the nurses treat you with courtesy and respect? 2.Did the nurses listen carefully to you? 3.Did the nurses explain things in a way you could understand? 4.Were there sufficient nurses on duty to care for you in hospital? 5.Did the nursing staff respond immediately to your call bell? 6.Did you have confidence and trust in the nurses treating you? 7.Did the nurses talk in front of you as if you weren t there? Code CFN1 CFN2 CFN3 CFN4 CFN5 CFN6 CFN7 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% CFN1 CFN2 CFN3 CFN4 CFN5 CFN6 CFN7 Always 90.23% 88.37% 82.22% 80.21% 69.35% 79.33% 16.81% Most of the Time 7.20% 9.04% 10.82% 11.83% 19.74% 15.76% 1.18% Half of the Time 1.54% 2.07% 5.15% 4.63% 8.05% 4.39% 2.36% Seldom 0.51% 0.52% 0.77% 1.54% 1.30% 0.52% 8.85% Never 0.51% 0.00% 1.03% 1.80% 1.56% 0.00% 70.80%

19 Patient experience and patient safety There is also some evidence to suggest that patients can be used as partners in identifying poor and unsafe practice and help enhance effectiveness and safety. When physicians communicate better, coordination of care improves and compliance with treatment options increases. Those are quality issues. When nurses communicate effectively at the bedside, medication errors go down, pressure ulcers go down, and falls go down. Those are safety issues. 21

20 A small but growing body of evidence shows the relationship between aspects of patient experience and clinical quality Clinical services that are intentionally patient-centered (surgery, ITU, cardiology) achieve better clinical outcomes (Boore 1978; Hayward 1975; Shuldham 1999; Suchman 1993) Patient experience Effective doctor-patient communication promotes compliance in medication + more active self-management of longterm chronic conditions (Bauman et al 2003) Anxiety and fear delay healing but are allayed by emotional and psychological support (Cole-King and Harding 2001; Norman 2003; Weinman et al 2008) Patient safety Clinical effectiveness

21 THE FINANCIAL IMPERATIVE Value-based purchasing Incentive payments based on total performance score Total performance score based on two domains quality measures 70% patient experience 30% Employee Engagement/Satisfaction 22% EMRs/Meaningful Use/IT Cost Management/Reduction 35% 37% Quality/Patient Safety 63% Patient Experience 70% Top three organisational priorities for healthcare leaders (Beryl Institute, 2013) 23

22 Patients emotional state AN EXAMPLE OF A PATIENT JOURNEY Enough time to ask questions Difficulty parking Can t find the dept Happy to wait for 30mins but now I ve had to wait for 1 hr Need for privacy on a mixed ward How far through the hospital? What will the scan be like? Getting settled into another ward. How to get home. Right medication - clear instructions? Hospital appointment at home journey and arrival waiting clinical In bed on a consultations/inter ward ventions moving around the hospital discharge and leaving

23 WHICH CHOICES- PROVIDER AND PATIENT? What are the most influential factors in a patients experience? Are these influential factors modifiable? If we modify these factors can we predict whether a patient s experience will be positive or negative? My hypotheses 27

24 RESEARCH GAP- THE CHALLENGE Only two research papers, on patient satisfaction in the UAE, have been published. Most of the research on patient satisfaction cannot be generalised to a multi-speciality acute care hospital setting. No research on patient experience with hospital services in the UAE or other Gulf countries. No assessment tools for measuring patient experience within an acute care setting have not been developed until now in this region. 28

25 HOSPITAL CASE STUDY 32

26 COMPASS METHOD FOR SURVEY DESIGN 33

27 SURVEY TOOL BASED ON: Learning from Picker Institute Literature US Consumer Assessment of Healthcare Providers and Systems (HCAPHS) survey which has only 27 questions PLUS Commitment to developing a practical, achievable method for the Middle East

28 SURVEY DESIGN Cover page for instructions English and Arabic 5 point Likert scale using Always-Never 10 point scale for global rating Ranking of importance Free text for comments

29 PATIENT CENTERED CARE MEASURED BY 13 PATIENT EXPERIENCE DOMAINS 13. Quality of Food 1.Care from doctors 2. Care from nurses 12. Medication management 3. Management of Operations and Procedures 11. Waiting for admission Patient experience 4. Cleanliness 10. Discharge 5. Treatment with respect and dignity 9. Involvement of family and friends 6. Consistency and Coordination of care 8. Pain management 7. Patient rights and feedback

30 SURVEY DESIGN 37

31 11 DEMOGRAPHIC QUESTIONS 1. Self-reported overall health 2. Education level 3. Nationality 4. Language 5. Age group 6. Marital status 7. Length of stay 8. Previous hospital visits How much did the hospital treatment/ operation improve your health problem? Worse than before Not at all 9.Occupation 10. Gender 11. Somewhat Treatment outcome Quite a bit A great deal اي الى درجة العالج او األجراء الطبي المقدم لك من قبل :المستشفى ساعدك على التحسن اسوأ من السابق ابدا الى حد ما احيانا الى درجة كبيره

32 DEVELOPING A VALIDATED TOOL Internal consistency Overall Cronbach's Alpha Cronbach's Alpha Based on Standardized Items N of Items Item 1. Did the doctor explain the risks and benefits of the operation or procedure in a way you could understand? 2. Did the doctor explain beforehand what would be done during the operation or procedure? 3. Did the doctor answer questions about the operation/procedure in a way you could understand? 4. Did the anesthetist explain how he/she would put you to sleep or control your pain? Scale Mean if Item Deleted Scale Variance if Item Deleted Corrected Item-Total Correlation Squared Multiple Correlation Cronbach's Alpha if Item Deleted

33 RESEARCH OBJECTIVES Produce a reliable and valid survey instrument to assess patient s experience of care in a Middle Eastern setting. 1. Identify the variables that contribute most to the variability in patient experience at the patient and hospital levels. 2. Identify the predictors of patient experience to empower regulators and payers to focus on these and improve on the delivery of care. 3. The knowledge of patient sociodemographic characteristics and its relationship to patient experience will permit healthcare providers to tailor care to meet the needs of patients at an individual level. 40

34 RESEARCH METHODOLOGY Using Slovin s formula approximately 500 patients interviewed Survey tool: 60 questions from 13 core domains covering the entire journey of care (from admission to discharge) Face- face interviews of all inpatients who stayed at least 24 hours in the hospital and due for discharge on the day of the survey. 35% of patients were Emirati 41

35 DATA ANALYSIS Descriptive statistics patients characteristics (including socio-demographic and stay characteristics 39 variables Multiple regression models test hypotheses relating to the association between patient experience, patient characteristics and experience constructs. Regression analysis was used to estimate the coefficients of the explanatory variables independently associated with experience outcomes such as the Overall rating of the hospital (Y1), Overall global measures score (Y4) and the Overall patient experience score (Y5). Logistic regression analysis was used Willingness to return (Y2) and Willingness to recommend (Y3), 43

36 WHAT DO PATIENTS WANT IN THE UAE WANT? Ranking of Importance Mean Rank Your Care From The Doctors Your Care From The Nurses Treatment With Respect And Dignity Cleanliness Of The Hospital And Hand-Washing Consistency And Coordination Of Care Your Pain Management In This Hospital Patient Rights And Feedback Involvement In Decision Making Your Medication Management In This Hospital Management Of Your Operations And Procedures

37 PREDICTORS OF POSITIVE PATIENT SATISFACTION The literature review Gender males record higher experience scores than females (Crow et al., 2002; Danielsen et al., 2007) Age Educational Level Self-reported Physical Health Length Of Stay Nationality Older patients rate their experiences and satisfaction higher than younger patients (Jackson et al, 2001; Jenkinson et al., 2002; Thi et al., 2002; Commission for Health Improvement, 2004; Vukmir, 2006; Danielsen et al., 2007; Bleich et al., 2007). High scores are associated with lower levels of education (Da Costa et al., 1999; Danielsen et al., 2007; Findik et al., 2010). Only two studies- with a poor health status are more likely to report poorer satisfaction (Da Costa et al., 1999; Commission for Health Improvement, 2004). Limited studies, more satisfied with longer LOS but less than 1 month (Findik et al., 2010) Inconsistent findings between nationals and expatriates (Al-Shamekh, 1992; Abdul Al Kareem et al., 1996; Al-Faris et al., 1996; Makhdoom et al., 1997; Bo Hamra and Al-Zaid, 1999; Saeed et al., 2001; Mansour and Al-Osimy, 1993; Al-Doghaither and Saeed, 2000; Alhashem, 2009) 46

38 PREDICTORS Self-reported Physical Health Only two studies- with a poor health status are more likely to report poorer satisfaction (Da Costa et al., 1999; Commission for Health Improvement, 2004). Educational Level Self reported health status, patients with a positive self-reported health status had a higher overall patient experience score and 4 times (OR 4.14) more willing to recommend the hospital than patients who had poor self-reported health. Education level No significant effect High scores are associated with lower levels of education (Da Costa et al., 1999; Danielsen et al., 2007; Findik et al., 2010). Gender males record higher experience scores than females (Crow et al., 2002; Danielsen et al., 2007) Gender No significant effect 48

39 KEY FINDINGS Summary: Hospital stay characteristics Length Of Stay Limited studies, more satisfied with longer LOS but less than 1 month (Findik et al., 2010) Length of stay Analysis revealed that patients who stayed 2-4 nights, 5-10 nights and more than 10 nights had reported significantly lower overall patient experience scores than patients who stayed for 1 night only. The longer the length of stay, the higher the probabilities of a lower overall patient experience score.. Treatment outcome No literature Hospital treatment outcome Patients who had a positive treatment outcome were more likely to provide a higher overall hospital rating than patients with negative treatment outcomes. (Area of originality) 49

40 KEY FINDINGS Summary: Patient experience constructs Rated #2 by patients Rated #1 by patients Nursing care a predictor of the overall rating of the hospital, the global measures score, willingness to return and willingness to recommend. Ranked 2 by patients Care from Doctors a predictor of willingness to recommend (Y3), willingness to return (Y2) and the global measures score (Y4). 50

41 KEY FINDINGS Summary: Patient experience constructs Rated #4 by patients Rated #6 by patients Cleanliness a predictor of the overall rating of the hospital (Y1) and the global measures score (Y4). Ranked 4 by patients. Pain management is a predictor of the overall rating of the hospital. Quality of hospital food a predictor of willingness to recommend (Y3), willingness to return (Y2) and the global measures score (Y4). 51

42 Key components of your organization s Patient Experience effort influencing choices Sharing Patient Experience Stories 52% Hourly Rounding 50% Leadership rounding 49% Staff training programs 49% The responses of almost 1,100 healthcare leaders (Beryl Institute, 2013) shows that: Top priorities in addressing the patient experience remain focused on tactical issues Key components of experience efforts reveal a shift from reactionary to in the moment improvement

43 Question 1 Which of the below is NOT a patient experience question? 1. How often were educated about medication by the nursing staff? 2. How would you rate the food quality? 3. How often were you assessed for pain? 4. How long did it take the nurse to answer the call bell? 5. How long did you wait to see the doctor? 57

44 Question 2 What do patient experience ratings NOT intend to measure? 1. Access to care 2. Treatment with respect and dignity 3. Involvement in treatment decisions 4. Perception of quality care received 5. Patients evaluation of what actually occurred 58

45 DIFFERENCES BETWEEN PATIENT SATISFACTION AND PATIENT EXPERIENCE Satisfaction ratings reflect The personal preferences and expectations of the patient The perception of the quality of the care received Response tendencies due to personal characteristics Global satisfaction ratings can be misleading General evaluation categories (e.g., excellent, very good, good, fair, poor) Fair or poor doesn t give managers or clinicians a view of what to do to improve the quality of care Patient s evaluation of what occurred How would you evaluate that experience? General rating of their care tends to elicit more positive responses Fools Gold Patients experience ratings reflect Report in detail about their experiences of a particular service, hospital episode, or clinician Confidence and trust in health professionals Involvement in treatment decisions Being treated with dignity and respect Quantifiable and actionable concerns e.g Had to wait more than 15 minutes for the call button to be answered Access and waiting times Questions are designed to discover what actually occurred What was your experience? Factual questions about events and occurrences 59 Source: adapted from literature review of Carr-Hill, 1992; Hall and Dorman, 1988; Sitzia and Wood, 1998; Fitzpatrick, 1991; Fitzpatrick, 2000; Fitzpatrick and Hopkins, 2000; Edwards and Staniszewska, 2000; Cleary and McNeil, 1988 and Cleary, 1999)

46 The bird is in your hands the choice is yours!

47 References Alaiban KM, Al-Omar B, Narine L, Al-Assaf AF, Javed F. A survey assessing patient satisfaction at public and private healthcare facilities in Riyadh, Saudi Arabia. Ann Saudi Med. 2003;23: Al-Doghaither, A.H., Abdelrhman, B.M., Saeed, A.A. (2000), "Patients' satisfaction with physicians' services in primary healthcare centers in Kuwait City, Kuwait", The Journal of the Royal Society for the Promotion of Health, Vol. 120 No.3, pp Al-Faris, E., Khoja, T., Falouda, M., Saeed, A. (1996), "Patients' satisfaction with accessibility and services offered in Riyadh Health Centers", Saudi Medical Journal, Vol. 17 No.1, pp Al-Shamekh, A. (1992), Determinants of patient general satisfaction with primary health care services in Riyadh, Saudi Arabia, PhD dissertation, University of Pittsburgh, PA,. Arentz, J. E. & Arentz, B. B. (1996). The development and application of a patient satisfaction measurement system for hospital-wide quality improvement. International Journal of Quality in Health Care, 8(6), Coyle, J. and Williams B. (1999). Seeing the wood for the trees: Defining the forgotten concept of patient dissatisfaction in the light of patient satisfaction research. International Journal of Health Care Quality Assurance incorporating Leadership in Health Services, 12(6-7), 1-9. Crow, R., Gage, H., Hampson, S., Hart, J., Kimber, A., Storey, L. and Thomas, H. (2002), The measurement of satisfaction with health care: implications for practice from a systematic review of the literature, Health Technology Assessment, Vol. 6 No. 32, pp Findik, U. Y., Unsar, S. & Sut, N. (2010). Patient satisfaction with nursing care and its relationship with patient characteristics. Nursing and Health Sciences, 12(2),

48 References continued Hall, J. A. & Dornan, M. C. (1990). Patient sociodemographic characteristics as predictors of satisfaction with medical care: a metaanalysis, Social Science &Medicine, 30(7), Jackson, J. L., Chamberlin, J. & Kroenke, K. (2001). Predictors of patient satisfaction. Social Science & Medicine, 52(4), Jenkinson, C., Coulter, A., Bruster, S., Richards, N. & Chandola, T. (2002). Patients' experiences and satisfaction with health care: Results of a questionnaire study of specific aspects of care. Quality & Safety in HealthCare, 11(4), Hall JA., Milburn MA., Roter DL., and Daltroy LM (1998) Why are sicker patients less satisfied with their medical care? Tests of two explanatory models. Health Psychol, 17 (1), 70-5 Hall JA, Dornan MC. Patient sociodemographic characters as predictors of satisfaction with medical care: a meta-analysis. Soc Sci Med 1990;30: Jaipaul CK, Rosenthal GE. Are older patients more satisfied with hospital care than younger patients? J Gen Intern Med 2003;18: Rahmqvist, M. (2001), "Patient Satisfaction in relation to age, health status and other background factors: a model for comparisons of care units", International Journal for Quality in Health Care, Vol. 13 No.5, pp Sitzia, J. & Wood, N. (1997). Patient satisfaction: A review of issues and concepts. Social Science & Medicine, 45(12), Hargraves JL, Wilson IB, Zaslavsky AM et al. Adjusting for patient characteristics when analyzing reports from patients about hospital care. Med Care 2001;39: Centers for Medicare & Medicaid Services. Mode and patient mix adjustment of the CAHPS Hospital Survey (HCAHPS), April 30, 2008 [ paper on the Internet]. (14 December, 2010, date last accessed). Otani, K., Waterman, B., Faulkner, K. M., Boslaugh, S. & Claiborne, W. D. (2010). How patient reactions to hospital care attributes affect the evaluation of overall quality of care, willingness to recommend, and willingness to return. Journal of Healthcare Management, 55(1), Sitzia, J. & Wood, N. (1997). Patient satisfaction: A review of issues and concepts. Social Science & Medicine, 45(12), Crow R, Gage H, Hampson S et al. The measurement of satisfaction with healthcare: implications for practice from a systematic review of the literature. Health Technol Assess 2002;6: