Evaluation Plan March 7, 2012

1. Evaluation PlanMarch 7, 2012

2. Evaluation • General approach to evaluation is broad with the ability to support specificity. • Collecting and evaluating multiple innovations using several methods: dashboard measures (fiscal, quality, patient and staff satisfaction, etc.), administrative data, surveys, focus groups, observations and narratives.

3. Evaluation • As of now, there isn't an emphasis on direct correlational measures of specific innovations. • This means…we don’t expect to be able to say (for example) that the new Welcome Packet helped improve satisfaction. What we will be able to say is that we implemented X, Y, Z innovations on this unit and there is a relationship between the innovation unit and patient satisfaction, or length of stay. • Please note, that if you have a specific idea or research interest, we can help design a research plan for those unit or individual specific interests.

4. Evaluation • Specifically – we’re going to release a survey for the Attending Nurses probably mid next week, and the survey will get repeated a few times over the next couple years. • ARNs: A link will be in your email.

5. Evaluation • Qualitatively, we’re going to: • Hold focus groups • Conduct observation studies • Evaluate narratives

6. Evaluation • Quantitatively, we’re going to administer surveys: • Revised Professional Practice Environment • Patient Safety Culture • Patient’s Feeling Known by Their Nurses

7. Evaluation • Administrative data that you/ we collect as part of MGH operations such as: • Indicators: Falls, Infections, Pressure Ulcers, etc. • HCAHPS (Patient Satisfaction) • Length of Stay (LOS) • Cost per Case Mix • Staff Retention • Other: Unit specific innovations/ interventions

8. Conceptual Schema Innovation Cluster Focus Areas * Interventions ** Education Evaluation (Pre, During, Post) Other measures as identified • Throughout Admission • Relationship-Based Care • Attending Nurse • Handover Rounding Checklist • Pre-Admission • 4. Pre-Admit Data Collection • 5. Patient IU Welcome Packet • During Admission • 6. Domains of Practice • 7. Interdisciplinary • 8. Team Rounds • 9. Electronic White Boards • 10. Volte Communication • 11. Tough books • Post-Discharge • 12. Discharge Follow-up Phone Calls • Others as identified Quantitative Qualitative • Culture of Safety Survey • HCAHPS • LOS • Quality Indicators • Patients Perceptions of Feeling Known (PPFKN) • Readmissions • Revised Perceptions of Practice Environment Scale (RPPE) • Cost per Case Mix • Staff Retention • Focus Groups (Staff, Patients, Families, etc) • Observations • Narratives Patient Engagement Communication Roles & Structures ** May apply to any or all 3 of the cluster focus areas * The clusters are a lens with which we gain perspective on any particular intervention. January 2012

9. Evaluation

10. Evaluation

11. Evaluation • What do YOU think is important to evaluate in this work? • Thoughts, Comments, Concerns??? • Feel free to email me jadams9@partners.org