1 / 9

Nemours Job Role Reconciliation 2018

Survey Solutions. Nemours Job Role Reconciliation 2018. Overview of Job Role Benchmarking Issue. Benchmark Tagging Inconsistencies between March and July Surveys. Job roles in the 2018 March Pulse Survey were tagged incorrectly resulting in slight data changes to already presented data. 1.

kimn
Download Presentation

Nemours Job Role Reconciliation 2018

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Survey Solutions Nemours Job Role Reconciliation 2018

  2. Overview of Job Role Benchmarking Issue Benchmark Tagging Inconsistencies between March and July Surveys Job roles in the 2018 March Pulse Survey were tagged incorrectly resulting in slight data changes to already presented data 1 Set up of July pulse survey highlighted several issues with the finalized job role tagging assignments from the March survey that were not identified at that time by either Nemours nor Advisory Board data teams, and that were ultimately signed off on to go into the finalized results site After Nemours identified the inconsistency between surveys, Advisory Board did a discovery exercise to identify the impact of the issue and how it occurred. Ultimately, there was a manual sorting error in the excel file caused by the Advisory Board that led to 6 job roles being tagged into an incorrect benchmark category. Categories are used to pull holistic data (like the leadership engagement level slide). 2 3 • Advisory Board created several resources for Nemours team to understand impact of changes, including: • Updated 2018 March pulse survey site to view updates in a filterable site • Audit document outlining changes in N size, engagement categories (engaged, content, ambivalent, disengaged), and engagement index for each impacted job role category, including identification of statistical significant changes

  3. Our Findings 0 Job Role Changes Statistically Significant 2 Leadership Roles Saw Decreases +3.8 Physician – Employed %Engaged Increase ! While there were some job roles that saw increases and decreases in percent engaged, none were statistically significant The Physician – Employed role saw an increase of 3.8% more engaged individuals following the data reconciliation The Manager Clinical role and the Supervisor/Assistant manager (Non-Clinical) roles were the only leadership level roles that saw a negative change in %Engaged (-1.3% and -5.7% respectively), but neither are statistically significant The Bottom Line: • There are 13 job roles that had increases in %Engaged, with Supervisor/Assistant Manager Clinical (+17.6%), Executive/VP (+12.4%), and Medical Technologist (+8.2%) increasing the most; RN’s also increased (+.6%) • There are 11 job roles that had decreases in %Engaged, with Respiratory Therapist (-8.5%), Nursing / PCA (-9.4%), and Radiologic Technologist (-14.8%) decreasing the most

  4. Our Plan March Pulse July Pulse Fall Full Existing Process New Process Smaller support team for data collection and verification on both Nemours and Advisory Board Larger support team with a dedicated Senior Business Analyst identified for all data collaboration Truncated QA timeline prior to launch Minimum 2 weeks for all Data QA prior to survey launch Immediate release of results to Associates Additional QA time built into results delivery timeline to allow for data checks after survey has closed Excel based documentation and potential for version control mishaps Utilization of new set up platform with automation built in to check data more efficiently and highlight inconsistencies

  5. What Does This Change (and Not Change)? Immediate Impact No Impact 2017 Full survey baseline data, reports, metrics, and goals remain unchanged and unaffected Reports using any job-role level data from 2018 March pulse data may change, depending on job role and severity of impact 2018 March pulse overall engagement data, when filtered by anything other than job role remains unaffected 2018 March pulse site will be refreshed with the corrected data, at which point you may see changes in your data when looking at job role specific information 2018 July pulse survey data, when released, will not be affected 2018 July pulse survey trended data, when released, will trend to corrected 2018 March data to create the most apples to apples comparisons

  6. Source: Advisory Board Survey Solutions. Leadership Comparison, Original to Updated March Nemours Leadership Engagement Comparison | Updated March 2018 Pulse Survey Percent Engaged Relative to Original March Data

  7. Source: Advisory Board Survey Solutions. Corrected Leadership Engagement Comparison Nemours Leadership Engagement Comparison | Updated March 2018 Pulse Survey Percent Engaged Relative to Benchmark and 2017 Trend

  8. Physician – Employed Nemours Job Role Comparison Relative to Advisory Board Benchmark

More Related