600 likes | 621 Views
This presentation showcases outcome data from 60,000 EAP clients over a 3-year period, highlighting client improvement and productivity benefits. Learn how to collect and interpret outcome measures, assess EAP impact on workplace indicators, and use results to evaluate program initiatives. Traditional and new EAP value measures will be discussed, along with specific results in areas such as problem improvement, risk management, reduced absenteeism, and productivity improvement.
E N D
EAP Outcomes Demonstrate ValueEASNA Conference May 2004 Rick Selvik, LICSW, MBA, CEAP Diane Stephenson, Ph.D., CEAP Federal Occupational Health, Program Support Center, U.S. Department of Health and Human Services
Presentation Abstract • Outcome Data from 60,000 EAP clients • During a 3 Year Period • With Federal Occupational Health EAP • During pre- and post- clinical process • Results show client improvement • Large number and consistent findings • Support productivity benefits of EAP
Presentation Issues • Cost-effective methods to document value • Demonstrate value by more than anecdotes • Outcome measures assure quality service and demonstrate value • Keep the customer informed of EAP services and impact on health and productivity
Learning Objectives • How to collect outcome measures • How to interpret the results • How to assess EAP impact on key workplace indicators • How to use results to evaluate program initiatives such as telephone counseling
Traditional EAP Value Measures • Utilization • Demographics • Presented and Assessed Problems • Client satisfaction
New EAP Value Measures • Problem Improvement • Risk Management Results • Reduced Absenteeism • Productivity Improvement
U.S. Dept. of Health and Human Services, PSC, Federal Occupational Health (FOH) • EAP for 1.4 million Federal employees • Serving over 400 Federal agencies • Have over 150 counselors onsite nationwide • Nationwide affiliate network • Heavy demand for information and quarterly reports of activity
The Typical EAP Client (1) • Between 45 and 54 years of age (35%) • Married (50%) • Caucasian (67%), African American (20%), and Hispanic (10%) • Males (50%), Females (50%) • Worked for Organization 6 to 15 Years
The Typical EAP Client (2) • Self-Referred to EAP (60%), Management Referred (15%), Union Referred (2%) • Three to Four Sessions on Average • Address Problem in EAP (80%) • Others referred to community resources • Follow-up for up to a year • Four of five clients resolve in EAP
Health Status Questions • Health Outcomes Institute and InterStudy • John Ware of Johns Hopkins • Different versions: SF36 and HQ12 • We selected four of the questions • Asked at case opening and case closing
Outcome Measures Used • Productivity impacted by emotional problems, • Productivity impacted by physical health, • Improved work and social relationships, • Health status, • Job attendance/tardiness, and • Global assessment of functioning (GAF).
Question: Productivity – As Affected by Emotional Problems • ”During the past 4 weeks, to what extent have you accomplished less than you would like in your work or other daily activities as a result of emotional problems (such as feeling depressed or anxious)?” • The response options were: None at all (1), Slightly (2), Moderately (3), Quite a bit (4) and Extremely (5) • 73% reduction in cases in lowest two categories
Productivity – As Affected by Emotional Problems Results show shift towards no or fewer productivity problems after EAP services.
Question: Productivity – As Affected by Physical Health • ”During the past 4 weeks, how much difficulty did you have doing your work or other regular daily activities as a result of your physical health)?” • The response options were: None at all (1), A little bit (2), Moderately (3), Quite a bit (4) and Could not do daily work (5) • 66% reduction in cases in lowest two categories
Productivity – As Affected by Physical Health Results show shift towards no or fewer productivity problems after EAP services.
Question: Improved Work and Social Relationships • ”During the past 4 weeks, to what extent has your physical or emotional problems interfered with your normal social activities with family, friends, neighbors, or groups?” • The response options were: None at all (1), Slightly (2), Moderately (3), Quite a bit (4) and Extremely (5) • 77% reduction in cases in lowest two categories
Work and Social Relationships Results show shift towards no or fewer relationship problems after EAP services.
Question: Health Status • ”In general, would you say your health is:” • The response options were: Excellent (1), Very Good (2), Good (3), Fair (4) and Poor (5) • 31% reduction in cases in lowest two categories
Health Status Results show shift towards improved health status after EAP services.
Question: Attendance/Tardiness • “How many days have you been unexpectedly absent or tardy in the past 30 days?” • 62% drop in average lost time away from work for clients after using the EAP
Attendance/Tardiness Results show dramatic change in unscheduled attendance/tardiness occurrences after EAP services.
Question: Global Assessment of Functioning • The counselors assessed a client’s level of functioning using the Global Assessment of Functioning (GAF) Scale (American Psychiatric Association, 2000). • GAF scores can range from 1 to 100, with higher scores indicating better functioning. • 10% average improvement for clients, moving from a range of mild symptoms and difficulty in functioning to transient, slight symptoms and impairment levels
Global Assessment of Functioning Results show change in average GAF scores at case closing.
How to Present the Results to the Customer • Charts • Percent Improvement • Quarterly Reports • Trends
Outcomes for Different Types of Clients • By Assessed Problem Type • When Alcohol/Drug is the Primary Problem • By Gender • For Telephone Counseling Clients
Improved Outcomes by Gender N=11,746
Evaluation of • Telephone Counseling in an EAP • Criteria • Outcomes
Telephone Applications in Behavioral Health • Crisis counseling • Initial contact - information/education • Screening • Appointment scheduling • Management consultation
Telephone Applications in Behavioral Health • Assessment • Counseling • Support between face-to-face • Case management • Supervision • Follow-up • Evaluation
Other TC Outcomes Study Results • Texas A&M Study (Reese, 2000) • Clients report same level of relationship with counselor (telephone & face-to-face) • Convenience, cost, anonymity, control • U of IL Study (Schneider, 2000) • Telephone, face-to-face, videoteleconference, no treatment • Audio (telephone) & video provide similar outcome levels to face-to-face • Any modality better than no treatment • Comfort with audio & video increase over time
FOH Guidelines for Counseling by Telephone • Assessing Client Appropriateness • Client Request for Counseling by Telephone • Environment • Conducting the Initial Assessment • Conducting the Counseling • Documentation • Statement of Understanding Issues • Counselor State Licensed
Contraindications to Counseling by Telephone • Alcohol or other drug abuse • Management referrals • Risk of violence • Suicidal or homicidal • Marital, family, child • Serious psychopathology
FOH TC Evaluation Components (1) • Number of telephone cases • Length of counseling sessions • Rates of case assignment to affiliate counselors • Client satisfaction ratings on access to care • Client satisfaction ratings on services received
FOH TC Evaluation Components (2) • Outcomes ratings on productivity and absenteeism • Clinical outcome (GAF score) • Structured counselor feedback on their telephone cases • Anecdotal case information from counselors
Comparison Time Frame Analyses • Implementation Period – 6 months immediately after issuance of the structured TC guidelines • Comparison Period – the same 6 month period the year before
Outcomes – #s Using Telephone Counseling • Generally the same number of telephone cases and telephone sessions during the implementation period as compared with the comparison period.
Telephone and Face-to-Face Counseling Groups • Face-to-face counseling analyses • TC sessions were fewer than 50% of the total • Cases with no telephone sessions • Telephone counseling analyses • TC session were 50% or more of the total • Cases with any telephone sessions
Outcomes – Length of Sessions • Average length of telephonic session – 32.2 minutes • Average length of face-to-face session – 59.8 minutes
Outcomes – Affiliate Assignment • Reduction of 5.6% in affiliate case assignment
Outcomes – Client Satisfaction: Access To Care • Same outcome results for telephonic and face-to-face cases on client satisfaction with access to care
Outcomes – Client Satisfaction: Quality Of Services Received • Same outcome results for telephonic and face-to-face cases on client satisfaction with quality of services received
Outcomes – Absenteeism & Productivity • Similar outcomes for telephonic and face-to-face cases on: • Pre/post absenteeism/tardiness rates • Pre/post productivity measures
Outcomes – Clinical Functioning • Cases with any telephonic sessions showed a greater average improvement in GAF scores from the opening to the closing of the case (p=.05) compared with the face-to-face cases