1 / 21

Common Indicators:

Common Indicators:. Transforming the Culture of Evaluation in Career and Employment Services Saskatchewan Abilities Council Saskatchewan Education, Employment and Labour New Brunswick Post-Secondary Training, Education and Labour Canadian Career Development Foundation (CCDF)

paniz
Download Presentation

Common Indicators:

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Common Indicators: Transforming the Culture of Evaluation in Career and Employment Services Saskatchewan Abilities Council Saskatchewan Education, Employment and Labour New Brunswick Post-Secondary Training, Education and Labour Canadian Career Development Foundation (CCDF) Goss-Gilroy Inc. Canadian Research Working Group on Evidence Based Practice in Career Development (CRWG)

  2. Research Team • CCDF: Lynne Bezanson & Céline Renald • Dave Redekopp, Life-Role Development Group • Guylaine Michaud, Universitéde Sherbrooke • Ken Organ, Goss-Gilroy • Provincial Partners • Managers and Practitioners • Clients: all who agree to participate; no criteria except not one-off’s

  3. U Name It Structure InputProcessOutcome • Activities to promote positive change • Generic interventions • Working alliance, client engagement • Specific interventions and progress in: • Job Readiness • Career Decision Making • Skill Enhancement • Work Search • Work Maintenance • Life Circumstances • The support you provide and progress in personal attributes: • self-esteem, self efficacy, well-being, self confidence, self-awareness) • Resources available • Staff: Number of staff, level of training, type of training • Funding: Budget • Agency mandate • Community resources • Access to Employment Opportunities and Training • Client Employment History • Client Life Circumstances • Indicators of client change • Learning outcomes • Knowledge and skills linked to intervention • Personal attribute outcomes • Changes in self-esteem, self efficacy, well-being, self confidence, self-awareness) • Impact outcomes • Impact of #1 & #2 on client’s life, e.g., employment status, training status, quality, fit, standard of livinga

  4. Research Questions • What common indicators are applicable across different client contexts, different client groups, different agencies, and different interventions? • What statements can be made about service effectiveness by tracking common indicators of inputs, processes and outcomes? If numbers permit, it will be possible to aggregate data to begin to address the ultimate question, “What kinds of interventions in what contexts produce what kinds of outcomes?”

  5. Input • LABOUR MARKET REALITIES: Catchment Area Profile • Local labour market opportunities – what is the quality and range of work opportunities? • Educational opportunities – easily accessible or not? • Community supports/resources – adequate? accessible? • CLIENT REALITIES: Client Employment Potential (demographic info) • Work experience • Level of education • Language • Health factors • Other

  6. Input • PRACTITIONER PROFILE • Age • Gender • Experience • Education/Training • SERVICES OFFERED BY YOUR OFFICE • Provided by managers

  7. Process • Build & Maintain Working Alliance with Client • Conduct Employability Needs Assessment • 5 Employability Dimensions and Additional Life Circumstances • Develop and Update Action Plan • Interventions (throughout 6 weeks) • Track Client Progress (as appropriate throughout 6 weeks)

  8. Employability Dimensions • PRE-EMPLOYABILITY/JOB READINESS: Has the intention to seek employment and/or enter training but faces challenges, vulnerabilities and/or skill deficits that need to be addressed before the client can be successful in achieving employment/training goals • CAREER DECISION MAKING: Not yet clear about work/learning goals; needs to understand personal skills, interest, values and personality and more about different potential occupations in order to develop a vision for a preferred future • SKILLS ENHANCEMENT: Has career goal, but needs to explore skills and qualifications needed for the work they want and how to acquire them • WORK SEARCH: Has career goal and necessary skills/qualifications for desired work; needs skills, strategies and tools necessary to conduct a successful job search • EMPLOYMENT MAINTENANCE: Has difficulty keeping work or may need to work on the skills/attitudes required for success at work • OTHER: Many circumstances beyond those covered by the employability dimensions may impact on the client’s employability outcomes. Some of these life circumstances may necessitate referral outside of career and employment services. Life circumstance issues may need to be addressed and resolved before progress toward employment can realistically be made.

  9. Client Progress Indicators • Employability Needs • 5 Employability Dimensions • Additional Life Circumstances • Personal Attributes Needs/Working Alliance • Self-management, self-esteem, well-being, self-efficacy, self-awareness • Working alliance • Client engagement • Labour Market Indicators • Tailored to client status

  10. Life Circumstances

  11. Personal Attributes Example

  12. Self-Esteem Attribute

  13. Outcome Indicators • Employability Needs • 5 Employability Dimensions • Additional Life Circumstances • Personal Attributes Needs/Working Alliance • Self-management, self-esteem, well-being, self-efficacy, self-awareness • Working alliance • Client engagement • Labour Market Indicators • Tailored to client status • quality and “fit” of employment or education/training, salary, location

  14. What We Hope/Expect to Say • Input & Outcome Connections • More educated clients do better than less educated clients • Success is positively related to labour market attachment • “No Barrier” clients do better than “Single Barrier” clients who do better than “Multiple Barrier” clients • Success is positively related to entry self-efficacy • Success is positively related to entry self-esteem

  15. What We Hope/Expect to Say (cont’d) • Outcomes and Processes • Learning Outcomes • Client skill/knowledge increases with any intervention • Personal Attribute Outcomes • Client attributes improve with any intervention • Client self-esteem improves with any intervention • Client self-efficacy improves with any intervention • Labour Market Outcomes • Employment/training increases with any intervention • Quality/fit increases with any intervention • Working alliance is positively related to employment/ training outcomes

  16. What We Hope/Expect to Say (cont’d) • Relationships between Outcomes • Learning outcomes are positively related to: • personal attribute outcomes • labour market outcomes • Personal attribute outcomes are positively related to labour market outcomes • Personal Attribute Outcomes & Processes • Working alliance is positively related to self-efficacy changes • Working alliance is positively related to self-esteem changes

  17. What We Hope/Expect to Say (cont’d) • Learning Outcomes & Processes • Client skill/knowledge increases are positively correlated with working alliance • Measurement Relationships • Practitioner and client assessments of working alliance are positively related • Practitioner assessment of personal attributes is positively related to client self-esteem scores • Practitioner assessment of personal attributes is positively related to client self-efficacy scores

  18. U Name It Structure InputProcessOutcome • Activities to promote positive change • Generic interventions • Working alliance, client engagement • Specific interventions and progress in: • Job Readiness • Career Decision Making • Skill Enhancement • Work Search • Work Maintenance • Life Circumstances • The support you provide and progress in personal attributes: • self-esteem, self efficacy, well-being, self confidence, self-awareness) • Resources available • Staff: Number of staff, level of training, type of training • Funding: Budget • Agency mandate • Community resources • Access to Employment Opportunities and Training • Client Employment History • Client Life Circumstances • Indicators of client change • Learning outcomes • Knowledge and skills linked to intervention • Personal attribute outcomes • Changes in self-esteem, self efficacy, well-being, self confidence, self-awareness) • Impact outcomes • Impact of #1 & #2 on client’s life, e.g., employment status, training status, quality, fit, standard of livinga

  19. Where “U-Name-It” is headed… • More evidence for the field to justify the power and efficacy of career interventions • More integrity around outcomes • A culture of evaluation built into career and employment service practice • Over time, the ability to answer: • “What kinds of interventions in what contexts produce what kinds of outcomes”

  20. To follow the study: Research Reports will be completed by May 31, 2013 Follow the CRWG website at: www.crwg-gdrc.ca Thank You

More Related