1 / 34

Investigating the Impact of LMI

Investigating the Impact of LMI. Research Team Réginald Savard , Sylvain Paquette, Céline Renald and Lynne Bezanson in collaboration with Bryan Hiebert Canadian Career Development Foundation (CCDF) Canadian Research Working Group in Evidence-Based Practice (CRWG)

helga
Download Presentation

Investigating the Impact of LMI

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Investigating the Impact of LMI Research Team RéginaldSavard, Sylvain Paquette, Céline Renald and Lynne Bezanson in collaboration with Bryan Hiebert Canadian Career DevelopmentFoundation (CCDF) Canadian ResearchWorking Group in Evidence-Based Practice (CRWG) In partnershipwith New Brunswick Post-Secondary, Education and Labour

  2. Outline • Review of foundations for the study • Principal findings • Summary of results

  3. Review of the Problem • Most researchon LMI focuses on usability of products: • Readability, accuracy of information • Ease of access, amount of use • Most researchiswithstudents: verylittlewithadults • Littleliterature about the direct contribution of LMI • Savard, R., Michaud, G., Bilodeau, C. et Arseneau, S. (2007). L’effet de l’information sur le marché du travail sur le processus décisionnel relatif au choix de carrière. Revue Canadienne de Counseling, 41(3), 158-172. • Several questions remainunanswered • How do people use LMI? • What (if any) assistance wouldbehelpful?

  4. Research Questions • If client needs are assesed and clients are given LMI consistent withtheirneeds: • to whatextentdoes assistance by a service provider enhancetheir effective use of LMI? • and • to whatextentisindependent self-help a sufficientprocess for clients to use LMI effectively?

  5. Review of foundations for the study • The studywilltake place withincurrentservice delivery practices in the employment centres • sothatprocessescanbeincorporatedintodaily practice if researchresultsprove positive. • Career practitioners and clients willwork in theircustomary settings • LMI interventions willbeisolated • LMI is a distinct intervention, separatefromemploymentcounselling or worksearch workshops in which LMI maybe a component • There willbeseparate LMI interventions for careerdecisionmaking and for job search

  6. Procedures followed for the francophone sample • Translation of LMI Booklets (client and resource centre) • Career DecisionMaking (2) • WorkSearch (2) • Field testing • Duration: 4 weeks • Semi-structured interviews with clients • 1 week and 4 monthsafterentering the research • Semi-structuredinterviews withresearchpartners (careerpractitioners, managers) • severalweeksafter the end of the research

  7. Être apte au travail Initial Contact: EmployabilityAssessesment Interview Croissance professionnelle Choix de carrière • Career DecisionMaking • WorkSearch Dimensions de l’employabilité Développement de compétences Maintien en emploi Recherche d’emploi

  8. Description of LMI Intervention 4 weeks of intervention • Using the LMI bookletsaccording to theiridentifiedneed in • Career DecisionMaking or • WorkSearch • Method of using LMI booklets: • Independent • Assisted • Information and advicefollow-up interviews (2) week one and andweek 3 Career DecisionMakingKnow yourselfKnow the labour market Arrive at a goal and develop an action plan WorkSearchCheck for « fit » Getready Search for work Secure employment

  9. Client Sample • 52 clients between18 and 56 years of age (average = 37 years) • 25 men and 27 women • 83 % had at least a secondaryschooldiploma • The majorityworked in industry (eg.: seasonalworkers, labourers) • 81 % of clients wereunemployed : 19 % were in full or part time employment

  10. Career PractitionerSample • 15 careerpractitioners • 3 men and12 women • Number of clients per careerpractitioner • Average = 3,47 (median = 3,87), range: between1 – 13. • Between1 and 3 clients = 12 • Between 4 and 6 clients = 0 • More than7 clients = 3

  11. Methodology • Post-pre self-assessment • At the beginning of an intervention, people do not always know whatthey do not know….so thereis a tendency to over or under-estimate ….. « Knowingwhatyou know now (havingcompleted the intervention), how wouldyou rate yourknowledgewhenyouentered the research and how wouldyou rate yourknowledgenow?» • Dependentmeasures • Knowledge of LMI • Ability to use LMI • Personalattributes (confidence and optimism)

  12. Principal Findings • Clients on averagedemonstratedsignificantincreasesregardless of the methodused (independent or assisted) • Clients in the assisted group demonstratedgreaterincreases over time than the independent group. • Assisted clients in the careerdecisionmaking group demonstratedgreaterincreasesthan the otherthreesub-groups • Independent careerdecisionmaking • Assistedcareerdecisionmaking • Independent worksearch • Assistedworksearch 4 sub-groups

  13. First Major Finding • Clients demonstrated on averagesignificantincreasesregardless of method of intervention (assisted or independent) • Betweenpre and post intervention: • Overallability to access and use LMI improved: • Knowledgere how to use LMI • Abilities to use LMI and to take action based on LMI • Personalattributes: optimism, self-confidence and by inference, motivation

  14. Sample of Results: Post-prequestionnnaire 6/14 items NON Sur ces 6 items (Connaissances = 1, 2, 3, 5; Compétences = 4; Attributs personnels = 6) 0) Ne s’applique pas du tout Ne s’applique pas du tout, mais presque S’applique, mais tout juste bien La réponse se situe entre tout juste bien et parfaitement bien S’applique parfaitement

  15. Descriptive Results – POST-PRE Considering all 14 items in the questionnaire

  16. Descriptive Results– POST-PRE • All the mean scores on the Before Intervention responseswere in the Not OK range [0,1], with 1 exception (2,23). • All the mean scores After the Intervention , without exception, were in the very OK or perfectly OK range [score average 3 or more]. • The amount of change wassimilaracross all dimensions of the survey • Wefound the samedegreeof change for knowledge, abilities and personalcharacteristics.

  17. Second Major Finding • Clients whowereassisted by a careerpractitionerdemonstratedgreater change with time

  18. Results Overall Score • Significantimprovement in overallability to use LMI betweenBefore and After • Theseresultswere consistent in all subscales (knowledge, abilities, personalattributes) 14 items Post-Pre For the group as a whole:

  19. Second Major Finding • Assisted clients showedincreasedlevels of change over time • Wecanconsiderthathavinghadtwo information and advicefollow-up interviews, althoughbrief, allowedassisted clients to state after the intervention, greater gains in knowledge and skillrelated to LMI as well as gains in confidence and optimismwith respect to theircareer futures.

  20. Information and Advice Interviews • Two interviews of 20-30 minutes each • Three key steps in Information and Advice interviews: • Re-establish the helping alliance and review the objective and action plan agreed to • Giveadvice and information related to client use of LMI as appropriate for client need • Come to agreement on nextsteps to move client action plan forward • All Career practitionersreportedfollowingthese 3 steps • Importance wasgiven to the helping alliance and to agreeing on the nextsteps to befollowed • Career practitionersused the second step to specificallyrespond to the information and action needs of the clients

  21. Third Major Finding • Assisted clients in Career DecisionMakingreported the highest gains among the four groups • Career DecisionMaking (independent) • Career DecisionMaking (assisted) • WorkSearch (independent) • WorkSearch (assisted)

  22. Resultsshowingboth the two types of intervention and the twomethods F

  23. Career DecisionMaking (assisted) (SuggestedInterpretation) • The unique position of clients who are trying to clarify a career direction maypromote the asking of clarification questions whichcouldincrease the impact of an LMI intervention (Imel, Kerka et Wonacott, 2001)  • The advicegiven and the individual assistance may have resulted in an increase in the effectiveness of LMI for the individual(Brown et Ryan Krane, 2000) • « The impact of the help of a careerpractitionerworkingwith LMI and workingdirectlywith a client trying to makecareer planning decisionsappears to be an important finding» (Savard, Michaud, Bilodeau et Arseneau, 2007, p. 163).

  24. OtherResults • No significantdifferences for: • Gender • Men and womenrespondedsimilarly to bothmethods of workingwith LMI • Age • Employmenthistory • Unemploymenthistory

  25. Attribution of change • To whatextentwouldyousaythat the changes youreportedbefore and after the intervention were the result of your participation in the research?

  26. Attribution of change • 50 % of clients attributedtheir change to participating in the LMI research and not to otherfactors; 48 % attributedtheir change partially to their participation • Overallthereappear to be no significantdifferences in the results of the anglophone and francophone sampleswith the exception thatassisted francophone clients reportedincreased gains over the anglophone clients althoughboth groups reportedmore positive change in the assisted condition.

  27. Client Engagement (client trackingsheets) • Clients wereveryengaged in workingwith the LMI packages • Clients accessedbetween 4 and 20 distinct LMI resources and made use of thesebetween 7 and 148 times. • On average clients accessedbetween 4 to 7 LMI resources; careerdecisionmaking clients accessed on average 19 resources and worksearch clients accessed on average 18 resources. • Most frequentlyusedresources • Career DecisionMaking • CareerCruising(95 %) • LMI Booklets (87 %) • Travailler au Canada (87 %) • WorkSearch • LMI Booklets (90 %) • CareerCruising(65 %)

  28. General Commentsfrom clients • Increase in confidence • I doubtedthat I wouldbenefitfrom the studybased on pastexperience but I became more certain and confident in myownability to findwhat I needed. (214) • Better self awareness and knowledge of possible careers • It wasveryuseful to understandmyselfbetter and use this as a basis for searching for possibilities and makingchoices. (241) • Overall a positive experience • The studyhelpedwithknowingwhat direction to go in and I am sure that I have benefited a lot. I am more confident and pleased to have participated. (231) • This allowed me to get more clear. I think I can continue to use this information as I face future changes. (217)

  29. Client Criticisms • The program needed to be longer given the number of resourcesavailable. (222) • All the information I neededwasavailable but I could not takeitwith me. It would have been better to have it all instead of having to go the the Resource Centre. […]. Working full time made itvery hard […]. With a little more help itwould have been mucheasier(242)

  30. Client Criticisms • There wastoomuch information and that made making a careerdecision more difficult […] very hard to do thisalone(209) • The information in the bookletswastoobroad for myregion […]. This coulddiscourage certain people (252) • I feel I am at the same point at the end of the study(237)

  31. Follow up interviews (1 week and 4 monthsafter intervention) • Week 1: 39 clients (75% of original sample) • 4 months: 27 clients (52% of original sample) • LMI overall relevant • Clients overalloptimistic and confident • Clients continued to use LMI but lessoften

  32. Follow up Interviews • Most useful aspects of LMI: • Self-knowledge • Job search techniques • Overallweakness in service delivery: • Action Planning

  33. Follow-up interviews • Most commonconcerns: • « toomuch» information • Lack of computer skills • Lack of practitioner assistance especially: • Connecting self knowledge to world of work • Addressingemploymentbarriers (confusion, disappointment)

  34. For more information Réginald Savard, professeur et co-chercheur Reginald.Savard@USherbrooke.ca Paquette, professionnel de recherche Sylvain.Paquette@USherbrooke.ca Lynne Bezanson, CCDF, l.bezanson@ccdf.ca Site du GRDC <http://www.crwg-gdrc.ca

More Related