390 likes | 495 Views
Work Life Balance External Evaluation > Report@Mar.11<. Mar.11. Agenda. 0. Background 1. Terms of Reference 2. Criteria , Scope & Framework 3. Maind Findings and Evaluation of Activities 4. Evaluation Summary Annexes. Agenda. 0. Background 1. Terms of Reference
E N D
Work Life Balance External Evaluation> Report@Mar.11< Mar.11
Agenda 0. Background 1. TermsofReference 2. Criteria, Scope & Framework 3. Maind Findings and Evaluation of Activities 4. EvaluationSummary Annexes
Agenda 0. Background 1. TermsofReference 2. Criteria, Scope & Framework 3. Maind Findings and Evaluation of Activities EvaluationSummary Annexes
0. Background • Work/Life Balance is a twinning (andongoing) projectthatemphasizes mutual learningand share ofpracticesbetweenNorwegianandPortugueseEntities. • It´s a multi-disciplinaryprojectwithseveraldimensions to relate. • The Drivers are anchoredin Macro (eg: Social Cohesion, Sustentability) and Micro factors (Motivation, Productivity, Health, etc) Public Policies Legal Framework Productivity Work Life Balance Organizations Workers Culture Motivation Motivation Sustainability Social Cohesion
Agenda 0. Background 1. TermsofReference 2. Criteria, Scope & Framework 3. Maind Findings and Evaluation of Activities EvaluationSummary NextSteps Annexes
1.0 Goals • Thisdocumentistheoutcomeof a balancingactbetweenexternalcontrolandsharedlearning. • Byobservingeffects, keyexpectationsaboutexternalevaluation are thefollowing: • Clarifytheachievementofaims • Measureofeffectivenessofactions • Ensuringqualityofthedeliverables • Sharedlearningbyreviewing original plans • Provideinformation to identifyfutureoptions • Promote mutual understandementandconsensus ExternalControl SharedLearning It´s a chance to veriifysetgoalsand to promoteanopen dialogue betweenpartners. • Thisdocumenthastwo major goals: (1) Verifiysetgoalsand (2) nurturesharedlearning
1.1 Team, Autonomy and Information • Thisdocument resumes anoverallapraisalloftheproject; It´sanoutsider´sviewbasedoninformation/evidences.
1.2 Type of Evaluation • Thisdocumentisthedeliverableofanexternalevaluationocurringalmostatthe final ofthe Project. Mid-termReport Apr. 11 Ago.2008 Nov.2010 Ex-ante End Ex-post You Are Here
Agenda 0. Background 1. TermsofReference 2. Criteria, Scope & Framework 3. Maind Findings and Evaluation of Activities 4. EvaluationSummary 5. NextSteps Annexes
2.0 Basis of Evaluation • A mixofquantitativeandqualitativeindicatorswasconsidered, includingdocumentationofevidencesandthedevelopmentof a satisfactionsurvey. • MethodologyKey-Points: • Sistematizationof Project Baselines(as statedinthebeginingofthe Project) • QuantitativeEvaluation(basedondocumentationofevidences) • % ConclusionofTasks; • % Indicatorsachieved • Tasks status(physicalexecution): Ontime; Onprogress • Partner´s Feedback (Web-Survey) • QualitativeEvalution • Web-platformfeaturesandusage • Project´sRiskMitigation • Partner´s Feedback (Web-Survey)
2.1 Framework • Framework to collectinformationandmakeassessmentofprogressbasedonfindings(quantitativeandqualitative). ExternalEvaluation Objectives Phases Activities InitialDefinitions Project BaselineandIndicators Methods to CollectInformation Achievements DeskReviewofDocuments Mainfindings vs. Deliverables Web usage Partner´sSurvey* Facts Web-Platform Partner´sSurvey Qualitative Assessment Quantitative Assessment Applyingdefiniedcriteria (seeScope) andmakeconclusions Criteria OverallEvaluation
2.2 Criteria Thescope for theevaluationisbasedonthefollowingcriteria: Efficiency Compares the use ofresourceswiththeachievedresultsIttakesinconsiderationPhysicalExecutionoftheproject, namely: % conclusionoftasksandon-timeexecution. Theextent to which a projecthasachievedits objectives Evaluatesoutcomes, riskmitigationactionsandoverallsatisfaction rate. Effectiveness Long-termefectsoftheprojectbeyondit´simmediatesphereofresponsibility Impact Inwhatextenttheprojectmettheexistingneedsandproritiesofthetargetgroups/beneficiaries(are wedoingtherightthings?) Relevance Ifthechangessetinmotioncanbecontinuedandfurtherdevelopedoverthelongterm Sustainability
Agenda 0. Background 1. TermsofReference 2. Criteria, Scope & Framework 3. MainFindingsandEvaluationofActivities EvaluationSummary NextSteps Annexes
3.0 Project Evaluation Summary Project activitieswereplannedfrom 2008 to2011. 2008.Aug 2009 2010 2011.Apr Mar.09 1. Comparative & GapAnalysis Dec.10 2. TwiningDevelopmentPlans 3.1 Field Mission #1 3.2 Field Mission #2 3.3 Field Mission #3 3.4 Field Mission #4 Oct.10 4. Web Platform Apr.11 5. CommunicationNetwork Apr.11 6. Marketing Dissemination Estimated Dates (beginingoftheproject)
3.1 Activity #1 #1 ComparativeAnalysis & GapSituation MainFindings • Initialdeadlinewasextendeddue to finantialconstraintsbutwasreported as finishedsince Feb.09. • Reportswereproducedandshared as planned. • A Strategyof Unilateral Learningwaschanged to a MultiLateralLearningStrategy
3.1 Activity #1 #1 ComparativeAnalysis & GapSituation • Thephysicalexecutionofthisactivityendedwithout major contrainsts. • Therewasreported a delayinthe Micro Reportwithoutaffectingoutcomeseffectiveness. • Riskmitigationaboutreprogrammingofstrategywasreportedtowards mutual learningapproach.
3.1 Activity #2 #2 TwiningDevelopmentPlanImplementation MainFindings • Progressreportsidentifiedsamedelaysintermsofactivitiesresults; as thestrateychanged, therewas some impactinthisphase. • TwiningPlansand a “HeatMap” Analysisweredevelopedandpresented to Partners (during 2nd FieldMission). • 30 Actionswerepresented as “Short-termWins”; 8 selected to beimplemented as priorities
3.1 Activity #2 #2 TwiningDevelopmentPlanImplementation • Thephysicalexecutionofthisactivitywasacomplish
3.1 Activity #3 #3 TwiningStudyVisits MainFindings • Project had to managebudgetdelaysbutitwaspossible to makestudyvisits; Therewere some externalevents (Islandvulcanicactivity) thatchangedinitialprogramming. • 1st Visit (Ne):Therewereproducedreportsaboutpractices (ex: eGov). • 2nd Visit (Pt): Therewaspresented a HeatMap” analysisandselectionof top 30 measures to beimplementedin a “short-termwins” approach.
3.1 Activity #3 #3 TwiningStudyVisits • Thephysicalexecutionofthisactivityreported some delaysbutthe objectives setwereacomplished • Thedecisionsneededandlearningexpectationswerereported as achieved
3.1 Activity #4 #4 Web Space&WebPlatform MainFindings • Therewasreportedthat portal userssurpassedthenumberforseeninitially – currentlythere are 50 usersofSakaiPlatform. • Wehadconsultedtheproject site (public + collaborativeareas) andcouldappreciatecollaborativefeatures online and download projectdocuments • Share ofpraticesonthewebPlaformisanongoingprocess.
3.1 Activity #4 #4 Web Space&WebPlatform • Thephysicalexecutionofthisactivityreported some initialdelaysbutweresurprassed. • Theoutcomeswereachievedand Web platformissupportingtheongoingcollaborativetasks
3.1 Activity #5 #5 CommunitiesNetwork & Sustainability • Until Jun.09 thisactivitydidn´treportsignificantprogress – due to finantialconstraints • Therewasreportedthat 7 Municipalities are willing to bepartoftheCommunity. • Meetingswereconcludedandprotocols are beingsigned. MainFindings
3.1 Activity #5 #5 CommunitiesNetwork & Sustainability • Thephysicalexecutionofthisactivityreported some delays • A convergente viewoftheprotocols/aggreements to besignedwithdifferenteentitiesis a challenge • Thisactivity continues
3.1 Activity #6 #6 PublictyandInformationCampaign MainFindings • Some outcomesweredelayedfrom Nov.09 to 2010 due to finantialcontraintsandvisitdelays • Marketing materialswereproducedand a conferenceat UCP/Portugal washeld – and are publishedonthw Web Platform • Riskmitigationwaseffective for thephysicalabsenceofNorwegianPartners (Icelandvolcano)
3.1 Activity #6 #6 PublictyandInformationCampaign • Thephysicalexecutionofthisactivitystill continues (e.g. 2nd Conference) • 1st Conferencewasheldin Portugal; VideowithNorwegianPartnerswasdelivered (seeRiskMitigation) • Mktmaterialswereproduced as expectedandMktcampaignwillfollow
3.1 Activity #7 #7 RiskMitigation • There were Risks initially identifiable; others emerged I. Risks Antecipated* (and Risk Mitigation Actions) • Training as staff from Partners left… New employees receive information H • As Partners with different Backgrounds (e.g. Legal), achieving agreements is not always easy - Roles and responsibilities defined and Flexibility • As Difficulties establishing communication and action platforms - One NE partnerleftthe Project; KS introducedanotherentity M Impact L H L M * Not exaustive Likelyhood
3.1 Activity #7 #7 RiskMitigation • There were Risks initially identifiable; others emerged II. Risks Emerged (and Risk Mitigation Actions) • Differentoperationalrealities vs. assumptions - Mutual learningapproachinsteadof a coaching (unilateral) setting H • € difficultiesfromdelaysinreimbursementofexpenses - Delaysinsupplierspayments; PostponeofFieldMissionsandactitivies • Local electionschangeddominantpoliticalparties- Meetingswithnewelected local authorities M Impact • Iceland Volcano - FieldMissionwaspostponed; ConferenceparticipationofNorwegianPartnersbyVideo • Some NE entitieswerenottotallyconfortablewiththeprotocols- Textofprotocolswaschanged L H L M Effects after Mitigation
Agenda 0. Background 1. TermsofReference 2. Criteria, Scope & Framework 3. Maind Findings and Evaluation of Activities 4. EvaluationSummary Annexes
4.1 Evaluation Summary Progressreported YTD. • Physical execution of activities is controlled; There were reported delays related with Activity #3 (Twinning visits) but the outcomes were assured; • At Activity #2 (Plans) there was a small initial delay that was suppressed; • Nevertheless the quality/quantity of the outcomes were achieved as expected; • Activity #5 and 6 are ongoing • Risks were managed well – sometimes dealing with extraordinary events; some ofthemwerewellmitigatedandothersnotpossible to do sowithoutoperationalimpacts(e.g. delaysofreimbursementpayments). • Globally, Efficiency & Effectiveness criteria are being well achieved.
4.2 Partner´s Evaluation Summary QualitativeEvaluation 54% 67% 64% 66% 71%
Agenda 0. Background 1. TermsofReference 2. Criteria, Scope & Framework 3. Maind Findings and Evaluation of Activities EvaluationSummary NextSteps Annexes
Annex - Partner´s Evaluation (1/6) • Impact 54%
Annex - Partner´s Evaluation (2/6) • Relevance 67%
Annex - Partner´s Evaluation (3/6) • Sustainability 64%
Annex - Partner´s Evaluation (4/6) • Satisfaction 67%
Annex - Partner´s Evaluation (5/6) • Collaboration 71%
Annex - Partner´s Evaluation (6/6) • Overall
Theend – • Mar.11