120 likes | 271 Views
MASS Project Evaluation Annie Paton. anne@indigops.com. Agenda. Indigo Background Overall Evaluation Format Internal Evaluation Topics Evaluation Focus & Objectives Baseline & Monitoring Information. Indigo Background. MASS application development & evaluation
E N D
MASS Project EvaluationAnnie Paton anne@indigops.com
Agenda • Indigo Background • Overall Evaluation Format • Internal Evaluation Topics • Evaluation Focus & Objectives • Baseline & Monitoring Information
Indigo Background • MASS application development & evaluation • Local authorities, colleges, charities • European Funding • ESF, ERDF, Interreg, LLP • High success rate • Project Management, Monitoring & Evaluation • Other Services • Varied experience • Evaluation • £16.5 million projects • ESF, ERDF, LLP, Lottery & government funding • Transnational (A1 for Jobs, Leonardo) • Target group (ESF – LTP – Disengaged school children)
Format • Interim Report • August 2010 • Report on progress • Adhering to timescales & milestones • Any barriers to success • Final Report • September 2011 • Draw conclusions on design, implementation & success • Inform stakeholders of results & impact • Stimulate support for mainstreaming • Identify further innovation
Internal/Self Evaluation • Simona (RO) • Self evaluation feeds into external • Communication • Effectiveness, frequency, methods, barriers • Twice, middle & end (online survey)/ observation • Partnership Meetings • Effectiveness, structure, content, cultural aspects • Learn & adapt • Short post meeting questionnaire • Team working • Involvement, motivation & commitment • Partner level
Topics Leonardo Other topics • Innovation * • Validity * • Dissemination * • Valorisation * • Transnationality • Partnership • Design & Methodology • Project Management & Delivery • Feasibility of Products • Progress
Focus • Project Aim 1 – To enable professionals in Greece, Sweden, Netherlands & Romania to understand the need/value of adapting VET systems in a shift towards learning outcomes.... • Project Aim 3 – Ensuring the professionals have the competencies to deliver VET to disaffected groups which is meaningful and conducive to learning and employment outcomes.... • Dissemination & Valorisation of results
Project Aim 1 • Evaluation Objectives • How feasible is use of EQF to map soft skills at partner level? • Is the value of soft skills within VET in partner countries relevant and recognised? • How effective are the materials and tools for assessment within classroom context? • Methodologies • Benchmarking (desk research/ consultation) • Partner questionnaire (PM level & tutor level) • Analysis of progress of relevant work packages/documentation review
Project Aim 3 • Evaluation Objectives • What is the impact of the methodologies used in the piloting on disaffected learners? • How do the outcomes for the group compare with that of the outcomes in the past? • Do learners find the tools easy to use? • Do the materials meet the requirements of trainers/tutors? • Is there evidence to support employment outcomes for the group?
Project Aim 3 • Evaluation Methodologies • Consultation with piloters (twice, mid point & end) • Consultation with tutors (twice, mid point & end) • Analysis of outcomes for piloters • Comparative analysis with past outcomes • Limited budget, best way for each partner, questionnaire or telephone interviews.
Baseline Information & Monitoring • Understand current situation • Current learning & employment outcomes for learners • Control group for comparison • How do you monitor learners? • How do you monitor tutors & teachers? • Use of English
Next Steps.... • Formalise the framework – Annie • Produce a time plan - Annie • Send baseline survey - Annie • Keep in touch......All