RETROSTEM – Using retro gaming consoles to revive hands on play and promote STEM

1. RETROSTEM – Using retro gaming consoles to revive hands on play and promote STEM Quality Assurance Strategy Kick off Meeting 30-31st October 2018 1

2. Quality Assurance and Evaluation Plan (QAEP) • It describes the scope and objectives of the quality management within the project. • It defines the fields of evaluation, the methods and the quality indicators are defined and • It specifies the monitoring as well as evaluation tools • It sets the timing of the evaluation and monitoring process 2

3. Objectives of QAE Plan • To ensure the quality of the work • To define roles and responsibilities • To define the scheduling of tasks and activities within each stage of the project life cycle • To show how risks, changes and problems can be identified and reported • To define the content, format, sign-off, and responsibilities for each product / I.O. • To provide the quality authorities with information that will allow them to organise quality assurance and quality control activities • To state all the participants, procedures, rules and applicable methods of the project. 3

4. What does the QAE Plan include? • Quality Assurance process • Communication and management related activities and tools • Measurement, analysis and review • Evaluation methods • Quality indicators of achievement • Risk and contingency plan 4

5. Project and organisational structure The QAE Plan will define the role and tasks of the: • Project management team: • Project manager • Project partner coordinator • Intellectual Output Leader • Dissemination manager • Quality Manager • Steering committee 5

6. Communication and Management The QAE Plan will define the: Communication Tools • AdminProject.eu • Emails • Skype • Meetings • Telephone Management Tool through AdminProject.eu It will be used as: • A repository for all the project documentation • A Management Tool for controlling project progress • A Communication Tool • QA evaluation and monitoring tool (tracking, checking communication flow, extracting reports etc.) 6

7. Quality and Evaluation Plan The Quality Plan aims to measure the quality of each project activity: A. Management • 1. Meetings • 2. Communication/Collaboration • 3. Reports – Budget B. IOs - Products • 1. Development/Progress • 2. Implementation/Pilot testing • 3. Output C. C1- Short-term joint staff Training Events D. Dissemination activities • 1. Multiplier Events • 2. Social Media E. Risks F. Sustainability /Impact 7

8. What tools, methods and activities will be used? • Evaluation of Questionnaires/ Forms • Attendance list • Google Analytics • Admin tool • Dissemination Logs • Quality Assurance and Evaluation Reports • Progress Reports • Feedback from participants 8

9. A. Management Meetings Indicators: • Number of meetings – minutes • Qualitative self and peer assessment on personal and organisational needs • Qualitative evaluation: questionnaires for evaluation of communication, working climate, fulfilment of objectives, general climate, team cohesion, etc. • Number of documents for each meeting: agenda, etc. 9

10. A. Template for evaluating meetings 10

11. A. Management- Communication and Collaboration The achievement of high quality standards in the various stages of the project will be promoted through close: • collaboration • frequent communication • hard work Indicators: • Compliance with deadlines • Compliance with the leading role and tasks of partners for each activity • Participation in Admin Tool • Use of other tools: Facebook, Twitter, project website • Upload of partner’s material, outputs, reports, activities, events • Self and peer evaluation after the completion of each output or event 11

12. A. Management & Collaboration Template 12

13. A. Management Reports Indicators: • Number and frequency of internal reports to monitor the progress • Dissemination • Quality • Financial • External reports (National Agency) • Interim • Progress • Final • Budget • Efficient use of approved budget and allocation of resources 13

14. A. Reporting deadlines based on Partner Agreement 14

15. A. Dissemination Template 15

16. A. Financial Template - Timesheets 16

17. B. Intellectual Outputs - Products Indicators (internal): • Number of IOs developed • Number of participants during the pilot testing • Partners’ plan for implementation at national/local level • Usage of outputs Review on: • Process of collecting and analyzing the data • Process of the IO report • The value of the content based on the project requirements • Overall quality of the IO report 17

18. B. Intellectual Outputs - Products Indicators (external): • Number of participants • School educators/Teachers • Number of participants of the “RETROSTEM Academy.” • Number – involvement of Associate Partners • Recognition of the Badge by related authorities, public and private bodies, etc. 18

19. B. IOs - Development Process 19

20. B. Examples – Benchmarks to ensure the Quality of the IOs 20

21. IOs- Output • RETROSTEM Consoles, Educational Guide and Curriculum • RETROSTEM Learning Motivation Environment and DIY Kits 21

22. C. C1- Short-term joint staff Training Events The quality of the trainers workshop for: • The RETROSTEM Curriculum (O1/A3). • The Learning Motivation Environment in all project languages with the skills and achievements recognition framework (O2/A5). • The DIY kits to complement and enhance the teaching experience (O2/A1). • The RETROSTEM Academy virtual space with supporting infrastructure (A4). 22

23. D. Dissemination Activities and Multiplier Events Indicators: • Number events: number of participants, category of participants • Number of informative materials: flyers, brochures, etc. • Number of organisational reports on activities and events • Feedback from participants: number of signatures collected from petition, participation and interactivity in discussions, workshops, etc. • Qualitative evaluation: suggestions from the participants • Number of related institutions and individuals outreached through the dissemination and exploitation activities 23

24. Evaluation Form - Template • To be defined in cooperation with the Dissemination Manager 24

25. E. Handling Risks Execution of Quality Assurance Activities The main objective of this step is to identify and solve every problem, shortfall or fragmentation appears during the development of each deliverable • Risk Assessment MATRIX Identify the probable risks in terms of the probability of the risk and the severity of the consequences • Application of Corrective Measures Every shortfall identified will be immediately corrected. In order to avoid repetition, the cause of each shortfall will be always identified 25

26. E. Risks Assessment MATRIX 26

27. E. Risks and Mitigation Strategies 27

28. E. Risk Assessment - Example Individual Description: Dropout of those involved in the planned activities Probability: Occasional Severity: Critical Mitigation Strategies: • Strong campaign for raising awareness and promotion of the project • Provide motives and incentives such as Euro/Youthpass and Certificates, links to the labour market RISK = Serious 28

29. F. Sustainability Indicators: • Portal Usage Statistics • Number of visits at the online environment • Number of downloads of the material and the applications • Level of stratification of participants through assessments and evaluation rubrics • Number of annual visits on the online environment after the project's lifetime 29

30. F. Impact The dissemination plan described, will guide the elaboration of the projects specific activities for achieving the desired impact on the target groups and define measurements and indicators. The two most important indicators with respect to achieving the desired impact at all levels are considered: • The proportions of the RETROSTEM Network facilitated by the Academy at the end of the project. • Invitations to participate in EU platforms collaborating on educational technology, game based learning, robotics, STEM. 30

31. F. Impact indicators – Qualitative and Quantitative • Qualitative: • Project partners will monitor this process by accessing the Academy website and consulting the usage reports • Past users will be interviewed • Teachers will have the option to provide feedback • Other qualitative indicators comprise overall satisfaction of : • - project partners about project implementation, progress and results • - partner staff after project meetings • - participants in the multiplier events • - participants about the training modules and material. • An evaluation questionnaire will be developed in order to collect the evaluation data and all participants in pilot training will be asked to participate in the evaluation. • Quantitative Measurement: • The project impact will be measured from a quantitative point of view: • • 180+ individuals and trainers attending the validation workshops in total in the countries of the partnership • • at least 80% positive results in the overall evaluation of the training experience • • at least 80% positive results in the overall evaluation of the RETROSTEM console • • at least 90% positive results regarding the overall experience with the workshop, curriculum and infrastructure. • • at least 45 participants per country attending each multiplier event and at least 3500 stakeholders reached at the end of the project through newsletters and publicity material. • • at least 800 followers on social network of choice, and an average of 500-800/month unique users accessing the project web page in the last 4 months of the project. 31

32. Thank you for your attention! Dziękuję Ci! Σας ευχαριστούμε! Vă mulțumesc! 32