1 / 10

Annamari Ylonen and Brahm Norwich

Evaluation of the project. Annamari Ylonen and Brahm Norwich. Session outline. Evaluation at different levels Goal Monitoring and Evaluation – principles and guidelines Ethnographic research – what is this and what does it involve? Process evaluation Ethical issues

makani
Download Presentation

Annamari Ylonen and Brahm Norwich

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Evaluation of the project Annamari Ylonen and Brahm Norwich

  2. Session outline • Evaluation at different levels • Goal Monitoring and Evaluation – principles and guidelines • Ethnographic research – what is this and what does it involve? • Process evaluation • Ethical issues • Timeline of evaluation activities • One survey to be filled in: concepts of inclusion & MLD

  3. Different levels of evaluation • Pupil level • Goal Monitoring and Evaluation (GME) by teachers as part of the Lesson Study • Teacher level • Questionnaires /surveys : online (Survey-Monkey), email or hard copies • Classroom and school level • Ethnographic research: observations of LS meetings and classes; some interviews • Process level (‘realistic evaluation’) • A survey/interviews about the Lesson Study process

  4. Goal Monitoring and evaluation • Developed from Goal Attainment Scaling (GAS) for the Lesson Study project • Method of monitoring the learning outcomes of the case pupils (2 in each class identified as having MLD) • 2-3 research questions for each pupil (related to LS aims) • 3 goals for each pupil (related to LS aims and RQs). Within each goal, 3 levels: 2 before the LS (baseline and expected levels) and 1 after the LS (an achieved level) • The process is teacher/LS team-led • How? • Detailed instructions are in the pack together with a template to be filled in for each Lesson Study/case pupils

  5. Example of a GME goal and levels

  6. Ethnographic research • Real time observations of the Lesson Study process (LS team meetings and classes) in schools • The focus is on the process, not on outcomes • How? • School visits (estimated 2-4 visits per school in each LS) • Observations in a small number of case study schools • Short interviews: • with teachers, other LS team members and some senior leaders: views about the process, impact on pupil learning, issues arisen etc. • with the case pupil focusing on their views about LS and how it affects their learning

  7. Ethnographic research: case study schools • There will be 5 case study schools (same for both LS cycles) • How are these schools selected? • By distance to Exeter: time constraints/logistics – easy access • If your school fits this criteria, you may be asked to take part • How are the visits planned? • By negotiating suitable times to fit within teaching timetables etc. • Suggestion: initial visit ASAP to plan dates/times

  8. Process evaluation • Focus on the LS process at teacher and school levels • why and how the LS works in schools/impact on teaching and teachers • construction of process theory (links between contexts, mechanisms and outcomes) • How? • An online survey at the end of the project (Feb/March 2012) OR at the final conference • Short interviews with a sample of teachers – possibly by phone

  9. Ethical issues • The research and evaluation in the project follows ethical guidelines (by the British Educational Research Association) • Consent from research participants: • Understand what the project is, what it is aiming to do and its purposes • What taking part involves • Right to confidentiality and anonymity (e.g. in any subsequent reporting of research findings) • Right to withdraw from the study at any time • For case pupils interviews: written parental consent • template available from project website

More Related