170 likes | 301 Views
Review of Toolkit Amber Gove RTI International Session 3.4. Potential Purpose(s). How is the system doing? Raise government/public awareness of a national or regional problem How is the project doing? Evaluate discrete interventions
E N D
Potential Purpose(s) • How is the system doing? Raise government/public awareness of a national or regional problem • How is the project doing? Evaluate discrete interventions • How are students doing? Help teachers track student progress in the lowest primary levels, before students have problems and drop out In all cases, the end goal is to provide resources for interventions that clearly address the problem.
Lessons from Pilots: Phases of EGRA • Planning and Development • Adaptation and Training • Field Work • Data Entry and Analysis • Dissemination and Reporting
Planning and Development • Review purpose with funder and Ministry • Involve/consult with teachers, ministry staff, parents, survey team, curriculum experts • Develop a detailed workplan, clarify roles and responsibilities • Determine use of results and dissemination plan • Carefully develop sample to fit purpose, budget
Adaptation and Training • Start with complete, but draft version • Adapt with teachers, survey specialists, curriculum experts (bring textbooks, word lists, sample stories) • Balance economy and desire to include everything • Pre-test and Pilots serve both training and instrument improvement opportunities (stopwatch practice; 0 vs. missing) • Changes must be evidence-based • Assess Inter-Rater Reliability using audio recordings
Field Work • 1 Supervisor plus 3 to 4 Enumerators • Timely transport is critical: arrive before school starts and meet, greet, thank director and teachers • Avoid false negatives: be nice to the children • Sample across all classrooms using teacher lists; start with youngest (1st grade) students • Prior to leaving the school: verify completeness and avoid missing data (waste of everyone’s time)
Data Entry and Analysis • Involve supervisors in data entry if possible • Develop and test data entry program in advance • Clarify difference between 0 and missing • If using excel, ensure consistency of entry • Use analysis as opportunity to work with ministry staff • Develop strategies for analysis in excel
Dissemination and Reporting • Develop different reports for different audiences (parents, teachers, ministry staff, testing specialists) • Recall purpose is to improve, not blame; use results accordingly • Discuss next steps, teacher training • Provide solutions to the challenges identified • Use results to mobilize for improvement