180 likes | 733 Views
Missouri Reading Initiative. Evaluation Plan: 2006-2009 Goals, Activities, and Responsibilities. Overview. Goals Who What When Roles and Responsibilities. Goals. Measure Outcomes Monitor Program Implementation (Process)
E N D
Missouri Reading Initiative Evaluation Plan: 2006-2009 Goals, Activities, and Responsibilities
Overview • Goals • Who • What • When • Roles and Responsibilities
Goals • Measure Outcomes • Monitor Program Implementation (Process) • Provide Useful Information for Program Development : Schools and MRI
MRI Staff University Interns School Personnel 5,000-7,000 Respondents: 15-25 new schools 4,500-7,500 students 350-750 Teachers Who?
What?Logic and Instruments Basic Program Logic: Step 1 ( Strategic Input): MRI provides instruction in Comprehensive Literacy. . . Step 2 (Strategic Objective): Classroom teachers change to (reinforce) Comprehensive Literacy practice resulting in. . . Step 3 (Long-Term Outcome): Improved levels of student achievement in communication arts.
Data Collection “Instruments” “Teacher Beliefs and Practices Survey”: Measures teacher beliefs and attitudes about learning styles, and how frequently they utilize certain practices in their classrooms. (Pre and Post)
Data Collection “Instruments” • Parent Involvement in Literacy Survey Given in Fall and Spring to assess how schools approach parent involvement Measures changes in programs after MRI presents its parent involvement component
Data Collection “Instruments” Annual MRI Questionnaire: Set of questions with scaled responses given at year-end to teachers, administrators and other participants that focuses on implementation process. Teacher/Administrator Interviews: Semi-structured interviews that ask about the strengths and weaknesses of various program elements. (Exit)
Data Collection “Instruments” • Standardized Test Scores: MAP and school-based scores used to document student achievement. • Developmental Reading Assessment(DRA) scores: An assessment tool that measures individual student reading development; a component of MRI instruction. • Create Baselines and collect as implemented
Data Collection “Instruments” Special Education and Title I data: Annual referrals to special education and Title I programs: • # Site team referrals • # Diagnostic evaluation referrals • #IEP placements • Create baselines and update annually
Data Collection “Instruments” • Student data--- student age, gender, social and economic data (free/reduced lunch status, family type), ethnicity/race. • Teacher data --- years teaching, length of service at school. • School data --- size, percentage on free/reduced lunch, rural/urban. • Document review --- collection, review, and analysis of documents relating to program design, budgets, implementation, school involvement, etc.
Timeline:Orientation: April-May 2006 • Present evaluation plan and finalize evaluation roles and responsibilities • Provide each school with a thorough orientation to the MRI program activities.
Timeline:Year I: (2006-2007) September-December 2006 • Conduct Pre-Teachers Beliefs & Practices Survey • Collect student demographic data • Collect baseline student achievement scores • Collect baseline DRA scores • Collect baseline special ed./Title I data • Collect school information
Timeline:Year I: (2006-2007) January-May 2007 • Update Student Achievement Scores April-May 2007 • Implement end-of-year questionnaire to teachers and administrators • Update student demographic info. June-August 2007 • Prepare site reports/1st year report
Timeline: Year II: (2007-2008) September 2007-May 2008 • Update standardized test scores as they occur • Update DRA scores as they occur • Update special education/Title I data May 2008 • Conduct end-of-year questionnaire (May) • Update student demographic info. June-August 2008 • Prepare site reports/2nd year report
Timeline:Year III: (2008-2009) September 2008-May 2009 • Update standardized test scores • Update DRA scores • Update special education/Title I data March-May 2009 • Conduct post-Teacher beliefs and Practices Survey • Conduct exit interviews • Collect final student achievement data • Update student demographic info.
Timeline:Year III: (2008-2009) June-August 2009 • Prepare final site reports Fall 2009 • Final Report
Schools Collect and transmit data; Test Scores Special Education Interviews Surveys Provide General information School Student Teacher Service MRI Support data collection Staff Set up systems Design Forms Internet Data Entry Analysis Reports Roles and Responsibilities