1 / 35

NDEC Methodology Update

NDEC Methodology Update. Teacher Leader Institute San Antonio: June 7, 2003 Francisco X. Gómez B. Director, NDEC. Data Update 2001-2002. Reading Recovery 146,165 students 17,557 teachers 10,451 schools 3,238 school districts 729 teacher leaders 564 teacher training sites 23 UTCs.

bryanne
Download Presentation

NDEC Methodology Update

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. NDEC Methodology Update Teacher Leader Institute San Antonio: June 7, 2003 Francisco X. Gómez B. Director, NDEC

  2. Data Update 2001-2002

  3. Reading Recovery 146,165 students 17,557 teachers 10,451 schools 3,238 school districts 729 teacher leaders 564 teacher training sites 23 UTCs Descubriendo La Lectura 2,873 students 1,512 teachers 1,049 schools 356 school districts 210 teacher leaders 169 teacher training sites 22 UTCs RR & DLL in 2001-2002

  4. RR DLL Demographic Characteristics of RR & DLL Schools

  5. Status Outcomes - RR

  6. Status Outcomes - DLL

  7. Percent of RR Treatment Group Discontinued by Lunch Cost

  8. Year-End TRL for RR & DLL

  9. RR Treatment Group: Reading Group Placement

  10. Special Education Referrals: RR • 0% of RR children who Discontinued were placed in LD: Reading or Writing • 5% of RR children who were Recommended were placed in LD: Reading or Writing (vs. 6% in 2000-2001) • 1% of RR children who were Full Program (Treatment Group) were placed in LD: Reading or Writing, same as for RS

  11. Reading-Related Retention: RR • 0% of children who Discontinued were retained due to reading-related difficulties • 1% of children in the random sample were retained due to reading-related difficulties • 1% of children in the Treatment Group (Full Program) were retained due to reading-related difficulties

  12. Changes for 2003 Reports

  13. New Data in 2002-2003 • New English and Spanish-language assessments; better validity & reliability • Disability status – disaggregated • Migrant status - disaggregated • New disaggregated tables from NCES data: • School Locale • School Minority Enrollment • School Title I funding

  14. Why new RS Methodology • 100 usually not enough to represent a site population • Do you want to test or teach? (SD) • Non-RR; who this is depends on level of coverage; can’t define the RS group • State or national averages or norms an aggregation of local samples; not ideal • New sample allows true national representativeness

  15. Options for reports with no RS • Do not discuss random sample data. • Compare scores to a previous year’s average band. • Compare scores to the 2001-2002 national average bands. • Discuss the distribution of current Observation Survey scores. • Use an alternate, locally defined benchmark. • Combine any of the above options. • Modify the research questions as needed. • Average Band tables replaced by distributions.

  16. New Reports • Teacher Leader menu now has link: Download Reports and Data Files • Inside, you will find: • Related Documents, such as “Writing 2002-2003 Site Reports without Random Sample Data” and “Guide to Annual Results Packet” • Site-level reports • District-level reports • School-level reports (See sample) • Not yet fully implemented changes – will notify

  17. Download Reports & Data Files

  18. System Summary Reports Menu

  19. School Data Summaries Menu

  20. New OS Stanines • Will be available in late fall • Don’t wait for them to write reports • Will be national norms • Based on entire population versus non-RR or non-DLL population • Will be published as sets of tables for Fall, Mid-Year and Year-End.

  21. User-Friendly Data Dumps

  22. School Data Summary-OS Tables

  23. School Data Summary- Form

  24. School Data Summary-Demographics

  25. School Data Summary – OS Scores

  26. School Data Summary-Retention, Referral & Special Education

  27. Methodology Changes & Issues

  28. Random Sample • Compliance with new method a challenge the first year • We need to be ‘rigorous & systematic’ • 2 children per school; no more, no less • Need to train & monitor teachers early in the school year – or in summer before • Fall, Mid Year & Spring testing for RS • RR/DLL can also be RS – use 2 forms

  29. Changes for 2003-4 • No changes to student form • Teacher form: In your ‘Other Role’, indicate how many total students you served This will allow you to highlight how many children are impacted by RR/DLL teachers during the part of the day they do not work in RR. This is a cost/perception issue.

  30. Changes for 2003-4 • School form: we no longer ask • No. of 1st graders in school who receive classroom instruction in English/Spanish • Estimated level of RR/DLL coverage in your school • NDEC obtains these numbers from NCES • Teachers enter # of student who need service • NDEC calculates level of coverage

  31. InstantReports • Won’t be instant; • Will run like mini-ARPs • Won’t duplicate other reports • Purpose; provide data needed during school year

  32. Longitudinal Data Entry/1 • Will be voluntary • Accessed based on school district • Pull-up data from past year • Add standard data: • Special Ed • Retention • Placement in other interventions

  33. Longitudinal Data Entry/2 • Add local data • Re-run data dump with new data • Longitudinal research must be local; • issues & questions are local • measures are local • Reporting and analysis must be local • Standardization important • See Using the NDEC Data Dumps to Conduct Longitudinal Research

  34. Download presentation • Log in to NDEC & Click on Download Reports and Data Files • This & other relevant documents will be listed under Related Documents • New links; • Related Documents • Site Documents • School System Documents • School Building Documents

More Related