120 likes | 217 Views
User vs Nonuser : Top 750 PD-360 Analysis :. Prepared by Steven H. Shaha, PhD, DBA. Does teacher engagement i n PD 360, significantly affect s tudent success?. Methods.
E N D
User vs Nonuser :Top 750 PD-360 Analysis: Prepared by Steven H. Shaha, PhD, DBA
Does teacher engagement in PD 360, significantly affect student success?
Methods • Design: Quasi-experimental, retrospective, pre-post, normalized treatment-control / participation vs. non-participation (2009-10, 2010-11) • Goal: Multi-State, large n with comparable student populations (matched, controlled) • Student Change:*Metric was percent students classified as Proficient or Advanced in respective States.
Sample Participation • Systematic sample of 750 schools, in 30 States • N determined by a priori Power analysis • Schools eligible for inclusion in the sample as participating Schools met the following criteria: • More than 10 teachers total • 80% or more of teachers viewed materials • Minimum average of 90.0 minutes of viewing per teacher for the school • Districts included were only those for which eligible schools were included • Normalizing for difference in socio-economic and demographic factors between participating Schools and their Districts cumulatively as the statistical comparison group Data • Participation data were extracted from the Internet-based professional development application as surveilled • Student performance data were captured from publically available, Internet-accessed sources (school as unit of measure, percent Proficient or Advanced as metric)
Exhaustive Analysis PD-360 Schools significantly outperformed their respective Districts • Math: • 11.6% Advantage in Percent Proficient (p<.001) • 19.4% Advantage in Percent Advanced (p<.001) • 13.0% Advantage for Combined Pct Prof and Adv(p<.001) • Reading: • 5.3% Advantage in Percent Proficient (p<.001) • 9.3% Advantage in Percent Advanced (p<.001) • 5.5% Advantage for Combined Pct Prof and Adv(p<.001)
Math Advantages As Districts fell 6.4%, PD-360 Schools gained 5.2% for a 11.6% advantage (p<.001)
Math Advantages Districts gained 14.5%, while PD-360 Schools gained 33.9% for a 19.4% advantage (p<.001)
Math Advantages Districts fell 4.9%, while PD-360 Schools gained 8.2% for an 13.0% advantage* (p<.001) * Figures do not sum perfectly due to rounding
Reading Advantages The Districts rose .8%, while PD-360 Schools gained 6.1% for a 5.3% advantage (p<.001)
Reading Advantages Districts gained 21.2%, while PD-360 Schools gained 30.5% for a 9.3% advantage (p<.001)
Reading Advantages Districts rose by 2.5%, while PD-360 Schools gained 7.9% for a 5.5% advantage* (p<.001) * Figures do not subtract perfectly due to rounding
Predictors of Change inPD-360 Schools • Math predictors: • #1 – Total Users • #2 – Average Minutes Viewed • #3 – Percent of Users Viewing • Reading predictors: • #1 – Percent of Users Viewing • #2 – Registered Users Viewing • #3 – Average Minutes Viewed