Evaluating District Needs Data

Evaluating District Needs Data OSPI Migrant Education Program Regional Offices Training of Trainers August 28-29, 2012

locating the i-Grants data How to get there…

District Level Gaps & Targets https://www.msdr.org/msis/reports/iGrant/ It is recommended that you bring up this page in the MSIS so you can explain the features while demonstrating them.

Demonstrate how to access the i-Grants data graphics select REPORTStab select iGRANTStab

maneuvering in the i-Grants data How to get around…

Explain • that the graphics take a short while to load • that the data always presents Pasco as the default page

First Point out the navigation buttons. • show how to bring up one’s own district data • - mention the time lag when refreshing the screen (Go button) • show how to select all, LEP, or English proficient results • explain the navigation buttons for subject specific results across the top 1 2 3

Point out the action buttons. print graphic and download graphic download aggregate data for all charts in all subjects (to be described later) download student-level data showing all results (to be described later) 1 2 3

Next Point out the results shown in the bar and line charts. Migrant student results by subject Non-migrant district student results by subject Statewide results for all students 3 2 1

Point out the specific academic area results. • Reading/writing/math/science bars and corresponding tabs • Explain the English proficiency bar and tab is % making gains (AMAO-1) • among the LEP migrants • Explain the MSP Math are the strand level results for Grades 3-8 • Explain the Math EOC results are the End of Course Math courses for High School • - mention that next year, the Science End of Course results will also be available 2 1 3 4

Demonstrate the dynamic features of the Summary page • hover over bar to bring up numeric results • explain the district migrant results always show the number of students tested • to be wary of results with very few students tested • demonstrate the show/hide results feature (Migrant ALL, Non-Migrant All, Statewide) 1 2

Navigating the i-Grants data displaying the subject results…

Select “All Students” and click on “Go”. Then select the “Reading” tab. Point out the three chart areas on this view: Statewide and migrant by grade line chart Migrant gap by grade level bar chart Target table 1 2 3

Demonstrate the dynamic properties of the charts by hovering over the results on the line chart (shows Statewide and migrant results and number tested for each grade) on the bar chart (shows the percentage point gaps for each grade) Notice the prompt to drill down to the building level for any selected grade.

Demonstrate the dynamic properties of the charts by hovering over the results on the line chart (shows Statewide and migrant results and number tested for each grade) on the bar chart (shows the percentage point gaps for each grade) Notice the prompt to drill down to the building level for any selected grade. Hover over each school abbreviation code to bring up the school name and gap. Point out that clicking on the chart returns you to the grade distribution chart. Also, point out that schools with less than 10 students do not show the gap.

Describe the Target Tables the reading gap between migrant and all students in 2011 was 33.8% the targets for annual improvement are set at 20% of the gap (i.e., 6.8%) reducing the gap by 6.8% during SY 2012-13 will mean the percent of migrant students meeting reading standard will go from 37.8% to what value? By 2014? 2015? Point out that the actual percent meeting standard will appear each year in the actual column, but that the left part of the chart will not change over time. The difference column will be filled in beginning with the 2013 test results and thereafter.

Select the “LEP Only” pull down menu and select the Reading tab. point out that the Target tables are only shown on the “All Students” option. point out that the line graph and the LEP gaps compare to the statewide total for all students, not just the gap between LEP migrant and LEP non-migrant students.

Point out that the same pop-up information appears on the screen when a specific “Grade Levels” bar is selected on the bar chart.

Likewise, point out that the school drill down provides grade specific results when hovering over the charts just like it does for the “All Student” screen.

Select the “All Students” and the district of interest and click on the “Writing” tab. Point out the writing line chart and the bar chart showing the gaps by grade. Also point out the Target table and how the hover pop-up and select by school features are active for this subject.

Click on the “Math” tab. Point out the math line chart and the bar chart showing the gaps by grade. Also point out the Target table and how the hover pop-up and select by school features are active for this subject.

Click on the “Science” tab. Point out the math line chart and the bar chart showing the gaps by grade. Also point out the Target table and how the hover pop-up and select by school features are active for this subject.

Click on the “English” tab. Point out the line chart and the bar chart show the gaps for LEP students by grade. Also point out the Target table and how the hover pop-up and select by school features are active for this subject. Mention that these results are for LEP students only even though the tab at the top says “All Students”, as LEPs are the only ones taking the WELPA and having AMAO results.

Click on the “MSP Math” tab. Point out the line charts compare the state total to migrant students by grade for each math strand. Also how the top right chart contains multiple results for the 8th graders (“PS only” means “probability and statistics only” since these strands are distinct for that grade)

Click on the “Show Percentage Point Gap” button. Explain how this button toggles between the “Show & Met Standard” and the gap charts. Point out these charts show the gap of the state total to migrant students by grade. Also point out how the hover pop-up features are active for this view as well.

Click on the “Math EOC” tab. Point out the line charts compare the state total to migrant students by grade for each math strand. Also how the top right chart contains multiple results for the 8th graders (“PS only” means “probability and statistics only” since these strands are distinct for that grade)

Click on the “Show Percentage Point Gap” button. Point out these charts show the gap of the state total to migrant students by grade.

Summary Results The big picture Interpreting the i-Grants data Understanding the results…

The Summary Page presents an overview of the migrant results showing the • gaps occurring across all subject areas. Point out • where the gaps appear large and where small • compare bars to lines (gaps are large in all 4 subjects, small in English proficiency • and MSP Math, but large in Math EOC) • consider how district results are different than statewide results • (notice that MSP Math results in district for all students • are much lower that the state average) 2 1

How do the migrant students differ from the non-migrant students at the district level? at the state level (includes all students, migrant or not, LEP or not) note: it may be helpful to hide lines when evaluating each question. Where are the gaps the largest? Smallest? Based on this information alone, where should migrant services be directed? 2 1

Then compare the results for Limited English Proficient (LEP) students pointing out particularly the gap in the district between migrant LEPs and non-migrant LEPs. (migrant gap among LEPs is small in 4 subjects, large in AMAO-1 gains and Math EOC, but the gap is negative in MSP Math, i.e., migrants are out preforming non-migrants)

Then compare the results for English Proficient (EP) students pointing out particularly the gap in the district between migrant EPs and non-migrant EPs. (notice the English Proficiency results are no longer relevant so not shown)

Ask: What areas show a large and small gap for migrants compared to non-migrants? What explains the difference of MSP Math and Math EOC? How are these results different for EP and LEP? for All Students?

How are these results different for All, EP and LEP? Recall the Download graphics button if users want to create multiple graphs on a single page like this one. All Students EP Only LEP Only

Subject Results The small picture Interpreting the i-Grants data Understanding the results…

For comparing results in Reading, select the district and compare “All, LEP and EP Only” What grades are showing gaps >4% for migrant students? Among the grades with the largest gaps, do specific schools have the greatest gaps?

For comparing results in Writing, select the district and compare “All, LEP and EP Only” What grades are showing gaps >4% for migrant students? Among the grades with the largest gaps, do specific schools have the greatest gaps?

For comparing results in Math, select the district and compare “All, LEP and EP Only” What grades are showing gaps >4% for migrant students? Among the grades with the largest gaps, do specific schools have the greatest gaps?

For comparing results in Science, select the district and compare “All, LEP and EP Only” What grades are showing gaps >4% for migrant students? Among the grades with the largest gaps, do specific schools have the greatest gaps?

English Proficiency – All students – LEP students For English Proficiency, results are the same for “All students” and “LEP Only” What grades are showing gaps >4% for migrant students? Among the grades with the largest gaps, do specific schools have the greatest gaps?

Select the MSP Math tab and explain the line charts each show the results of the different math strands. Point out the Measurement graph is a compound chart and show Probability & Statistics separately for 7th & 8th grades. Toggle to the “Show Gaps” chart. Where are the gaps largest? What strands? Math Strands – All students

Select “EP only” students and then select the MSP Math tab. Toggle to the “Show Gaps” chart. Where are the gaps largest? What strands? How do these results compare to the “All Students” results? Math Strands – EP students

Select “LEP only” students and then select the MSP Math tab. Toggle to the “Show Gaps” chart. Where are the gaps largest? What strands? How do these results compare to the “All Students” results? To the “EP only” student results? Math Strands – LEP students

Math EOC – All students Select “All Students” on the pull down menu. Then select the Math EOC tab. Describe the line charts and toggle to the gap charts. Remind staff that EOC tests are only taken by high school students or advanced 7th & 8th grade students. Ask where migrant students are doing best, and where the gaps are largest. Explain that Science End of Course results will also be included on an additional tab once these data become available.

Math EOC – EP students Select “EP Only” on the pull down menu. Then select the Math EOC tab. Describe the line charts and toggle to the gap charts. Ask where migrant students are doing best, and where the gaps are largest. Explain the % meeting standard will not display when the number of students in a grade are less than 10. Point out the charts will be blank when all grades have less than 10 students. 1 2

Math EOC – LEP students Select “LEP Only” on the pull down menu. Then select the Math EOC tab. Describe the line charts and toggle to the gap charts. Ask where migrant students are doing best, and where the gaps are largest. Point out that were there is only one grade with >10 students, hovering over the grade will display the gap.

Interpreting the i-Grants data Results in tabular format…

Explore the data downloads from the main page for the district under review. Note: Data downloads should only be available for the district the user is assigned. Point out that the data contained in this spreadsheet are the data that drives all of the graphs and charts used in this i-Grants procedure. DOWNLOAD the “All Data: to Excel, and review what is presented in this table.

1. Point out the two sheet tabs at the bottom of the table and show how to toggle between the English Proficiency results and the Academic Results. 2. Point out that the English proficiency gap for grades 1-5 is computed for them. Point out that the State total and state grade totals are always on the top for comparison with the district total, district grade totals, and school totals below. 2 1

Point out that percentages in RED font are based upon very few students and are NOT reliable so should be interpreted with caution. Be sure to check the number of students in the corresponding rows in the columns further to the right to see the number of students involved. Show the sequencing of the columns, from total gaps – to % meeting standard – to number of students.

Evaluating District Needs Data