2013 STAR Reports Preview

1. May 22, 2013 Webcast starts at 9 a.m. Mark Hansen and Michael McDaniel 2013 STARReports Preview

2. 2013 STAR Reports Preview Agenda Objectives: Identify the reports districts receive; understand the information provided on each report and how to use the information • Shipment Schedule and Packaging • Student Reports • CSTs (California Standards Tests) • CMA (California Modified Assessment) • CAPA (California Alternate Performance Assessment) • STS (Standards-based Tests in Spanish) • Individual Reports • Summary Reports • Data CD • Quick-turnaround Reporting

3. What’s New for 2013 • Quick-turnaround Reporting is now available for the spring 2013 administration. • STS performance levels—advanced, proficient, basic, below basic, and far below basic—are now also reported for RLA in grades eight through eleven and EOC Algebra I and Geometry. • ELA scale scores for the grades four and seven CSTs and CMA will be provided based on the multiple-choice items only. • The reporting cluster “Writing Applications” is no longer part of the CST and CMA ELA cluster groups. • The writing score is provided as a standalone score called “Writing Response Score.”

4. When Will Report Information Be Delivered?

5. Shipment Schedule for Single Administration Districts • One shipment of reports contains: • All individual reports including Student Reports for CST, CMA, CAPA, and STS • Student Report Interpretation Guides • English only, except for STS (English and Spanish) • Unmatched reports • All summary reports • Data CD • EAP Roster (if applicable) • DVD-ROM containing Student Report PDFs (if ordered on Processing Form)

6. Shipment Schedule forMultiple Administration Districts • One shipment per administration • Early shipment(s) contain: • Student Reports (CST, CMA, CAPA, and STS) • Student Report Interpretation Guides • Student Master List • Student Record Labels • Unmatched reports • Data CD • EAP Roster (if applicable) • DVD-ROM containing Student Report PDFs(if ordered on Processing Form) Note: Summary (aggregated) reports are not available for early shipments.

7. Shipment Schedule forMultiple Administration Districts • Final shipment contains: • All remaining individual reports including Student Reports (CST, CMA, CAPA, and STS) • Student Report Interpretation Guides • All summary (aggregated) reports • Unmatched reports • Data CD • EAP Roster (if applicable) • DVD-ROM containing Student Report PDFs(if ordered on Processing Form)

8. Student Reports • CST, CMA, CAPA, and STS • Receive two report copies for each test students took. • Send one report to parent/guardian within 20 working days of receipt. • Forward the school shipment, which contains a second copy for students’ current teacher.

9. CST Student Report Example

10. STAR Student Report • Address on LEFT • Same position as the 2012 STARStudent Report and the CAHSEEStudent Report • #10 left window envelope • Address includes POSTNETbarcode • Statewide Student Identifier (SSID) (“Student #”) and localidentification number (“Local ID #”) printed • Student name printed on front and back

11. CST, CMA, and STS Student Report, Front • Scale scores • Performance levels CST Grade 7 Example

12. CST, CMA, and STS Student Report, Back: Reporting Clusters • Number and percent correct • Comparison to statewide proficient scores CST Grade 7 Example

13. CST, CMA (4–7) Writing Response Scores • Shows score from 1–4 • Shows rubric used to determine that score Note: The writing score is NOT combined with the multiple-choice score to calculate the ELA score. CST Grade 7 Example

14. CMA Student Report Example

15. CMA Student Report, Front • Scale scores and performance levels for: CMA Grade 8 Example

16. CMA Student Report, Back • Reporting clusters for ELA, Mathematics, and Science • Number and percent correct • Comparison to statewide proficient scores • Description of the CMA CMA Grade 8 Example

17. CAPA Student Report Example

18. STS Student Report Example

19. STS Student Report, Front • Scale scores and performance levels for all tests • RLA (including grades 8–11) • Mathematics (including Algebra I and Geometry) STS Grade 5Example

20. STS Student Report, Back • Reporting clusters for all tests • Number and percent correct • How to use the STS results STS Grade 5Example

21. Student Record Labels • Add to students’ permanent record • Schools are responsible for affixing labels to each pupil’s permanent school records or for entering the scores into electronic pupil records. [California Code of Regulations, Title 5, section 863(c)] • Includes SSID number and, if provided, local student ID number • Available for: • CSTs/CMA • CAPA • STS

22. CST/CMA Record Label CST/CMA Grade 3 Example

23. CAPA Record Label CAPA Grade 5 Level III Example

24. STS Record Label STS Grade 8 Example

25. Student Master List • Report that contains details of results for each student • For all grade-level and EOC CSTs, CMA, and STS, the report includes: • Percent correct for each reporting cluster • Scale scores • Performance levels • For the CAPA, the report includes: • Scale scores • Performance levels

26. Student Master ListSort Sequence • School • Grade • Test type • CSTs/CMA • CAPA • STS • Alphabetical order by last name Note: STS data are not matched with CST, CMA data.

27. Student Master List CST/CMA Grade 3 Example

28. Summary Reports • Review data on reports and use to develop reports for your school or district. • Do NOT compare across grades or across subjects. • Student Master List Summary includes CSTs, CMA, CAPA, and STS results. • Student Master List Summary: End-of-Course (EOC) includes EOC results for CSTs, CMA, and STS. • Subgroup Summary includes results for CSTs, CMA, CAPA, and STS.

29. Student Master List Summary Grade 7 Example

30. Student Master List Summary Grade 3 Partial Example

31. Student Master List SummaryEnd of Course CST for Biology Example

32. Subgroup Summary Grade 5 Gender Example

33. Subgroup Summaries • Compare results among different student demographics • Gender • Disability status • (CAPA, specific disability) • Economic status • Ethnicity • Two or more races • English proficiency • Ethnicity for economic status

34. Subgroup Summary Grade 5 Gender Example

35. Data CD—Text Format • Two files • Three record types • EAP status data • Reported in file; four positions, 407–410 • 2013 Student Data File Layout • Layout description included in shipment • Contact STAR TAC for questions • Download from www.startest.org/reports.html in mid-June

36. Data CD—XML Format • One file • Two companion files on www.startest.org/reports.html: • .xsd = Schema • .xsl = Data layout • Available at the end of June • Easy to import data into other formats • Access database

37. Quick-turnaround Reporting (QTR)

38. QTR—Background • QTR is a module of the STAR Management System that makes a data file available that contains early student-level results for the CSTs and CMA. • QTR data file is available upon completion of an entire administration once all scorable test booklets and answer documents for that administration have been received at the STAR Processing Center in Iowa City, IA, and certified by Educational Testing Service. • The school district will be notified via e-mail that all CST and CMA tests in the administration have been certified and a QTR file is ready for download.

39. QTR—Background, continued • QTR data files contain results data for CST and CMA multiple-choice tests: • Scale-scores • Performance-levels • Associated student-identification and test-taken information • It is important to remember that these are preliminary results only; the results may change in the reports that are shipped to districts.

40. QTR—Access • Log on to the STAR Management System.

41. QTR—Access, continued • Select the Quick-turnaround Reporting button in the left navigation bar to open the “Quick-turnaround Reporting” application window.

42. QTR—Access, continued • Select a file-name link for the QTR file you wish to download. • Select the Save button in the File Download dialog box to download the file or the Open button to open it. • Use your zip archive application to extract the contents of the file.

43. QTR—Documentation • Available on the “STAR Management System” Web page at http://www.startest.org/sms.html: • Quick-turnaround Reporting Manual • Student Data Layouts • Fixed-format file—“_FIX.txt.zip” extension • Tab-delimited format file —“_TAB.txt.zip” extension

44. Questions ?

45. For STAR technical questions:STAR TAC—800-955-2954 • For STAR policies: CDE—916-445-8765 • For accountability questions:CDE Academic Accountability Unit—916-319-0863 More Questions?

46. Next Webcast:2013 Post-Test Workshop August 7, 2013 Webcast starts at 9 a.m.