Pretest Workshops

1. Pretest Workshops Jennifer Burton and Tracy Cerda 1

2. Objectives “What’s new” for 2011-2012 Transitions Changes to statewide assessments MDE policy and procedures Test WES Pretest Edit Window and Precode Student Eligibility 2

3. Important Reminders District training plan District testing schedule Test administration policies and procedures Security policies and procedures Participation of students in special circumstances Test materials delivery, inventory, returning 3

4. 4 Transitions

5. MDE Transition – Student Identity A unique student ID can only be assigned to only one student Student Identity Validation Interface Accessed by authorized staff, usually the MARSS coordinator Separate system from MARSS Used to validate new students and to resolve problems with student identity 5

6. MDE Transition – Student Identity MARSS data still used as basis for assessment precode and accountability MARSS contact: marss@state.mn.us Precode Student Eligibility in Test WES: Add students to precode Change location for testing 6

7. MDE Transition – Website Redesign Access to documents and resources Technical documents posted to MDE website Administration resources posted to AIR’s website Manuals Test Monitor Directions Item samplers and tutorials Assessment results data 7

8. Service Provider Transitions American Institutes for Research (AIR)/Data Recognition Corporation (DRC) Title I (MCA, MCA-Modified, MTAS) GRAD Pearson BST WIDA/MetriTech Title III (ACCESS for ELLs) 8

9. NCLB and AYP Transitions MDE has applied for a waiver for NCLB Policy changes are not known at this time Contact: Sam Kramer 651-582-8454 samuel.kramer@state.mn.us 9

10. Changes to Statewide Assessments 10

11. 11 Online Grades 3-8 Mathematics MCA Test window: February 6 – May 18 Adaptive test Adjusts to each student’s skills Assesses only grade-level standards Three opportunities available Immediate results Highest score used for accountability District determines how opportunities will be offered

12. 12 Online Grades 3-8 Mathematics MCA Student responses in accommodated materials entered into AIR’s Data Entry Interface No answer documents returned for online schools Use entire online testing window Only one opportunity available when using paper accommodated materials

13. 13 Online Grades 3-8 Mathematics MCA Paper test book Available for students with IEP or 504 plan Must be used if IEP or 504 plan requires hand-held calculator Responses must be entered into Data Entry Interface Accommodated text-to-speech available in every form Script must be used in conjunction with a paper test book

14. 14 Reading MCA-III Field Test Schools have been notified and selected Field test window: February 6 – March 2, 2012 Operational in the 2012-13 for all grades Aligned to 2010 Minnesota Academic Standards

15. Science MCA-III First operational administration aligned to 2009 Minnesota Academic Standards Standard setting Field test items Simulations Open-ended response items No classroom assessments 15

16. Science MCA-III Additional flexibility in scheduling All students in the same grade in the district do not need to test on the same days Pausing capability No sections or seal code 16

17. MCA-Modified Students who took MCA-Modified last year are eligible if other eligibility criteria are met Eligibility determined each year Indicated as ? in Student Status for Potential MCA-Modified Participation list Online grades 5-8 Mathematics MCA-Modified Only one opportunity Test decision (MCA or MCA-Modified) must be made before any administration 17

18. MTAS Test window is now 8 weeks long for all subjects March 26 – May 18 Science MTAS: first operational administration aligned to 2009 Minnesota Academic Standards Student scores entered in AIR’s Data Entry Interface 18

19. Minnesota Alternate Assessment: Writing Only grade 9 results entered into Data Entry Interface during MTAS test window Grades 10-12 results kept on file at the district 19

20. Reading and Mathematics GRAD Retests Test Monitor Directions for Paper Accommodations available Results available immediately in AIR’s Online Reporting System starting in January 20

21. GRAD ELL exemption clarification: Enrollment from kindergarten through grade 12 is considered Students consecutively enrolled for four or more years in this timeframe are not eligible 21

22. Reading and Mathematics BST Last administration in April Order materials through Pearson Shipping, scoring, and reporting by MDE Any BST students who do not pass in April will begin to take GRAD Current legislation does not allow for mathematics alternate pathway 22

23. ACCESS for ELLs Selecting test administrators Group administrations Individual administrations Training ACCESS for ELLs Test Administrator’s Online Training requirements WIDA resources 23

24. ACCESS for ELLs Valid score rules MetriTech scores all returned answer documents for students participating in the assessment Valid score needed for LEP funding Parent refusal indicated in posttest editing 24

25. ACCESS for ELLs Alternate ACCESS for ELLs Students with significant cognitive disabilities Administered in spring 2013 Special education deferred (SPD) test code Indicated by domain 25

26. ACCESS for ELLs Hand-bubbling demographic information on the test books Available for posttest editing in Test WES 26

27. ACCESS for ELLs Reports Early reports available on Educator Portal Student-level results Purpose is for placement decisions Reports provided by WIDA 27

28. MDE Policy and Procedure Changes 28

29. Documentation Test administration dates must be posted on district website No longer collected for paper administrations Test Administration Reports kept on file at district for 12 months No longer returned in shipments Test Security Notifications still submitted for security breaches 29

30. Accountability Window Used to determine how students will be counted for participation and proficiency Reading and Mathematics MCA, MCA-Modified, and MTAS: April 16 – April 27 Science MCA and MTAS: March 26 – May 11 30

31. Site Readiness Confirmation Confirm readiness for online testing in Test WES No workbook submitted December 15 – February 29 Work with Technology Coordinator to: Install secure browser Use AIR Diagnostic Tool Complete checklist in available Technical Specifications for Online Testing 31

32. 32 Paper Accommodations for Online Assessments Students use paper accommodated materials but responses are entered into Data Entry Interface Large print test books Braille test books Regular print test books (GRAD retests and online schools for Mathematics MCA only)

33. 33 Script Accommodation for Online Assessments Mathematics MCA-Modified and GRAD and Science MCA Script can be used in conjunction with online form Script can be used in conjunction with large print and Braille test books and student responses entered into Data Entry Interface Mathematics MCA Script can only be used with regular print, large print, and Braille test books and student responses entered into Data Entry Interface

34. 34 Script Accommodation for Online Assessments Script must be indicated in Test WES for all online assessments If used in conjunction with online form for Mathematics MCA-Modified and Science MCA: Cannot be indicated at time of testing Must be indicated in Test WES prior to testing

35. 35 Hand-Held Calculators for Online Assessments Allowed as an accommodation only for Mathematics MCA and MCA-Modified For Mathematics MCA, students use paper test book and responses are entered into Data Entry Interface For Mathematics MCA-Modified, online assessment must be administered in an individual setting Not allowed for Science MCA Allowed for Mathematics GRAD retests

36. Valid Score Rules Grades 3-8 Mathematics MCA (online and paper), grades 5-8 Mathematics MCA-Modified, and Science MCA Students must respond to 90% of items Reading and Mathematics GRAD retests Students must respond to 6 items If “Begin Test Now” is selected, student is not eligible next month Minnesota Alternate Assessment: Writing Completed form required 36

37. Results in Online Reporting System Immediate results: Reading and Mathematics GRAD retests (starting in January) Online grades 3-8 Mathematics MCA (after each opportunity) 37

38. Results in Online Reporting System Results available after processing and scoring: High school early reports Paper assessments and Mathematics MCA-Modified and MTAS Results available after standard setting: Science MCA and MTAS 38

39. Results in Online Reporting System Results available include district and school summary information Used for instructional and planning purposes Official accountability data comes from MDE Reporting rosters and student essays available only in Online Reporting System 39

40. Final Reports Shipment includes: Hard copy Individual Student Reports (ISR) Student results labels (if selected) Educator Portal District Student Results (DSR) files Summary files Dynamic results 40

41. Transition to AIR 41

42. Minnesota Assessments Portal Access to systems Test Information Distribution Engine (TIDE) Online Testing System Data Entry Interface Online Reporting System Learning Point Navigator 42

43. Test Administration Groups Reading, Mathematics, and Science MCA Reading and Mathematics MCA-Modified Reading, Mathematics, and Science MTAS Reading and Mathematics GRAD Written Composition GRAD (retests and grade 9) 43

44. Minnesota Assessments Portal Item samplers Online Paper Student tutorials Reading and Mathematics GRAD retests Combined for Mathematics MCA, Mathematics MCA-Modified, and Science MCA Reading MCA field test Online calculators 44

45. AIR Training Online Test Monitor Certification Course Webinars TIDE in December Online Testing System in January Online Reporting System in January Modules Learning Point Navigator available in January 45

46. Online Testing - TIDE Non-Disclosure Agreement must be completed to start online testing View students loaded to TIDE Prepare student login information Export list of students First name and MARSS number Must be kept secure and securely disposed of following testing 46

47. Online Testing - TIDE Test settings Available for all students Background color and print size can be changed Regular text-to-speech is defaulted to on 47

48. Online Testing - Accommodations Accommodated text-to-speech and accommodation codes Must be indicated in TIDE or Online Testing System for Reading and Mathematics GRAD retests View only for Title I assessments in TIDE Indicated in Test WES Accommodated text-to-speech can be changed in Online Testing System 48

49. Online Testing – Title I Accommodations Accommodations must be indicated before student logs in Indicating accommodation provides correct form Affects how students test Accommodated text-to-speech Available in all forms Can be changed at the time of testing Script must be changed in Test WES if used in conjunction with an online form 49

50. Online Testing System Sessions started immediately before testing Creates session ID students need to log in Student tests or sessions idle for longer than 20 minutes Students will need to log in again New test session will need to be started 50

51. Online Testing System Pausing rules Individual student tests can be paused as needed Students cannot review past items after pausing for more than 20 minutes Testing over multiple days Not allowed for GRAD retests Session is stopped and new session created for next administration 51

52. Online Testing System Online tools are available for students Tools are accessed by clicking a button or right-clicking and selecting the tool Text-to-speech is student-initiated and students select want they want to listen to Online calculators available when allowed 52

53. Online Testing System Students can mark items for review Must answer each question Must review items before pausing for the day Review screens divide calculator and non-calculator sections of online Mathematics MCA and MCA-Modified 53

54. Data Entry Interface Similar to student testing site in terms of layout and functionality Student responses or scores entered Accommodated materials for online tests MTAS and Alternate Assessment: Writing Accommodations must be indicated prior to entering responses or scores 54

55. Initial Materials Orders Orders tab for Title I December 15 – January 27: Complete Supplemental Information January 16 – January 27: Verify school addresses if materials will be delivered to the schools After January 27: View order summary for initial order 55

56. Initial Materials Orders Orders tab for grade 9 Written Composition GRAD December 15 – January 27: Complete Supplemental Information and order accommodated test materials January 16 – January 27: Verify school addresses if materials will be delivered to the schools After January 27: View order summary for initial order 56

57. Supplemental Information Indicated by administration group Questions vary by administration but include: Shipping preferences Delivery date Preprinted labels or answer documents Overage amount Student results labels ISR delivery Grade 12 reading retest opportunity 57

58. Hand-Bubbled Answer Documents A valid MARSS  number must be indicated on the student answer document If MARSS number is incorrectly hand-bubbled or missing, results will be delayed  Use district/school labels 58

59. Paper Administration All coordinator materials are shipped in a white coordinator box Checklists and memos are available in the Assessment Manual Ship by dates must be followed Late shipments will affect reporting timelines 59

60. Test WES 60

61. Test WES 61

62. Test WES Dashboard 62

63. Test WES Important Dates Ongoing: Precode Student Eligibility December 15 – January 27 Confirm test administration mode Confirm student eligibility for alternate assessments View precode View or change test assignment for paper administrations Indicate or change accommodations for test materials 63

64. Test WES Important Dates December 15 – February 29: Confirm site readiness December 15 – May 18: Indicate or change accommodations for Title I assessments January 3 – May 18: Indicate demographic and test codes for Title I assessments January 27 – May 18: View or change test assignment for online administrations 64

65. Test WES Important Dates Initial precode file sent to TIDE on January 27 Used for ordering paper test materials for online and paper administrations Last day to indicate paper administration mode for Mathematics MCA January 26: Last day to update MARSS data for initial precode sent to AIR May be earlier if working with a service provider 65

66. MARSS Enrollment Records and Precode District student enrollment records submitted into MARSS MARSS number vs. State Student Identification (SSID) number Student enrollment records uploaded to MARSS WES Precode sent files begin with the current MARSS enrollment records 66

67. Student Identity Validation Validation of MARSS enrollment records against the Student Identity Validation MDE initiative Errors appear in Precode Student Eligibility Must be resolved in Student Identity Validation Students must have a unique ID for testing and reporting SSID must be confirmed before student record can be included in precode 67

68. Precode Student Eligibility Check and Edit Screen 68

69. Precode Student Eligibility Student enrollment and eligibility records in the Precode Student Eligibility View student eligibility View ID errors Make manual changes to include students in precode 69

70. Manual Changes Add students to precode Add students that are no longer enrolled, but still need to test Add homeschool students Change testing location Enrollment records sent for one school’s precode only Change grade 70

71. Precode Student Eligibility Enrollment codes indicate how a student will be included for testing Regular Homeschool Only GRAD Retest Must be indicated as grade 12 71

72. 72 Site Readiness Screen

73. Verification of Site Readiness Use AIR Diagnostic Tool Verify software installation Network capacity Online Testing System Diagnostics Tool Information and Instructions Respond to site readiness questions December 15 - February 29, 2012 73

74. 74 Test Administration Options Screen

75. Test Administration Options Indicate test administration modes by school for grades 3-8 Mathematics MCA Default to last year’s administration mode Change to paper mode by January 27 Change to online mode until May 18 75

76. Test Administration Options Confirm student eligibility for alternate assessments Certification is done once for all students in a district on this screen Certification is done for individual students on the Search and Edit screen 76

77. Search and Edit Screen 77

78. Search and Edit Screen Search Results Legend 78

79. Search and Edit Screen Messages in Status Column 79

80. Search and Edit Screen 80

81. Search and Edit Screen Resolving inactive records 81

82. Precode Student Eligibility Screen Returning to Search and Edit Screen 82

83. 83 Test Assignment Confirmation and Selection Test assignment will default to prior year assessment Grade 3 and students with no prior assessment will default to MCA Need to indicate MCA-Modified for all students in grade 5

84. Test Assignment Confirmation and Selection Grade 9 Written Composition GRAD and Alternate Assessment: Writing Indicate test assignment and sort order Cannot indicate accommodations in pretest editing Must order accommodated materials in TIDE during the Additional Orders window 84

85. 85 Accommodation Indication Indicate accommodations for each student To order accommodated test materials To assign the correct form in Online Testing System or Data Entry Interface Large Print and Braille will be pre-indicated for students based on last year

86. 86 Sort Order and Precode Indicator Adding a sort order for paper administrations only Available for Reading/Math and Writing groups Adding a sort order by student Adding a precode indicator for Science Default is N for high school students who have previously taken science test

87. 87 Filtering and Downloading Search Results Filtering enhancements By “any” accommodation code (at least one) Download a specific search results file Download functionality only Do not use these files for the uploading of files on the Download/Upload screen

88. 88 Download and Upload

89. Editable Columns in the Precode Download Sort order for paper administrations Column H is for sort order Sort order added for online school will not be used Edits to any other fields will not be reflected Science MCA and MTAS precode indicator 89

90. 90 Precode File Upload Upload district precode file Do not upload the search results file from Search and Edit screen Uploaded sort order for paper administrations Overrides changes previously indicated on the Search and Edit screen

91. Errors That Will Prevent Upload File names greater than 80 characters. Files with an .xlsb or .xlsx District number and type doesn’t match the selected district Rows with fewer than 8 columns or more than 4000 characters in length Test Group number in rows doesn’t match selected Test Group. Invalid data MARSS Number (must be 13 digits) Grade (must be KG or 01-12) Subject (must be R, M, L, W or S) Sort order (must be = 25 characters) Science precode indicator (must be Y, y, N or n) 91

92. Sent Precode Files 92

93. Sent Precode Files These are the most current precode files that have been sent to TIDE Organized test and subject Can download only the most current precode file once initial precode file is sent 93

94. Sent Precode Schedule 94

95. Posttest Editing May 29 – June 15 ACCESS for ELLs will be in posttest editing Development on posttest editing enhancements 95

96. 96 Resources

97. AIR and DRC Phone: 1-877-215-8749 Press 1 for AIR Press 2 for DRC Email: MNHelpDesk@air.org Minnesota Assessments portal: www.mnstateassessments.org

98. WIDA and MetriTech WIDA 1-866-276-7735 help@wida.us MetriTech 1-800-747-4868 wida@metritech.com 98

99. Educator Portal and Test WES Login and password questions: Educator Portal: Donna Larkey; Donna.Larkey@state.mn.us Test WES: Mary Ann Vogel; Mary.Ann.Vogel@state.mn.us Student Identity Validation: mde.studentidauth@state.mn.us Website: http://education.state.mn.us > School Support > Test Administration 99

100. MDE Assessment Contacts