Mathematics MCA-III Online Testing

1. Mathematics MCA-III Online Testing Jennifer Dugan, Sandy Gimpl, and Rosemary Heinitz

2. Math MCA-II vs. MCA-III Grades 3-8 • MCA-II was operational through Spring 2010 administration • Aligned to 2003 Academic Standards • Initial administration of MCA-III in grades 3-8 will be during 2010-2011 school year • Aligned to 2007 Academic Standards

3. Background • 2007 math standards were finalized in 2008. • Math MCA-III Test Specifications Committee drafted first version of the test specifications in 2008. • Test specifications will be in draft form until the first administration of the test. • Math MCA-III items were field tested in both 2009 and 2010 spring administrations. • A Math MCA-III online Fall Field Test was given to some students in fall 2009.

4. High Quality Timely Results Most Information Short Administration Designing the MCA-III • How can we provide – • the highest quality assessment • with the most information for educators • that takes the least amount of time to administer and • the timeliest results?

5. MCA-III Components • Computer administered tests (CAT) • Technology-based items (computer scored) assess higher-order thinking skills • Flexible assessment window allows for convenient administration during the school year • Computer-scored exams provide usable information during the school year • Computer-adaptive assessment provides more precise information about students’ knowledge and skills

6. 2011 Administration • Computer administration with engaging, interactive items (not adaptive) • Longer online test window to allow for more scheduling choices • Ability for students to start and stop the online test during the test window • Online calculator and formula sheet

7. 2011 Administration • Paper administration also available • Accommodations • One administration per student • Spring 2011 results available after performance levels are established (Standard Setting) Minnesota Assessment Conference

8. 2011 Administration • Audio available to all students in online • On-demand – controlled by the student • Does not describe graphics • Audio pauses when there is text in the item that is not read (graphics, expressions, numbers) • Vast majority of students’ audio needs should be met • Paper continues to have script and CD • Describes graphics • Available for students with IEP or 504

9. 2011 Online vs. Paper Audio The table shows Jimmy’s and Linda’s ages. How old will Linda be when Jimmy is 13 years old? • 9 • 12 • 16 • 17 Jimmy’s and Linda’s Ages on January 1

10. Item Types • Multiple Choice • Technology Enhanced (only on the online test) • Hot spot • Drag and drop • Graphing • Numeric type-in • Gridded Response (only on the paper test)

11. Screen Tools Help tool Formula sheet Audio box Calculator Eraser tool Highlighter tool Back/next buttons Eliminate choice tool Pointer tool Reset button

12. Graphing Item Type

13. Fill-InItem Type

14. MCA-III Support Materials • Samplers • Familiarize students with the overall testing experience • Online and paper versions – same items used in both formats • Do not predict performance on MCA-III • Current schedule has fall release • Tutorial • Gives information on online tools, procedures for navigating through the test, etc. • Current schedule has fall release

15. MCA-III Support Materials • Formula Sheets • MCA-III Formula Sheets aligned to 2007 standards • Grades 5-8 • Released Items • Provided in subsequent years as testing pool allow Minnesota Assessment Conference

16. Test Specifications • Not final until first administration • MCA-III and Modified Combined for 3-8

17. Other Minnesota Math Assessments • 2010 was last year for MTELL • Universal Design and Simplified Language Principles implemented in MCA-III development • 2011 MCA-II Grade 11 • Aligned to 2003 Math standards • CRs eliminated • 2011 MCA-Modified will be operational • Grades 5-8 aligned to 2007 Math standards • Grade 11 aligned to 2003 Math standards • 2011 MTAS • Grades 5-8 aligned to 2007 Math standards • Grade 11 aligned to 2003 Math standards

18. Plans for 2011-2012 Administration • Adaptive computer administration with engaging, interactive items • Paper administration also available • Three administrations per student • Test window late fall - spring • Ability for students to start and stop the test during the test window • Preliminary results by student available immediately

19. Plans for 2011-2012 Administration • Audio available to all students in online • Text to speech • Paper continues to have script and CD • Describes graphics • Available for students with IEP or 504

20. How can you become involved? • Unique professional development opportunity at no cost to districts • Teachers learn how tests are built • Teachers learn the standards intimately • Teachers advise MDE on how items are developed and tests are built • Teachers see student performance across the state

21. MDE Contact Information • Jennifer Dugan • Supervisor Test Development • (651) 582-8654 • jennifer.dugan@state.mn.us • Sandy Gimpl • Math Assessment Specialist • (651) 582-8634 • sandy.gimpl@state.mn.us • Rosemary Heinitz • Math Assessment Specialist • (651) 582-8836 • rosemary.heinitz@state.mn.us