Technology and The Smarter Balanced Assessment System

1. Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D.

2. The Smarter Balanced Assessment System Summative assessments Benchmarked to college and career readiness Idaho Core State Standards specify K-12 expectations for college and career readiness All students leave high school college and career ready Teachers and schools have information and tools they need to improve teaching and learning Digital Library Teacher resources in formative assessment to improve instruction Interim assessments Flexible, open, used for action feedback

3. The Smarter Balanced Governance Structure

5. Idaho Involvement in the Smarter Balanced Assessment Consortium • Governing Board Member (Supt. Tom Luna) • Former Executive Committee Co-Chair (Carissa Miller) • Executive Committee Member (Luci Willits) • K-12 State Lead (TJ Bliss) • Higher Ed State Lead (Chris Mathias/Roger Stewart)

6. Common Core Math Standards • Balance conceptual understanding and procedural fluency • Connect these two types of knowledge • Maintain high cognitive demand • Communicate reasoning about concepts • Engage students in mathematical practices: • Reason abstractly and quantitatively • Construct viable arguments and critique the reasoning of others (Moschkovitch, 2012)

7. Common Core ELA Standards • Reading: Engage with complex texts to build knowledge across the curriculum • Writing: Use evidence to inform, argue and analyze • Speaking and Listening: Work collaboratively, understand multiple perspectives, and present ideas • Language: Develop and use the linguistic resources to do all of the above (Bunch, Kibler & Pimental, 2012)

8. Assessing Deeper Knowledge Identify Define Memorize Organize Classify Compare Matching Multiple Choice Critique Revise Investigate Create Evaluate Design Performance Tasks (Essay) Short Answer

9. Assessing Deeper Knowledge Smarter Balanced ISAT Identify Define Memorize Organize Classify Compare Identify Define Memorize Organize Classify Compare 30% 90% Critique Revise Investigate Critique Revise Investigate Create Evaluate Design Create Evaluate Design 70% 10%

10. A Balanced Assessment System Summative assessments Benchmarked to college and career readiness Idaho Core State Standards specify K-12 expectations for college and career readiness All students leave high school college and career ready Teachers and schools have information and tools they need to improve teaching and learning Teacher resources for formative assessment practices To improve instruction Interim assessments Flexible, open, used for action feedback

11. Formative Assessment • Assessment FOR learning • Daily/weekly at classroom level • Answers questions like: • Where are my students in relation to learning goals (for this lesson)? • What is the gap between students’ current learning and the goal (for this lesson)? (Heritage, 2013)

12. Smarter Balanced Formative Digital Library • State Networks of Educators (SNE): • 2000+ educators contributing, reviewing, and approving materials for the library using a Quality Criteria Checklist / System • Educators will review and pilot materials in their classrooms and schools to provide feedback. • Library will be available for use in beta in April 2014 • States may purchase access after August 2014

17. A Balanced Assessment System Summative assessments Benchmarked to college and career readiness Idaho Core State Standards specify K-12 expectations for college and career readiness All students leave high school college and career ready Teachers and schools have information and tools they need to improve teaching and learning Teacher resources for formative assessment practices To improve instruction Interim assessments Flexible, open, used for action feedback

18. Interim Assessment • Assessment OF learning • Periodicallyat classroom, school or district level • Optional • Answers questions like: • What have my students learned? • Is there evidence improvement strategies are working? • How should we allocate resources at the district and school levels? (Heritage, 2013)

19. Smarter Balanced Interim Assessments • Non-secure interim item bank is flexible; can be used at district, school, classroom levels. • Ready for use in Fall 2014 • States may purchase access going forward

20. A Balanced Assessment System Summative assessments Benchmarked to college and career readiness Idaho Core State Standards specify K-12 expectations for college and career readiness All students leave high school college and career ready Teachers and schools have information and tools they need to improve teaching and learning Teacher resources for formative assessment practices To improve instruction Interim assessments Flexible, open, used for action feedback

21. Summative Assessment • Assessment OF learning • Annual at state level • Answers questions like: • Have students met the standards? • How are subgroups performing over time? • Is there evidence improvement strategies are working? • How should state and districts allocate resources?(Heritage, 2013)

22. Smarter BalancedSummative Assessment • Developed with broad input from stakeholders in every consortium state • Computer Adaptive Test • Multiple choice • Short answer • Performance Tasks • Theme and scenario-based sets of materials • Measure higher-order thinking skills

23. Smarter BalancedSummative Assessment • Students who pass 11th grade test will receive exemption from remediation in first year of college

24. Smarter Balanced Summative Assessment MATH Multiple Choice/Short Answer MATH Performance Task ELA Multiple Choice/Short Answer ELA Performance Task

25. Smarter Balanced Item Types SR CR ER PT TE

26. Assessing Deeper Knowledge Smarter Balanced ISAT Identify Define Memorize Organize Classify Compare Identify Define Memorize Organize Classify Compare 30% 90% Critique Revise Investigate Critique Revise Investigate Create Evaluate Design Create Evaluate Design 70% 10%

27. DOK 1: Selected Response SR CR ER PT Grade 6 Math – Selected Response TE

28. Assessing Deeper Knowledge Smarter Balanced ISAT Identify Define Memorize Organize Classify Compare Identify Define Memorize Organize Classify Compare 30% 90% Critique Revise Investigate Critique Revise Investigate Create Evaluate Design Create Evaluate Design 70% 10%

29. DOK 2: Drag and Drop (Matching) SR CR ER PT TE

30. Assessing Deeper Knowledge Smarter Balanced ISAT Identify Define Memorize Organize Classify Compare Identify Define Memorize Organize Classify Compare 30% 90% Critique Revise Investigate Critique Revise Investigate Create Evaluate Design Create Evaluate Design 70% 10%

31. DOK 3: Constructed Response SR CR ER PT TE

32. Assessing Deeper Knowledge Smarter Balanced ISAT Identify Define Memorize Organize Classify Compare Identify Define Memorize Organize Classify Compare 30% 90% Critique Revise Investigate Critique Revise Investigate Create Evaluate Design Create Evaluate Design 70% 10%

33. DOK 3-4: Performance Tasks SR ER PT TE

34. Other Item Types: Manipulatives

35. Other Item Types: Embedded Video

36. Essential Elements for a Quality Next-Gen Assessment System • Full alignment to Common Core Standards • Computer-based summative assessments in grades 3-8/HS • Computer-based interim assessments • Formative assessment tools for teacher development • Assessment of lower & higher-order thinking skills • State involvement in development and quality assurance • Sole ownership of student data • Data availability to states for further analysis • Cost neutrality or savings • Extensive accommodations and accessibility options

37. Michigan Study on CCSS Assessments

39. Smarter Balanced Technology Specifications • Devices • Software • Other Hardware • Network • BYOD

40. Device Compatibility PC: http://farm3.staticflickr.com/2838/9527140126_6b8d88348c_o.jpg MAC: http://upload.wikimedia.org/wikipedia/commons/7/74/Mac_mini_2012.jpg Laptop: http://pixabay.com/p-41070/?no_redirect Tablet: http://upload.wikimedia.org/wikipedia/commons/a/a4/IPad_3.png

41. Software Specifications

42. Future Software Considerations

43. Other Hardware Requirements • 10” Screen size • Headphones • External keyboards • Pointing device (finger) • Printers (for accommodations)

44. Network Requirements • 10–20 Kbps per student or less • Bandwidth Test: https://air.tds.airast.org/student/Pages/LoginShell.aspx?section=sectionDiagnostics&c=SBAC_PT • Bandwidth test can be accessed using most browsers, except Internet Explorer

45. http://farm8.staticflickr.com/7206/6776952988_8a7273ab29_o.jpghttp://farm8.staticflickr.com/7206/6776952988_8a7273ab29_o.jpg

46. Idaho Tech Readiness • Meeting Minimum Operating System: 98.5% • Meeting Minimum Display Size: 96.6% • Meeting Minimum Screen Resolution: 96%

47. Questions? Dr. TJ Bliss Director of Assessment and Accountability, SDE SBAC State Lead for Idaho tjbliss@sde.idaho.gov (208) 332-6842