Building Engaging Games for Learning AND Assessment

1. Building Engaging Games for Learning and Assessment Kristen DiCerbo, Ph.D. Vice-President, Education Research @KristenDiCerbo July 2017 Image by Ruben Alvarado

2. Game-Based Assessment 2 2

3. 3

4. The ability to capture data from everyday events should fundamentally change how we think about learning and assessment. 4

5. New Ways of Thinking Item Paradigm Activity Paradigm Problem Formulation Items pose questions Activities request action Output Items have answers Activities have features Interpretation Items indicate correctness Activities provide attributes Activities provide multi-dimensional information Information Items provide focused information 5

6. Some Things We’ve Figured Out You need assessment experts, content experts, and game designers 6

7. Some Things We’ve Figured Out Evidence-Centered Design works… sort of 7

8. Some Things We’ve Figured Out The process must be iterative 8

9. Some Things We’ve Figured Out Think About Systems 9

10. 5 Key Elements 10 1 0

11. Domain and Student Models 11

12. Task Model 12

13. Evidence Model – Evidence Identification and Scoring 13

14. Evidence Model – Evidence Identification and Scoring Student Time Attempts Mean Space Median Space Min Space 14

15. Evidence Model – Evidence Accumulation 15

16. Communication 16

17. Some Things We Haven’t Figured Out ■ Despite promises of “hundreds of data points,” we always end up with relatively few in our measurement models. Why is that? ■ How do we define evidence for validity and reliability? ■ How do we scale development? ▪ Costs ▪ Time ▪ Staff 17