1 / 23

Updating Certification: Providing Robust Assessment through Games

Share stories and techniques about certifications for learning game designers and for games as learning and assessment products as technologies advance. Join the highly interactive discussion of the growing demand for games as assessment methods and as alternatives to traditional multiple-choice exams. Come discover the emerging world of assessments where games, gamification, augmented reality, virtual reality, and certifications are creating new assessment techniques. For those who attended this session in 2017, this version will discuss changes emerging in 2018.

Download Presentation

Updating Certification: Providing Robust Assessment through Games

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. The Challenge of Certification: Using games for assessment Sharon L. Gander, M.Ed, CPT, CACP. CIDD Judith Hale, Ph.D., CPT, CACP, CIDD, CTF Hale Associates www.HaleCenter.org

  2. Sharon Gander, M.Ed., CPT, CACP, CIDD  Director of ID Certification  Learning Architect  Certification Specialist  Performance Improvement Specialist Other Gov’t  Item writer  Author & Blogger Healthcare Non-Profit  Holds a badge in Serious Learning Game design & development Connecting learning to workforce development through targeted learning solutions using emerging and traditional learning technologies, certifications, microcredentials, and badges in order to show performance improvement. Social Service Information Technology P-20 Education

  3. Who Am I? I write books  Author of award winning and practical books  Filled with job-aids, common missteps, best practices

  4. I Build Certifications & Accreditations Architectural Lighting 30+ years experience designing & developing credentials for organizations:  Adopted across all industries  Used in more than 90 countries Roofing Facilities Performance Improvement Based on:  Universal standards  Evidence-based and performance-based  Plain Language & Global English Standards  Internal and external integrity Credentialing Instructional Design Cyber Security Google: Serious Learning Assoc. Android Developer Cloud Architect Data Engineer Games Learning Solutions

  5. Some Clients Industries • Education • Energy • Entertainment • Facilities • Finance • Healthcare • Hospitality • Human Resources • Insurance • Manufacturing • Technology • Trades • Transportation * All registered trademarks and logos are owned by their respective companies and are shown here only for illustrative purposes

  6. Getting on the Same Page Key Concepts & Terms

  7. What is a Test  A test is a stimulus (any assessment device) designed to elicit a sample of a taker's physical or intellectual behavior in a specified domain. APA Standard 1  Along with the stimulus is a scoring procedure to allow user (you) to measure, evaluate, and interpret the taker's behavior. APA standard 2

  8. What is a Game  Attested as early as 2600 BC, games are a universal part of human experience and present in all cultures.  A game is a structured form of play, usually undertaken for enjoyment and sometimes used as an educational tool.  Games are distinct from work, which is usually carried out for remuneration, and from art, which is more often an expression of aesthetic or ideological elements.  Key components of games are goals, rules, challenge, and interaction. Games generally involve mental or physical stimulation, and often both. Many games help develop practical skills, serve as a form of exercise, or otherwise perform an educational, simulational, or psychological role. Wikipedia, June 26,2017

  9. What is Evidence-Based Assessment  The assessment requires evidence of competence or capability through:  Demonstration  Attestation  Artifacts  Portfolio Can games, virtual reality (role play) scenarios provide evidence of competence and capability?

  10. Tapping Your Experience Can games be used as a valid form of evidence-based assessment and, in particular, for evidence used to certify individuals?

  11. Evolution of Work* *Art Isaacs Products & systems Increasing Complexity of Work Miniaturization Computerization Simple Stand alone Systems New Materials Workers & contractors Increasing Diversity Technical Specialization Multi skilled Mixed skills Skilled Unskilled Government supplier customer Increasing Interface Collaborative Directive Quality approach Increasing Quality 1930 1970-1980 1990-2020+ 1960 1940-1950 Craftsman Quality assurance Total quality Quality control Inspection

  12. Impact on Level of Work Being Certified Type I Type II Repetitive Projects Know what compete looks like and how to get there Quasi-experimental Have well described methods Type III Type IV Complex Work Know what success looks like, but more than one way to do it R&D Not sure what success looks like and don’t know how to get there

  13. Levels of Assessments  Assess Knowledge:  Assess Performance:  Ask questions to elicit recognition and recall of facts  Ask for demonstration of a procedure under controlled conditions  Assess Application:  Assess Proficiency (fluency):  Ask questions requiring classification, deduction, or comprehension  Ask for artifacts that demonstrate the application of a rule or principle in non-controlled or real world environment

  14. What is most challenging about using a game as an assessment?

  15. What is most challenging about using a game as an assessment? 1. Cognitive fidelity  Realism of the cues, decisions, outputs 2. Physical fidelity  Too much or too little physical activity is a distraction 3. Balancing the skills being measured versus game play  Time/effort on game play can detract from the time/effort devoted to solving problems or the performance objective

  16. What is most challenging about using a game as an assessment? 4. Feedback  How helpful is it? Must direct player’s attention to important cues, decisions, & solution characteristics. Must go beyond right/wrong 5. Level of challenge  Level of challenge is in the mind of the player – so pilot test with people who represent the target audience, and ask

  17. What would be the advantage for using a game as an assessment?

  18. What would be the advantage for using a game as an assessment?  Opportunity for high cognitive fidelity  But make sure the game experience supports the cognitive skills being developed and assessed  Feedback is key to learning and reinforcing the desired behaviors – so ask what information is given to the player?  Does it call attention to the cues or information that is important in the real work?

  19. What Can You Do Next? How can we make game-based actions as valid an assessment as rote knowledge for the purposes of demonstrating mastery or should games be reserved for fun and learning?

  20. Thank you Join us at www.HaleCenter.org where membership is free. •

  21. Need More? Ask About how to Get Your Game Certified. Ask About our Consulting and Psychometric Services

More Related