1 / 35

Paulette Robinson - Microlearning and Gamification in Policy Leadership

Paulette Robinson, Office of Personnel Management (OPM) The policy courses for government leaders offered by OPM in its open enrollment catalog have been redesigned using a blended model that includes microlearning and gamification. In this session, Dr. Robinson will report on the development process and the effectiveness of the new designed based on data collected. Link to video found in slide deck: https://youtu.be/7KmRFrrYk9Y

SeriousPlayConf
Download Presentation

Paulette Robinson - Microlearning and Gamification in Policy Leadership

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Microlearning and Gamification in Policy Leadership Courses Paulette Robinson, PhD Program Director OPM/HRS/CLD/EMDC

  2. Who We Are

  3. Pilot Policy Course Redesign Process Pilot Policy Course Redesign Process • Needs Assessment • Instructional Design • Blended Instructional Design • Selection of a Gamification/Microlearning Platform • Content Development Team • Evaluation and Data Results from Courses • Lessons Learned • Recommendations Going Forward

  4. Needs Assessment Study http://trainingneedsassessment.blogspot.com/

  5. Partnership

  6. Instructional Design Assumptions

  7. Blended Instructional Design Layout The Online Portion (4 Weeks) Residential Portion Pre-Assessment Consistent topical areas and segments with clear segment objectives and overall learning outcomes Review of online materials Micro-learning/gamification (available on smart phones, tablets and computers) Activity to initiate networking and simulation line folder 1: diagrams, job aides, and short summaries No more than 3 expert speakers Online folder 2: Annotated bibliography of additional resources Conduct the simulation Online folder 3: Simulation Process simulation activity Post Assessment

  8. Content Development EOP Foundation)

  9. Finding a Platform for Online Portion

  10. Student Game Home Screen-- GamEffective

  11. Screenshot from GamEffective Missions and Activities My Wins Leaderboard

  12. GamEffective Trivia Game 2. Teaser Question 1. Name of Activity 3. Study Item 4. Test Question 5. Points Awarded

  13. FBPP Game Content Structure Gamification Categories (Campaigns Number of Activities The Policy Environment 1. External Forces 14 2. Internal Influences 18 3. Laws and Regulations 20 4. Budget Elements 27 5. Budget Overview 8 Agency Budget 23 The President’s Budget 36 The Congressional Budget 32 The Appropriations Budget 10 The Allocation (Executive) Budget 24 Total 211

  14. OPM Review Jeopardy Game Introduction Screen Jeopardy Categories Question Feedback

  15. Data Results from Pilot Course

  16. GamEffective Data Game Completion by Week and Campaign Week 1 Week 2 Week 3 Week 4 Total Total Students Completions Policy Environment 3 6 8 11 29 31 President's 3 2 8 16 29 31 Congressional 3 2 4 20 29 31 Appropriations 2 3 4 20 29 31 Allocations 2 3 4 20 29 31

  17. Survey After the Game

  18. Pre- and Post Assessment Pre Assessment 15 Post Assessment 18 Average Score High Score 21 Perfect Score (2) Low Score 8 15 30 questions in assessment/n=26

  19. Student Focus Group—Online Format

  20. Student Focus Group—Residential Format

  21. End-of-Course

  22. End-of Course Evaluation Likert Rating Scale 1-5 Kirkpatrick Evaluation Level (self report) Pilot 2016 Satisfaction: Recommend to colleagues 4.12 3.86 Satisfaction: Worth my time 4.28 3.86 Level 1: Reaction 4.04 3.88 Level 2: Learning 3.95 4.19 Level 3: Job Impact 3.36 4.00 Level 5: Business Results 3.56 4.00 2016 n=7 out of 30 Pilot n=25 out of 31

  23. Recommendations Going Forward

  24. Student Survey After the Game Technology Used to Access FBPP Game Students could choose multiple responses. Answer Choices Responses Number of Responses Percentage Government Smart Phones 3 10% Government Tablet 1 3.33% Government Laptop or Desktop 26 83.33% Personal Smart Phone 7 23.33% Personal Tablet 3 10% Personal Laptop or Desktop 15 50% Total Respondents (30)

  25. Student Survey After the Game Self-Report Student Content Retention Answer Choice Responses # Responses Percentage I remember 100% of the material presented in the game 1 3.3% I remember 75% of the material presented in the game 11 36.67% I remember 50% of the material presented in the game 12 40% I remember 25% of the material presented in the game 6 20% I don’t remember any of the material presented in the game 0 0% Total 30

  26. Student Survey After the Game Engagement of Game Content Answer Choice Responses # Responses Percentage I found the game very engaging 8 26.67% I found the game somewhat engaging 7 23.33% I found the game was OK. 12 40% I fount the game somewhat boring 1 3.3% I found the game boring and uninteresting 2 6.67% Total 30

  27. Student Survey After the Game Technical Issue (Comments) Most Common Responses: 1. Issues in getting into game from government devices (3 responses) 2. Distorted display of the game on Internet Explorer 3. Performance of the GamEffective Platform 4. EMDC produced Jeopardy Games Student Proposed Changes (Comments) 1. Overall positive 2. Couple of students did not like gamification format 3. Few comments suggesting the game be shortened

  28. FBPP End-of Course Evaluation—Kirkpatrick Level 1 1-5 Likert Scale Rating 2016 n=7 out of 30 Pilot n=25 out of 31 Satisfaction Reaction (Level 1) Pilot 2016 Pilot 2016 Recommend to colleagues 4.12 3.86 Worth my time 4.28 3.86 Engagement 4.36 4.12 Program Relevance 3.68 3.71 Faculty 4.56 4.43 Course Materials 3.08 3.14 Activities 4.28 3.57 Environment 4.28 4.29 Overall Level 1 4.04 3.88

  29. FBPP End-of Course Evaluation—Kirkpatrick Level 2 Criteria Likert Rating Scale 1-5 Pilot 2016 Attitude: Commitment to public service 3.72 4.29 Confidence: Apply to work 3.92 4.00 Commitment: Committed to apply to work 4.20 4.19 Overall Level 2 3.95 4.19 2016 n=7 out of 30 Pilot n=25 out of 31

  30. FBPP End-of Course Evaluation—Kirkpatrick Level 3 & 4 Criteria Likert Rating Scale 1-5 Pilot 2016 Training will improve work behaviors (level 3) 3.36 4.00 Program will improve job performance (level 4) 3.56 4.00 2016 n=7 out of 30 Pilot n=25 out of 31

  31. FBPP End-of Course Evaluation 2016 n=7 out of 30 Pilot n=25 out of 31 Likert Rating Scale 1-5 Faculty Simulation Criteria Obannon Hezir Haun Gibbons Jensen Session 1 Presido Overall Instructor enhanced my learning Instructors knowledge/background enhanced my learning 4.68 4.68 4.08 4.52 4.42 4.67 4.52 4.75 4.75 4.12 4.65 4.42 4.71 4.56 Clearly conveyed program information 4.56 4.68 4.08 4.44 4.43 4.75 4.52

More Related