Evaluating a Game Simulation Kit in Second Life

1. Evaluating a Game Simulation Kit in Second Life Dr. Cynthia Calongne Institute for Advanced Studies Colorado Technical University NMC Symposium March 25, 2009 Operation Codename: Anaconda Global Learning Forum Briefing Slides by Dr. Andrew Stricker Licensed under a Creative Commons Share Alike with Attribution License

2. Air Force Simulations

3. Explorations

4. MyBase Visitor Center Spinoza Quinnell and Lyr Lobo

5. AF Global Learning Forum - Serious Game Simulation

6. Game Simulation Kit Team (l to r) Toni Weezels, Harley Weissman, Spinoza Quinnell, Scarlett Stand, Ry Auerbauch and Apollo Segall

8. Air Operations Center (AOC) Sample game scoring system and group dynamics 8

9. Participants in the Game Simulation Test

10. Hostage Rescue: Armed and dangerous

11. OPERATION PRE-BRIEF Operation Codename: Anaconda Communications: MNF Command Authority, Colonel Stone Ops Intel: A small group of insurgents, a mujahideen proxy military force for al-Qaeda, on the island of Ayab (50 miles from the coast of Murma) are holding one or two hostages. The insurgent leader’s identity is unknown but from information provided by the escaped interpreter, a rendered portrait is depicted on the right. It is likely the insurgents expect a rescue attempt by a coalition force. It is also expected the insurgent leader will attempt to relocate the physician hostage off of Ayab before a rescue attempt can be executed. Rendered drawing: identity unknown Slide courtesy of Dr. Andrew Stricker

12. OPERATION PRE-BRIEF Operation Codename: Anaconda Communications: MNF Command Authority, Colonel Stone Ops Intel: One of the hostages, pictured on the right, is an internationally known physician associated with the World Relief Organization. She and a small team of relief workers went to the isolated island of Ayab following a typhoon to provide medical assistance and evacuation of island inhabitants before another expected typhoon hits the island in the next 48 hours. The escaped interpreter reported the physician was wounded in the leg and the other remaining hostage was shot dead on the attempted escape. Slide courtesy of Dr. Andrew Stricker Dr. Algernon Loire

13. OPERATION PRE-BRIEF Operation Codename: Anaconda Communications: MNF Command Authority, Colonel Stone Ops Intel: The island of Ayab has an abandoned WWII era u-boat base located on a lagoon inlet from the south bay. The island is hilly and rocky with sparse vegetation. It is believed the insurgents have fortified the u-boat base. Satellite photos suggest the presence of underground tunnels. Slide courtesy of Dr. Andrew Stricker South lagoon and U-boat base location

14. OPERATION PRE-BRIEF Operation Codename: Anaconda Communications: MNF Command Authority, Colonel Stone COA: The team will be inserted on the southeast side of the lagoon entrance under the cover of darkness. Using zodiac crafts the team will proceed to the lower u-boat docking area and recon the warehouse. An exit defense zone will also be established for the extraction. Via intercepted cell phone calls, MNF intel reports the hostages are likely located in the underground u-boat quarters. Extraction of the hostagesshould proceed back to the defense zone for zodiac evac. Be prepared to adapt COA depending on situational factors. Mission duration NTE 2 hrs. Content by Dr. Andrew Stricker, 2008

15. OPERATION PRE-BRIEF Operation Codename: Anaconda Communications: MNF Command Authority, Colonel Stone Ops Intel: Defense satellites are being positioned to provide for near continuous coverage of Ayab. Mission communication will be via secured MNF satellite uplink and downlink channels. Additionally, a predator UAV is being positioned to provide assistance as needed. Slide courtesy of Dr. Andrew Stricker

16. OPERATION PRE-BRIEF Operation Codename: Anaconda Communications: MNF Command Authority, Colonel Stone Ops Intel: Historical Ayab photos on the right depict fortified bunkers from the u-boat base area and warnings of a mine field. Expect the insurgents to use the bunkers and tunnels to resist extraction of the hostages. Insurgents are expected to be well armed with AK-47s and rocket propelled launchers. Slide courtesy of Dr. Andrew Stricker

17. OPERATION PRE-BRIEF Operation Codename: Anaconda Communications: MNF Command Authority, Colonel Stone • Operation ROEs: • Proceed only via operation directives obtained from MNF communications (Operation Flags) • Reach Operation Flags (1 to 8) by allotted time constraints • Use only minimal force necessary for safe extraction of hostages • Respect civilian property and protect innocent civilians from harm • Slide courtesy of Dr. Andrew Stricker

18. OPERATION PRE-BRIEF Operation Codename: Anaconda Communications: MNF Command Authority, Colonel Stone • Remember MNF Operation ROEs • Review the COA • Rehearse operation roles • Gear up for insertion into Ayab • Slide courtesy of Dr. Andrew Stricker

19. Strategic areas in the Game Simulation Kit

20. 1st view of the simulation range, looking to the left

21. Lyr Lobo sneaks around the range

22. Levels of Assessment Knows it matters (values) Knows how Does Thinks (adapts) Absent Emerging Developing Mastering 0 1 2 3 4 5 6 Assessment Rubric Skill Levels: Rating Scale: Slide courtesy of Nancy F. Smith

23. Context of Challenge 1 2 3 4 5 Initial exposure to situation or challenge Assessment of situation COA determination Implementa-tion of COA Feedback & interpretation Assessment Rubric Slide courtesy of Nancy F. Smith

24. Activity Distinguished Proficient Minimally Proficient Unsuccessful Use of Comm Outside of Group Channel 3 Points No use of outside comm (e.g., IM, email) 2 Points 1 instance of outside comm 1 Point 2 instances of outside comm 0 Points 3 or more instances of outside comm Game Rules Rubric Other activities to be observed Time Limits, Use of Weapons, Use of Devices (other than weapons), Flying, etc. Slide courtesy of Nancy F. Smith

25. Game activities • Pre-briefing • Game preparation • Elevator down • Game play • Find the 1st flag • Share information • Select a strategy • Navigate to flags • Achieve objectives • Rescue the hostages Scenes from the Game

33. After the alpha test - under fire!

34. Observations Initial confusion How to reload the weapon Group name uncertain Blue Team Strengths Sharing the flag orders Teamwork Second Life observations Tight camera angles in corridors Where do we go? Had to explore, discover and solve problems Who is the enemy? Shot a friend -- oops! Post-Test Debriefing Four game participants CTU Students - first term in SL

35. Experience Exhilarating experience Fun, immersive game! Realistic environment Shared leadership roles Ideal for teamwork Great for group decisions Great communications Unfamiliar terrain added to the realism Participant Feedback • Next test • Use the rubrics • Monitor the voice communications • Analyze the chat log • Post debrief • Discuss the team decisions and leadership roles

36. Participant Recommendations • After the initial game test with novice users • Add a portable game map? • More briefing time - for novices • Practice military communication protocol • For realistic human movement simulation • Navigation for crouch & turn • Camera constraints - for realistic viewpoint • Future Use • Great for testing modern warrior technology

37. After the game, testing a military training system

38. CTU Student Rides the Monorail

39. Other Air Force Simulations

40. Acknowledgements • The Global Learning Forum Team • Second Life Names: Toni Weezels, Harley Weissman, Spinoza Quinnell, Scarlett Stand, Ry Auerbauch Apollo Segall • Nancy Smith - assessment rubrics • Dr. Andrew Stricker - Spinoza Quinnell - briefing content • Game Simulation Kit, 5 regions of content, rubrics • Colorado Technical University Doctoral Students • Arlene Chisley-Wade • Guillermo Quintero • Dennis Musick • John Orosco

41. Evaluating a Game Simulation Kit in Second Life For more information, visit: http://ctusoftware.blogspot.com http://www.slideshare.net/lyrlobo Dr. Cynthia Calongne Lyr Lobo in Second Life Twitter Lyrlobo Lyr Lobo CS 820 Game participants