70 likes | 157 Views
Proceeding to the Questions and Simulation from the Instructions Tab. Issue: Half of the participants tried to advance on to the questions and simulation by first clicking the red “START” text. Suggestions: Stylize the entire statement not just the “START” text.
E N D
Proceeding to the Questions and Simulation from the Instructions Tab Issue: Half of the participants tried to advance on to the questions and simulation by first clicking the red “START” text. Suggestions: Stylize the entire statement not just the “START” text. Adding a picture or arrow indicating the tab
Question 1 • Four out of six participants correctly answered the question on the first attempt • The other two participants moved on to the second question without correctly answering question 1 • Only two participants used the simulation after selecting an answer choice. “It’s good. I understood it.”-S5
Question 2 • Only one participant correctly answered on the first attempt • Only one participant correctly answered on the second attempt • Four participants correctly answered on their second attempt: correct answer via process of elimination • One participant abandoned the question, after 1 attempt. • Two participants used the simulation before attempting to answer the question • One of these participants also used the simulation after attempting to answer the question • Four participants used the simulation after one attempt • One participant never used the simulation at all “I’m trying to figure out what candidate A and candidate B is” –S1 “I assumed that it [the animals in the simulation] was pertaining to this [question #2] automatically”-S6
Learning Objectives Tab Issue: Only two participants visited the learning Objectives tab during the session Suggestion: Consider reordering the tabs, have Learning Objectives after the Instructions but before Use Simulation. Purposefully direct them to the tab. In reference to the order of the tabs: "In all honesty, it was not in the order I would have gone“ – S1 “1st should be learning objectives, then instructions, then questions“ – S2
Additional Comments • Four participants did not use the simulation after answering question 1 • Two participants did not use the simulation at all • Stratified sampling is not explicitly mentioned in the questions • Most participants never switch from random sampling to stratified sampling “I would assume that if you had a simulation, you would do it before you had a chance to answer the questions?... I think a lot of people would just skip the simulation if they got it right“ – S3 "There should be a question that makes you use stratified sampling, or something about how to use it“ –S1
Positive Feedback • All participants said the tabs were easy to understand and navigate. • All participants said the instructions were easy to understand • They knew where to go to use the simulation, they just didn’t always see the need to use the simulation • With respect to the illustrated simulation instructions: • “Having arrows and the pictures really helped” –S1