100 likes | 230 Views
Chapter 24. Final preparations for evaluation. Completing preparations. Geez, I thought we were all ready… This chapter dots the i’s and crosses the t’s I guess…. Roles for evaluators. If you’re the only person, you have to do everything…or, assign, I mean, delegate responsibilities
E N D
Chapter 24 Final preparations for evaluation
Completing preparations • Geez, I thought we were all ready… • This chapter dots the i’s and crosses the t’s I guess…
Roles for evaluators • If you’re the only person, you have to do everything…or, assign, I mean, delegate responsibilities • Facilitator: • “flight attendant”, looks after well being of participant • “sportscaster”: data collector, keeps the participant talking (if talk-aloud, presumably) • “scientist”: ensuers data collected in scientific manner (objective, unbiased, etc.)
Other roles • How many roles are there? Lots… • Note-taker: self-explanatory • Equipment operator: self-explanatory • Observer: good for “outsiders” (e.g., stakeholders) • Meeter and greeter • Recruiter • Lone Evaluator: does all of the above
Use a script • (Seems like I said to use a script several times already…) • Scripts are important for several reasons: • so you don’t forget to say or do something (e.g., get consent form signed) • so you don’t influence the participant, or if you do, at least the influence is consistent (e.g., between groups)
Informed Consent • What’s on the Informed Consent Form? • Rights of the participant • minimal risk (no harm) • procedural info (what is going to happen) • comprehension (does user understand) • voluntariness (no coercion or pressure) • human rights (participants must be informed) • Rights of the company/school • nondisclosure (is an NDA needed?) • confidentiality (thought this was subject’s identity kept secret) • waivers (for pictures, video recordings, etc.) • legalese (use plain English) • expectations (not clear on this…)
Example of IC form • See Clemson’s IRB: • http://www.clemson.edu/research/orcSite/orcIRB.htm
Pilot study • Before running the full experiment, run a pilot study: • this will expose “minor annoyances” that you may have missed, that are easy/quick to fix, but that may hinder collection of the “real data” • you can generally expect to throw away all data collected in the pilot