70 likes | 197 Views
Measuring Human P erformance: Demand Characteristics and Range E ffects. Orne (1961) and Poulton (1975) Presenter: Brenda. The Problem Set (1). Research participant responses may be affected by Demand Characteristics Want to be ‘good’ participants and perform well
E N D
Measuring Human Performance:Demand Characteristics and Range Effects Orne (1961) and Poulton (1975) Presenter: Brenda
The Problem Set (1) • Research participant responses may be affected by Demand Characteristics • Want to be ‘good’ participants and perform well • Want to perform as expected • May guess the hypothesis and want to help (or not) the researcher’s goal • Negatively affects reproducibility, ecological validity • Related to Hawthorne Effect?
What to do about Demand Characteristics • Study • Minimize • Deception • Control of information to participant • Minimal researcher/participant contact • Account for it statistically • Post-research survey one-sample t test on mean • Correlate survey results to dependent variable • Stats with and without positive outliers • Between-Subjects Design
The Problem Set (2) • Range effects may account for performance • Central tendency in human response behavior • Common in within-subjects designs • Suspect in many venues of performance • Subjects learn the range of stimuli and adjust or confuse response • Could it be something else? • Adaptation Level Theory (Helson, 1964) • Sensory system physiology • Parallel processing • Exhaustive serial scanning
What to do about Range Effects • Use between-subjects design as the standard • Use within-subjects design followed by a between-subjects design with different groups of participants
System Testing and Operations • Do demand characteristics and range effects play a role in system design/testing? • How would human-system interaction be influenced? • Unintended consequences in operational settings?
Additional References • Perceived Awareness of the Research Hypothesis (PARH) Scale • Rubin, M., Paolini, S., & Crisp, R. J. (2010). A processing fluency explanation of bias against migrants. Journal of Experimental Social Psychology, 46, 21-28. • https://sites.google.com/site/markrubinsocialpsychresearch/a-measure-of-the-influence-of-demand-characteristics • US Army Land Warrior System • http://www.nap.edu/openbook.php?record_id=5436&page=R1 • http://www.scribd.com/doc/95088640/Human-Factors-Evaluation-of-Land-Warrior-Version-1-0