90 likes | 103 Views
This research aims to investigate how faculty and undergraduate students use electronic literature retrieval systems for class-related tasks. The study explores search processes, information selection, and system-related difficulties encountered. Data collection includes behavioral observations, think-aloud protocols, and topic descriptions before and after searches. Analysis involves transcription, verbalization coding, and comparison between participants.
E N D
Searching and Using Electronic LiteratureIII. Research Design
Framework for Empirical Research of Human Behavior • Paradigms • positivist • naturalistic • dualistic A research design is guided by a paradigm using a methodology • Methodologies • quantitative • qualitative • pluralistic
Classic Method for Observation • Experiment (rigid standards exist) • randomization • treatment • to find cause-effect (relationship between dependent and independent variables) • to test hypothesis based on statistical significance of quantitative data
Alternative Method • Naturalistic experiment • observing real behaviors in real life • subject's own environment • to describe behavior • to interpret or model behavior • typical data: interactions, verbalized thoughts, diaries, participant-observations, interviews • longitudinal
Research Questions 1. How are electronic literature retrieval systems used in finding useful information for class-related tasks by faculty and undergraduate students? • What type of information is used for selecting documents? • What type of information is used for defining topics?
Research Questions (cont’d) 2. What are the search processes? • Which system functions are used and how? • What problems related to system do users encounter during the search? 3. Are there any differences between faculty and students? What are the differences if any?
Experimental design • Participants • Participants from Phase I • New participants with similar backgrounds • Simulated class-related tasks • Faculty: conducting a search for literature to design a course assignment • Students: conducting a search for literature to complete a course assignment
Data Collection • Behavior • Search process (video) • Think-aloud during searching (audio synchronized with video) • Topic description before searching • Topic description after searching • Post search input • Cognitive trait • Learning style
Data Analysis (Plan) • Transcribing data • Verbalization (reasons for certain actions) • Search formulation / reiteration • Screen action • Selection behavior • Coding