Scrutinizing Data Collection Methods

1. Scrutinizing Data Collection Methods Professor Lisa High University of Windsor

2. Existing Data vs. New Data • First data collection decision: - Use existing data • New data gathered • How will the researcher generate data?

3. Methods of Collection • Historical research • Secondary analysis • Records

4. Data Collection Methods • When existing data is not available • Developing a data collection plan = 3 types of approaches used most frequently: • Self-reports • Observation • Physiologic measures

5. Dimensions of Data Collection Methods Four Dimensions: • Structure • Quantifiability • Obtrusiveness • Objectivity

6. Self-report Methods • Direct questioning • Unstructured Reports: • Completely unstructured interviews • Focused or semi-structured interviews • Focus group interviews • Life histories • Diaries

7. Self-report Methods • Structured self-report - formal means of collection – written document = instrument • Instrument is the “interview schedule” or “questionnaire” ( face to face or telephone) • QUESTION FORMS: • Closed-ended questions or fixed alternative - dichotomous, multiple choice, cafeteria, rank order and forced question • Open-ended questions

8. Instrument Construction • Outline of the instrument’s content • Monitor for: wording, clarity, sensitivity of the respondent’s psychological state, freedom from bias, and reading level • Draft instruments • Critically reviewed • Pre-test/pilot -tested • Borrowed or adapted from other instruments

9. Questionnaires less costly Less time and effort to administer Complete anonymity Absence of interviewer = no biases Interviews face-to-face interviews = good response rates Feasible for most people Questions less likely to be misinterpreted can produce additional information through observation Interviews vs. Questionnaires

10. Scales & special Forms of Structured Self-Reports • Social-psychological scales • response bias (social desirability, extreme response, acquiescence response) • Counterbalancing? • Vignettes • Projective techniques • Q-sorts

11. Evaluation of Self-Report Methods Strengths: • Behaviors can be observed • Yields more information • Most commonly used in nursing Weakness: • Validity and accuracy • Social desirability • Unstructured = time consuming and demanding

12. Critiquing Self-Reports • What to look for: • Degree of structure • Interview or questions uses • Composite scale administered • How instruments administered • Response rate

13. Observational Methods • Alternative to self-reports • Broad applicability Researcher flexibility to several dimensions: • Focus of the observation • Concealment • Duration of observation • Method of recording observations

14. Unstructured Observational Methods • Permits the researcher to see the world as the study participants • To develop a rich understanding and appreciation of the phenomena • Extract meaning form events and situations • Grasp the subtleties of cultural variation • What is participant observation?

15. Gathering Unstructured Observational Data • Consider the following: • The physical setting – where questions • The participants – who questions • Activities – what questions • Frequency and duration – when questions • Process – how questions • Outcomes – why questions

16. Positioning Approaches • Single Positioning • Multiple Positioning • Mobile Positioning

17. Recording Unstructured Observational Data • Log • Field notes • Observational notes • Theoretical notes • Methodologic notes • Personal notes

18. Structured Observational Methods • Differs from unstructured observational • Advance preparation • Accurate categorizing, recording and encoding the observation and sampling • Checklist • Rating scales Observational sampling includes: • Time sampling • Event sampling

19. Evaluation of Observation Methods • Have an intrinsic appeal to capture • Suited for people who are unable to describe their own behaviors • Provides in-depth and diverse information • Humans are used as the measuring instruments • Shortcomings – ethical difficulties, reactivity, observational bias • Unstructured – yield richer data

20. Biophysiologic Measures • Use of biophysiologic and physical variables • Five classes: • Basic biophysiologic processes • Nursing actions = outcomes • Evaluation of specific nursing procedures/interventions • Evaluate & improve the measurement & recording of biophysiologic information • Antecedents and consequences of biophysiologic indicators = possible treatment modes

21. Types of Biophysiologic Measures • Includes:“in vivo measures” or “in vitro measures” • IN vivo measures– performed directly within or on living organisms • IN vivo instruments– to measure all bodily functions and technological advances • IN vitro measures– data gathered from participants extracting some biophysiological material from them • In vitro measures– chemical, microbiologic, cytologic and histologic means

22. Types of Biophysiologic Measures Evaluation of Biophysiologic Measures: • Accurate and precise • Measures are objective • Valid measures of the targeted variables • Cost usually low or nonexistent Disadvantages: • measuring tool may affect the variable • Normally interferences that create artifacts • Energy must be applied – avoid damaging cells

23. Critiquing Biophysiologic Measures Critiquing Biophysiologic Measures: • most important consideration – the appropriateness of the measures for the research question Review: • Box 11-4 – p. 293 – 1st edition • Box 13.5 – p. 308 – 2nd edition