300 likes | 623 Views
BONY WIEM LESTARI EPIDEMIOLOGY AND BIOSTATISTICS DEPARTMENT 2012. QUESTIONNAIRE DESIGN AND VALIDATION. Learning Objectives:. A tool for collecting information to describe, compare, explain, knowledge, attitudes, behaviors, and/or demographic characteristics on a particular target group.
E N D
BONY WIEM LESTARI EPIDEMIOLOGY AND BIOSTATISTICS DEPARTMENT 2012 QUESTIONNAIRE DESIGN AND VALIDATION
A tool for collecting information to describe, compare, explain, knowledge, attitudes, behaviors, and/or demographic characteristics on a particular target group What is Questionnaire?
Types of Questions: • Open-ended questions • Permit free response which should be recorded in the respondents’ own words. • 2. Closed questions • Have a list of possible options or answers from which the respondents must choose.
Identify: (Self learning) Advantages & disadvantages of open-ended questions Advantages & disadvantages of closed questions
Steps in Designing A Questionnaire • Content Take your objectives and variables as a starting point • Formulating questions • Formulate one or more questions that will provide the information needed for each variable • Check whether each question measures one thing at a time • Avoid leading questions • Avoid words with double or vaguely defined meanings or that emotionally laden • Ask sensitive questions in a socially acceptable way
Steps in Designing A Questionnaire • Sequencing the questions • Design your interview schedule or questionnaire to be ‘informant friendly’ • Use simple, everyday language • Formatting the questionnaire • Translation If interviews will be conducted in one or more local languages, the questionnaire should be translated in order to standardise the way questions will be asked.
Steps in Questionnaire Development: (Cohen) Conceptualization: abstract construct – conceptual definition – operasionalization - indicator Constructing Testing Analysis Revising
Questionnaire is a tool: • The quality of a measurement: validity and reliability Validity: • the extent to which a test measures what it is intended to measure • Free of systematic error • Accuracy
Questionnaire is a tool: Reliability: • The degree to which a variable has nearly the same value when measured several times • Free of random error (chance) • Precision • Also called reproducibility, consistency • Assessing precision (reproducibility of repeated measurement): • Within – between observer • Within – between instruments
Reliability: • Reliability coefficient ~ correlation coefficient (0 – 1) • A questionnaire is reliable when the minimum reliability coefficient is 0.7
Assessing Validity: Criterion validity (predictive and concurrent) depending on whether the criterion refers to a current or future assessment Construct validity assembly evidence to support or refute a complex scientific theory and to show under what circumstances it holds true
Assesing Validity: • Content validity • refers to comprehensiveness • how adequate the sampling of questions reflects the aims of the index that were specified in the conceptual definition of its scope
FINAL REMARKS: • prior to using a questionnaire it has to be established that the instrument is valid and reproducible in the context (i.e. population, setting and study design) in which it is going to be employed. • conceptually comparable (conceptual equivalence) • developing a new questionnaire is very time-consuming • burden on respondents • practical aspects of the study
REFERENCES: • Measuring Health: A Guide to Rating Scales and Questionnaire. Ian McDowell and Claire Newell. 1996. • Psychological Testing: Design, Analysis and Use. Lisa Friedenberg. 1995. • Designing and Conducting Health System Research Projects. KIT Publishers. WHO. 2003
THANK YOU What’s Your Message?