150 likes | 168 Views
Instrument for Participant Communication. Chapter 12. Instrument Development Process. Phase 1: Developing the instrument design strategy Phase 2: Constructing and refining the measurement questions Phase 3: Drafting and refining the instrument. Flowchart for Instrument Design. Investigative
E N D
Instrument for Participant Communication Chapter 12
Instrument Development Process • Phase 1: Developing the instrument design strategy • Phase 2: Constructing and refining the measurement questions • Phase 3: Drafting and refining the instrument
Flowchart for Instrument Design Investigative Questions Prepare Preliminary Analysis Plan Measurement Questions Pretest individual Questions Instrument Design Pretest Individual Questions Instrument Ready for Data Collection
Data Hierarchy • Management Question • The dilemma, stated in question form, that the manager needs resolved • Research Question • The fact-based translation of the question the researcher must answer to contribute to the solution of the management question • Investigative Question • Specific questions the researcher must answer to provide sufficient detail and coverage of the research question • There may be several questions as the researcher moves from the general to the specific • Measurement Question • Questions participants must answer if the researcher is to gather the needed information and resolve the management question
Strategic Concern • What type of data is needed to answer the management question? • What communication approach will be used? • Should the question be structured, unstructured or some combination? • Should the question be undisguised or disguised? If the latter, to what degree?
Data Collection • Type of data • Communication approach • Question structure • Disguising objectives and sponsors
Ways to Interact with the Participant • Personal interview • Telephone • Mail • Computer
Types of Measurement Questions? • Target • Classification • Administrative
Appropriate Question Content • Should this question be asked? • Is the question of proper scope and coverage? • Can the participant adequately answer this question, as asked? • Will the participant willingly answer this question, as asked?
How to Test a Respondent’s Appropriateness • Filter questions • Screen questions
Question Wording Criteria • Is the question stated in terms of a shared vocabulary? • Does the question contain vocabulary with a single meaning? • Does the question contain unsupported assumptions? • Is the question correctly personalized? • Are adequate alternatives presented within the question?
What Dictates Your Response Strategy? • Characteristics of participants • Nature of the topic(s) being studied • Type of data needed • Your analysis plan
Types of Response Questions • Free-response • Dichotomous • Multiple-choice • Checklist • Rating • Ranking
Guidelines to Refining the Instrument • Awaken the participant's interest • Use buffer questions as a guide to request sensitive information • Use the funnel approach to move to more specific questions
Improving Survey Results • Pretesting is an established practice for discovering errors and useful for training the research team