80 likes | 199 Views
Reading and Evaluating Research. Method. Method . Essential question to ask about the Method: “Is the operationalization of the hypothesis valid? Sections: Section 1 – Design Section 2 – Participants Section 3 – Materials Section 4 – Procedures Overarching Concepts:
E N D
Method Essential question to ask about the Method: • “Is the operationalization of the hypothesis valid? Sections: • Section 1 – Design • Section 2 – Participants • Section 3 – Materials • Section 4 – Procedures Overarching Concepts: • Construct Validity • External Validity • Internal Validity • Confounds
1 Design • Did the author(s) state the research design? This section is not always included, especially if the methodological approach is simple, such as a survey. For more complicated designs, you can ask the following questions… • Type of design? • Between or within? • If manipulations, levels? • How does the overall design relate to the hypothesis?
2 Participants • Did the author(s) indicate the participants? This section typically involves descriptive data about the sample. Some articles present this information in the Method section while other articles present this information in the Results section. • Number of participants (see external validity) • If demographic characteristics, what is reported? • If participants were removed, then is there the number, rationale, exclusion criteria?
3 Materials • Did the author(s) discuss the materials used in the study? The Materials section always includes the measures used in the study, and sometimes includes information about manipulations if they involve materials (otherwise reported in section about “Procedures”) • Clear and explicit? • If from published works, … • If from new or unpublished works, … • Appropriate to hypothesis? • Are there other relevant materials?
3 Materials (CONTINUED) Questions about content of items • One concept per item? • Can vary on the item? • If open-ended, how coded? • Scale points issues? • Labeling issues?
4 Procedures • Did the author(s) discuss the procedures used in the study? The procedures are the step-by-step chronology of the aspects that occurred in the study. Not all studies require a formal Procedures section if the methodological approach is basic or only involves one step, such as a survey. • Clear and explicit? • If from published works, … • If from new or unpublished works, … • Appropriate to hypothesis? • Cover story?