1 / 10

Data Collection

Data Collection. In the Beginning. Define Constructs (what is the domain?) Therapy effectiveness Integrity tests Research Question What ’ s the average? Zero? Impact of management (e.g., Brown*) May or may not be summary of a literature Theoretical Justification of Moderators

jisabel
Download Presentation

Data Collection

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Data Collection

  2. In the Beginning • Define Constructs (what is the domain?) • Therapy effectiveness • Integrity tests • Research Question • What’s the average? Zero? • Impact of management (e.g., Brown*) • May or may not be summary of a literature • Theoretical Justification of Moderators • Pick ONE study type (e.g., experiment, correlational study) or pick all and analyze separately. *Brown, S. (1981). Validity generalization and situational moderation in the life insurance industry. Journal of Applied Psychology, 66, 664-670.

  3. Sources of Data (ES) 1 • Electronic Databases • Psych info, APA online • SSCI, Web of Science, PubMed • Google scholar*; What others? • May hire a reference librarian • Conference Proceedings & Abstracts • Dissertations • Local • Distant • Government Docs & Agencies *So far as I know, you cannot use Boolean AND or NOT in Google Scholar, so you get too many returns.

  4. Sources of Data (2) • Hand searches of the literature • Refs in books • Refs in articles • Flip thru journals • People in the area (write, email, drink) • Use your contacts (faculty, friends, etc.) • Butter up • Review Articles (used to be more) • Unpublished manuscripts (prepubs, too)

  5. Eligibility (1) • Country • Language • Measure (specific) • NEO vs Big Five • Beck vs CESD • Measure (general) • Reliability • N of items • Participants (e.g., female cancer survivors; bankers; no students; employed 20 + hr/ week, etc.) • Publications (what type) • Published vs. not The criteria are your choice. But you may have to defend that choice. Do you have good reasons?

  6. Eligibility (2) • Time frame • Gains over time • Time after treatment (e.g., smoking) • Required information • Effect Size • Moderator • Other • You can contact authors for missing info • Study Design • Control group • Repeated Measures • Random Assignment • Specific controls (e.g., dismantling) • Methodological Quality? Code for features, not overall quality

  7. Database 1 • Keep records of the search process and the elimination process to create a flow chart (replication). Example of flowchart soon. • Create a database to hold the effect sizes, data needed to compute them, and potential moderators • Excel is good for a database, but you can use whatever you like

  8. Database 2 • Prepare for reliability of coding – copy code book and database • At least 2 coders who will code ALL the variables independently for at least a sample of studies • Create system to track dependencies (effect sizes from the same study, etc.) • Code Author and Date of Publication separately for cumulative analysis by date

  9. Example Flow Chart

  10. Example Search Setup Note. We sort the documents into bins. Also see the files ‘SearchAurah.xlsx’ and ‘SearchProcessmb.docx’ for examples. The Excel file is for the flow chart. It has no space for coding ES.

More Related