1 / 21

Factors Influencing Item Nonresponse in the NSSE Survey:  Why do Students Skip so many Questions?

Factors Influencing Item Nonresponse in the NSSE Survey:  Why do Students Skip so many Questions?. Presented by Chris Maxwell Purdue University AIR 2009. Introduction. Purdue NSSE 2004: Max Item Nonresponse: 10% Purdue NSSE 2007: Max Item Nonresponse: 18% Purdue NSSE 2007: • Web Only

tommy
Download Presentation

Factors Influencing Item Nonresponse in the NSSE Survey:  Why do Students Skip so many Questions?

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Factors Influencing Item Nonresponse in the NSSE Survey:  Why do Students Skip so many Questions? Presented by Chris Maxwell Purdue University AIR 2009

  2. Introduction Purdue NSSE 2004: Max Item Nonresponse: 10% Purdue NSSE 2007: Max Item Nonresponse: 18% Purdue NSSE 2007: • Web Only • Targeted Oversample: Underrepresented • 24% response rate • 1,388 total respondents (703 FY and 685 SN)

  3. All Students (FY and SN) N=1,388

  4. Investigation Question order is an apparent factor, but is anything else at play? Model the response probability with logistic regression: • Separate models for students grouped by class, ethnicity, gender, and STEM status (18 total). • Each model includes the explanatory variables question order, type, length, and first page status.

  5. Model Details Ln(P/(1-P)) =A+B1(order)+B2(page1)+B3(likert4_scale) +B4(numerical_scale)+B5(length) Use SAS proc Logistic (binary modeling, stepwise selection) Input data set

  6. Model Results Stepwise selection rejected question types and length as useful predictors in every case 15 models use question order and page one status, with 3 models only using question order Ln(P/(1-P)) = A + B1(order) + B2(page1) -or- P = exp(A + B1(order) + B2(page1)) 1 + exp(A + B1(order) + B2(page1))

  7. FY and SN Results N=685 N=703

  8. FY and SN Results N=685 N=703

  9. Model Parameters Thus, for FY students the model predicts a 9% decline in response after the first page, and in the middle of the survey a 1% drop for every 6 questions.

  10. FY: STEM and Non STEM Majors N=301 N=399

  11. SN: STEM and Non STEM Majors N=219 N=459

  12. FY: Male and Female N=356 N=347

  13. SN: Male and Female N=339 N=346

  14. FY: All Underrepresented N=564 N=99

  15. FY: African American N=564 N=45

  16. FY: Hispanic N=564 N=44

  17. SN: All Underrepresented N=592 N=76

  18. SN: African American N=592 N=36

  19. SN: Hispanic N=592 N=36

  20. All Model Parameters

  21. Summary Study Limitations Conclusions Discussion Available at: www.purdue.edu/OIR/irvba/AIR2009/nsse.ppt

More Related