1 / 14

Validity with the CAAP Assessment

Validity with the CAAP Assessment. Validity for what purpose?. Placement/Progress Accountability/Accreditation. Validity measures of what type?. Absolute score based Normative. Possible validity models. Correlations with accepted measures of skills

grimesm
Download Presentation

Validity with the CAAP Assessment

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Validity with the CAAP Assessment

  2. Validity for what purpose? • Placement/Progress • Accountability/Accreditation

  3. Validity measures of what type? • Absolute score based • Normative

  4. Possible validity models • Correlations with accepted measures of skills • Prediction of accepted measures of skills • Change across time

  5. Placement/Progress models • Based on some measure of future success (e.g. graduation, upper level GPA) • Regression model based

  6. Model: Value-Added – All Students .40 Achievement beyond 2nd year Achievement first two years .68 .49 .64 .79 .77 .40 Graduation in 6 years .81 College Readiness High School Prep Value-Added .81 .04 -.02 Progress beyond 2nd year Progress first two years CFI = .95 RMSEA = .08 .39 7

  7. Accountability/Accreditation • Tend to be normative • Comparison group of like institutions • Adjustment for covariates • Longitudinal/Cross sectional

  8. Example of longitudinal study Pascarella, Bohr, Nora and Terenzini, (1995) Journal of Higher Education

  9. Example of cross sectional model • VSA • ACT Linkage report

  10. Linkage model • Uses ACT scores as a covariate • Develops conditional distribution of CAAP scores given ACT score, based on a large sample • Compares institutional distribution with comparison distribution (based on deciles)

  11. What’s next? • Assessments of a different type (non multiple choice) • Standardization of alternative measures (alternative assessment types, portfolios, college GPA)

  12. Example of what is possible • Bassiri and Schulz (2003) Constructing a universal scale of high school course difficulty

  13. International dreams • Is there a PISA or a Bologna in our future? • Is college knowledge the same across the globe? • Are the populations in college the same?

More Related