160 likes | 299 Views
International Education Programs Service Technical Assistance Workshop 2009. Office of Postsecondary Education: Program and Project Evaluation February 2, 2009 Strategic Planning Staff, OPE. Discussion Points. Evaluating OPE programs’ performance
E N D
International Education Programs ServiceTechnical Assistance Workshop 2009 Office of Postsecondary Education: Program and Project Evaluation February 2, 2009 Strategic Planning Staff, OPE
Discussion Points • Evaluating OPE programs’ performance • The fit to the Department’s strategic priorities • Program-level assessment • Within-program variability • Assessing project performance • We need your help... • OPE’s commitment
Evaluating OPE programs Program-level assessment: • GPRA measures, PART process, annual reports • (Grantee-level reports) • Program measures Project-level assessment: project measures
More on program evaluation... • We also have periodic, rigorous, formal program evaluations... • Our concern here is with what we get through IRIS, annual performance reports, administrative records... • ...what our grantees provide us in the course of the grant cycle.
The Department’s strategic (postsecondary) priority: to... ...Ensure the accessibility, affordability, and accountability of higher education, and better prepare students and adults for employment and future learning. [Goal 3, Draft Strategic Plan 2007-2012] In other words: Enrollment Retention Graduation
The Department’s strategic (postsecondary) priority: ...OPE’s programs don’t always fit neatly into this priority, or the consequent performance measures.
Program Improvement Process Research Strategic planning Measures & Application Feedback & Collaboration Performance Reports Analyses
How are program- and project-level assessments linked? • GPRA measures address (mostly) the strategic priorities of the Department; • Program measures deal with other legislative priorities, program-specific goals, short-term or interim goals; • Project measures look at success of individual projects, can feed directly into program improvement and new program measures.
Two very important ‘ifs’ in that linkage... • IF the projects collect and report data on their project; and • IF the Department pays attention to what the projects tell them.
Within-program variation... • We’ve begun looking at between-project variation in program outcome measures... • Notion is to see if we can understand differences between projects... • ...And provide this information as feedback to grantees.
Project-level evaluation needs... • Clear goals • Measurable objectives • Performance measures that focus on outcomes as well as outputs • Some basis for comparison, so improvement can be judged • Increased rigor and periodic reporting
OPE will be working toward this renewed emphasis at all parts of the grant cycle: • Improving instructions in grant application packages and closing date notices; • Improving instructions to peer reviewers; • Providing guidance to project directors; and • Increasing review of annual and final performance reports.
We need your help... • OPE needs to do a better job at using project evaluations • We need your input at all stages of the grant cycle: • Evaluation plans • Periodic evaluation reports • Final project evaluation reports
And OPE’s commitment: • To work with you on project evaluation issues; • To pay attention to project evaluation methods and results; and • To provide feedback. • It won’t happen all at once... • ...but it will happen.
Contact information: John Clement john.clement@ed.gov 202-502-7520 Karla verBryckBlock karla.verbryckblock@ed.gov 202-502-7632