270 likes | 474 Views
Evolution of Program Review at UCF Using SAS Business Intelligence Tools to move Towards Optimization. Patricia Ramsey & Carlos Piemonti 2013 FAIR Conference January 31, 2013. Program Review Process. Task : Examine the quality and productivity of programs
E N D
Evolution of Program Review at UCFUsing SAS Business Intelligence Tools to move Towards Optimization Patricia Ramsey & Carlos Piemonti 2013 FAIR Conference January 31, 2013
Program Review Process • Task: Examine the quality and productivity of programs • - Mandated by state statute • - 7 year cycle • - Approximately 30 programs per year • Goalis to determine which programs to: • Enhance, Reduce, Maintain, Eliminate, or Study Further • Process requires a self-study, external consultant visit, and committee recommendations to the Provost, BOT & BOG
Program Review Data Value Program Review Data Value • Wide range of data is required to support the process during all steps • Departments and programs - self-study prep • External Consultants - better understand the program prior to site visit • Program Review Committee members and the Provost - to identify opportunities or weaknesses
Program Review Data Requirements • Each program review data document includes the following: • Series of data points • Trend information • Comparison of program to overall department and college
Progress Through the Years 2000 MS Word 2006 SAS EG 2012 SAS BI
Recent Advances • Surface the data on the web via SAS BI tools – Web Report Studio (WRS) (IR waited for cascading parameters to be available!) • Provide data for all programs, not just programs under review • Auto-populate the self-study templates • Graphs and charts are now developed in Web Report Studio not in EG
New Way • Update filters to reflect new reporting cycle
The Magic Behind the Scenes Official data is loaded to Data Warehouse each term SAS Information Maps create a view of the data designed for a purpose SAS Web Report Studio graphically surfaces the data on the web
New Maintenance Routine • Data prep: run an EG project once a year and Roll forward one cohort in each report by updating filters (Feb) • Request refreshed data to UAPS (Projections – May), UAPS does it by replacing table • Generate reports: preliminary (Apr); final (Aug) for programs under review
New Program Review CyclePreparation • University Community has access now! 1H
New Program Review CyclePDF Report Generation Day 4 Day 3 Days 1-2 Program Review 2012-2013: 12 department reports were created twice (preliminary and final versions) in less than 10 workdays.
Pegasus Mine Portal https://my.ucf.edu/
Report Contents College Department Undergraduate Graduate Sample
Prompts Page on the Portal • Dynamically generate values • & • Cascading parameters
External Access web
Program Review2012-2013by Department/Program Area Communication 1 Dean's Office UGST Health Mgmt. & Informatics Health Professions FL Interactive Entertainment Academy Office of Interdisciplinary Studies Legal Studies Modern Languages Optics Public Administration Political Science Physical Therapy 12 For a total of 26 programs! Document Layout Key
Limitations • Security - Program Review in the portal is limited to select users. Consultants must have access to data outside the portal. IR must make .pdf versions and post to a location outside this firewall so they have easy access • Design - SAS has not yet designed prompts that apply to the entire report. The user must respond to prompts on each tab