Oklahoma’s Performance Driven Outcomes System

1. Oklahoma’s Performance Driven Outcomes System Vic Woods, Tech Prep State Coordinator Oklahoma Department of Career and Technology Education vwood@okcareertech.org 405.743.5158 “A Seamless Transition” Performance Driven Accountability We’re Through Tinkering Around

2. Former Times • Six isolated consortia were funded in 1991 through individual competitive grants. • A few consortia were added between 1991 and 1996. • As a result of the “New Carl Perkins” and a state funding formula more consortia were added in 1998. • The Tech Prep Student Definition was approved July, 1999. • Consortia analysis provided evidence of transition barriers and the need to restructure some consortia in 2000-2002. • Twenty-five coordinators currently provide leadership for 24 consortia. • In 2003 program evaluations supported by a general review process were replaced by the Performance Driven Outcomes System (PDOS), which is supported by data.

3. Tech Prep 2003

5. 16 Career Clusters

6. Tech Prep: Delivering On The Promise • Accountability • Data Collection and Analysis • Communication and Outreach

7. Characteristics of an Effective Accountability System • Improve performance, instead of providing compliance to punish failure • Establish a few measurable goals that are clear and significant to progress • Monitor Progress Publicly • Employ fundamental and extreme incentives • Utilize every available tool; involve anyone who can help • Build capacity • Invest in results oriented outcomes

8. PDOS PipelineSeamless Transition System • The PDOS serves as a year-to-year working plan with deliverable milestones. • It has seven program outcome domains and nine student outcome domains, among other areas of performance. • It provides a web-based • transitional reporting • mechanism (longitudinal • cohort study) for • students from the high • school to technical • training to higher • education to the • workforce.

9. Data Maintenance Menu

10. Business Partner Form

11. Program Outcomes Data Form

12. Student Outcomes Data Form

13. PDOS Program OutcomesFY03 First Quarter Report (July-Sept.) • System—Component 1 Education Partners—Academic and technical learning experiences - Middle School, High School and Technology Center sites = 466 -Higher Education institutions (Colleges and Universities) = 61 Business/Industry Partners—Work-based learning, curriculum, etc. – Active B/I Partners = 149 - Job shadowing, mentorships = 458 - Student internships = 145 - Teacher internships = 115 • Articulation—Component 2 State Approved Agreements—# of agreements and credit hours possible that higher education can transcript - Cooperative = 367/6488 - Advanced Standing/Extra-institutional = 15/?

14. (Continued) • Professional Development—Component 3 - Technically related activities/# attending activities - Administrators = 89/422 - Teachers = 69/786 - Counselors = 78/333 • Curriculum & Instruction—Component 4 - Plans of Study = 126 - Career Clusters = 151 - Connecting /Incorporating Content - Curriculum Alignment = 89 - Contextual Coursework = 104 - Curriculum Integration = 106 - All Aspects of the Industry = 87

15. PDOS Student Outcomes5 year Cohort Study—FY01-FY06 for FY01 students • Student Opportunities—Component 5 - # of Tech Prep students - FY00=928 - FY01=2,304 - FY02=2,686 - Completing High School - GPA composite = ? - ACT composite = ? - Technical Program Completers = ? - Transitioning to Post-secondary - Higher Education = ? - Technology Centers = ? -Requiring Remediation - # of Students = ? - Courses = ?

16. (Continued) -Completing Post-secondary - Associate of Applied Science = ? - Associates of Science = ? - Bachelor of Science = ? - Bachelor of Technology = ? - Technical Certification or License = ? - Military, Apprenticeship = ? -Obtaining Employment - Related = ? - Unrelated = ? -Occupational Competency Testing - Completers = ? -Credentials (certifications, license) - State = ? - National = ? -Non-traditional Students - Participants = ? - Completers = ?

17. PDOS Culture • From a culture of compliance to a culture of results. • From a document driven system to a performance driven system supported by data. High School Tech Center Business/ Industry College University Middle School

18. PDOS Database Software • The Oklahoma Department of Career and Technology has an integrated mainframe database system in which we store most of our corporate data. The mainframe is an IBM Multiprize 2000 running VM/ESA. The Tech Prep Outcomes System interfaces with this mainframe system in order to obtain school, personnel, and student information and to store the data associated with its consortiums. • The interface to the web is accomplished via software marketed by Sirius Software, Inc. (http://www.sirius-software.com). This software is called Janus and allows us to write programs to access and update data located on our mainframe from web-based environments. It provides a direct, high performance connection between the mainframe and a TCP/IP network. • The database for the Tech Prep Outcomes System is structured as a set of tables each containing a different type of data. The tables are normalized to help eliminate duplication. There are tables for Business Partners, Committees, Schools, Training Activities, etc. The Tech Prep Coordinators are assigned ID numbers that serve to link the information concerning their Consortiums to them. • Future plans call for our current mainframe databases to be replaced by Oracle databases running on Sun/UNIX machines.

19. Get Online! • To see how this Performance Driven Outcomes System really works go to: • www.okcareertech.org/stw • Click on Tech Prep button • Click on PDOS button • Click on Tech Prep Coordinator Menu • Enter this information: • Last Name = anonymous • PID = 11111 • Password = Testing