Don’t Be Afraid of the New Tech Prep Accountability! !

1. Don’t Be Afraid of the New Tech Prep Accountability! ! NACTEI CONFERENCE Boise, Idaho May 21 & 22, 2008 1

2. PRESENTER Mr. Dennis Fiscus NATPL President Arizona State Tech Prep Director 2

3. OUTLINE • How Can You Make Tech Prep Data Collection and Reporting Work For You • Tech Prep and Perkins IV • How to Make Data Collection Work • How to Approach the Data Collection of Tech Prep Indicators of Performance • Questions/Discussion 3

4. What is a accountability? What is Tech Prep accountability? Why do we need accountability? How do we collect data? How do WE keep Tech Prep going? DATA!

5. Sec. 113. Accountability • Perkins IV requires data to be collected for career and technical education • Core indicators of performance at secondary and postsecondary level identified • Levels of performance identified for each core indictor, expressed in percentage and numerical form 5

6. Sec. 113. Accountability Tech Prep is included in all section 113 language Tech Prep is always a subset of the Perkins Performance Measures Accountability is nothing new. . . States are already collecting data 6 6

7. Perkins IV • Core Indicators of Performance (SEC. 113. Accountability) • Collect and report data on a state and national level • Consistent data collected for reporting purposes • Reports program and student outcomes • Identifies “indicators of performance” for accountability purposes • Regardless if states combine “funds”, important to collect and report Tech Prep data

8. Sec. 113. Accountability-SECONDARY • 1S1: ATTAINMENT OF ACADEMIC SKILLS - READING/LANGUAGE ARTS • 1S2: ATTAINMENT OF ACADEMIC SKILLS – MATHEMATICS • 2S1: ATTAINMENT OF TECHNICAL SKILLS • 3S1: SECONDARY SCHOOL COMPLETION • 4S1: STUDENT GRADUATION RATES • 5S1: SECONDARY PLACEMENT • 6S1: NONTRADITIONAL PARTICIPATION • 6S2: NONTRADITIONAL COMPLETION

9. Sec. 113. Accountability POSTSECONDARY • 1P1: ATTAINMENT OF TECHNICAL SKILLS • 2P1: ATTAINMENT OF CREDENTIAL, CERTIFICATE, OR DIPLOMA • 3P1: STUDENT RETENTION OR TRANSFER • 4P1: STUDENT PLACEMENT • 5P1: NONTRADITIONAL PARTICIPATION • 5P2: NONTRADITIONAL COMPLETION

10. Student Accountability Forms for the Section 113 Core Indicators of Performance (Title I) SECONDARY LEVEL 1S1: ATTAINMENT OF ACADEMIC SKILLS - READING/LANGUAGE ARTS

11. Student Accountability Forms for the Section 113 Core Indicators of Performance (Title I) SECONDARY LEVEL 1S2: ATTAINMENT OF ACADEMIC SKILLS - MATHEMATICS

12. Student Enrollment Forms Enrollment of CTE Participants

13. Student Accountability Forms for the Section 203 Indicators of Performance (Title II) SECONDARY LEVEL

14. Student Accountability Forms for the Section 203 Indicators of Performance (Title II) POSTSECONDARY LEVEL

15. Why the need to collect and report Tech Prep data: • To provide relevant information to stakeholders • To respond to the ongoing concerns and issues raised by stakeholders • To respond to legislation: Sec 203. Indicators of Performance and Accountability • To use data to identify what is working and what needs improvement • To sustain funding 15

16. In order to make your Data System work for you, you will need: To want to do this, Develop workable secondary and postsecondary systems to report Tech Prep data, Budget dollars to support data collection and reporting of results, Buy-in from all stakeholders, Active consortia to deliver Tech Prep, Investment in technology to simplify the collection and analysis of data, 16

17. In order to make your Data System work for you, you will need: 17 A method for collecting and reporting data needed to adequately report to OVAE for the Consolidated Annual Report (CAR), Coordination with agencies that have employment and earnings data (e.g. FEDES), To share results of program improvement and success efforts with all stakeholders, To conduct a small ,achievable pilot project if no data collection system currently exists in your state.

18. Overview State Data Collection Systems – Arizona SECONDARY • Integrated with existing Career and Technical Education student reporting system • Tech Prep data is a subset of all CTE reports and Performance Measures • Long time established Tech Prep Consortia • State Tech Prep Student definition makes it work • Signed Articulation agreements mandatory 18

19. Overview State Data Collection Systems – Arizona POSTSECONDARY • Uses secondary data to develop Postsecondary Tech Prep student list • Tech Prep Consortia Directors an integral part of data system • Postsecondary Institutional Research people a key • Tech Prep developed a statewide postsecondary, web-based system for reporting • AZ Department of Education did all of the training 19

20. Overview State Data Collection Systems – Arizona STEPS • Tech Prep Directors submit to State Articulation reports to determine TP programs/students • Secondary LEA’s report to AZ Department of Education • Programs are tagged as Tech Prep or Not Tech Prep • Students fall into programs that are tagged • Completers come from programs that are tagged 20

21. Overview State Data Collection Systems – Arizona STEPS • State completer list available to Tech Prep Directors • Tech Prep directors work with Institutional Research people at Community College to find Tech Prep completers • Students that are found are then tagged as Postsecondary Tech Prep students • Postsecondary Tech Prep students then become a subset of the postsecondary reporting system • Tech Prep Consortia Directors watch over the system 21

22. How to Approach the Data Collection of Tech Prep Indicators of Performance • Section 205. Report “report on the effectiveness of tech prep programs” • Tech Prep Indicators Definitions (Numerators and Denominators) • Secondary Tech Prep Student: a secondary education student who has enrolled in 2 courses in the secondary education component of a tech prep program. 22

23. How to Approach the Data Collection of Tech Prep Indicators of Performance Tech Prep Indicators Definitions (Numerators and Denominators) Postsecondary Tech Prep Student: a student who (A) has completed the secondary education component of a tech prep programs; and (B) has enrolled in the postsecondary education component of a tech prep program at an institution of higher education described in clause (i) or (ii) of section 203 (a)(1)(B). 23 23

24. Perkins IV - Indicators of Performance (SEC. 203. Tech Prep Program, Indicators of Performance and Accountability) • The number of secondary education tech prep students and postsecondary education tech prep student served. • The number and percent of secondary education tech prep students enrolled in the tech prep program who • enroll in postsecondary education; • enroll in postsecondary education in the same field or major as the secondary education tech prep students were enrolled at the secondary level;

25. Perkins IV - Indicators of Performance (SEC. 203. Tech Prep Program, Indicators of Performance and Accountability) (iii) complete a State or industry-recognized certification or licensure; (iv) successfully complete, as a secondary school student, courses that award postsecondary credit at the secondary level; and (v) enroll in remedial mathematics, writing, or reading courses upon entering postsecondary education.

26. Perkins IV - Indicators of Performance (SEC. 203. Tech Prep Program, Indicators of Performance and Accountability) (c) The number and percent of postsecondary education tech prep students who (i) are placed in a related field of employment not later than 12 months after graduation from the tech prep program; (ii) complete a State or industry-recognized certification or licensure; (iii) complete a 2-year degree or certificate program within the normal time for completion of such program; and (iv) complete a baccalaureate degree program within the normal time for completion of such program.

27. Student Accountability Forms for the Section 203 Indicators of Performance (Title II) SECONDARY LEVEL

28. Student Accountability Forms for the Section 203 Indicators of Performance (Title II) POSTSECONDARY LEVEL

29. (1) The number of secondary education tech prep students and postsecondary education tech prep students served. Measurement Definition Number of secondary TP students Number of postsecondary TP students Collected & Percent In Sec. & PS # of TP Students 29

30. Numerator #of secondary TP students who graduated last year and are enrolled during the current year Denominator # of secondary TP students who graduated last year Collected & Percent In PS % of secondary TP enrolled in PS (2) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(i) enroll in postsecondary education. 30

31. (2) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(i) enroll in postsecondary education. Denominator # of secondary TP students who graduated last year Must know this number/student first Already collected as a part of the state CAR report for Technical Attainment-denominator 31

32. (2) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(i) enroll in postsecondary education. Denominator # of secondary TP students who graduated last year Student file utilized could contain just a common identifier such as SSN or Department of Education state student identifier 32

33. (2) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(i) enroll in postsecondary education. Denominator # of secondary TP students who graduated last year File could contain common student identifier fields such as: Student name High school name Gender Graduation date/year CTE Program completed 33

34. (2) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(i) enroll in postsecondary education. Denominator # of secondary TP students who graduated last year This finds the majority of the students Some “hands on” delineation or sorting is required 34

35. (2) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(i) enroll in postsecondary education. Numerator #of secondary TP students who graduated last year and are enrolled during the current year Run list of secondary tech prep graduates through the community college enrollment database Utilize National Clearinghouse especially for universities and out of your state enrollees 35

36. (2) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(i) enroll in postsecondary education. Numerator #of secondary TP students who graduated last year and are enrolled during the current year Once found-need to place an identifier with the postsecondary student record to show this is a Tech Prep student (XX) Tech Prep 36

37. Numerator #of secondary TP students enrolled in the current year in the same major or cluster/pathway as in high school the previous year same graduation Denominator # of secondary TP students who graduate last year Collected & Percent In PS % of secondary TP enrolled in same filed in PS (3) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(ii) enroll in postsecondary education in the same field or major as the secondary education tech prep students were enrolled at the secondary level. 37

38. (3) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(ii) enroll in postsecondary education in the same field or major as the secondary education tech prep students were enrolled at the secondary level. Denominator # of secondary TP students who graduate last year Again-This is the same number as from your CAR report-Technical Attainment denominator Same as the denominator above for #2 38

39. (3) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(ii) enroll in postsecondary education in the same field or major as the secondary education tech prep students were enrolled at the secondary level. Numerator #of secondary TP students enrolled in the current year in the same major or cluster/pathway as in high school the previous year same graduation This is a subset of the numerator above on #2 The subset is now needing JUST those in same major/cluster 39

40. (3) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(ii) enroll in postsecondary education in the same field or major as the secondary education tech prep students were enrolled at the secondary level. Numerator #of secondary TP students enrolled in the current year in the same major or cluster/pathway as in high school the previous year same graduation Your state MUST be identifying what programs the secondary students are in-by CIP and program name # of students BY program is reported in the CAR on form 3 40

41. (3) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(ii) enroll in postsecondary education in the same field or major as the secondary education tech prep students were enrolled at the secondary level. Numerator #of secondary TP students enrolled in the current year in the same major or cluster/pathway as in high school the previous year same graduation Student identifier from secondary should have the students program as part of the identifier field As before-run student list through the college system to find student 41

42. (3) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(ii) enroll in postsecondary education in the same field or major as the secondary education tech prep students were enrolled at the secondary level. METHODS OF DETERMINING MAJOR OR CLUSTER/PATHWAY • Must first define Major and Cluster/Pathway for use in your system 42

43. (3) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(ii) enroll in postsecondary education in the same field or major as the secondary education tech prep students were enrolled at the secondary level. WHAT DETERMES A CLUSTER/PATHWAY ? • Utilize Classification of Instructional Programs list-CIP CODE • Same first two digits of CIP code=Cluster/Pathways • 01.000=Agriculture • 51.000=Health 43

44. (3) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(ii) enroll in postsecondary education in the same field or major as the secondary education tech prep students were enrolled at the secondary level. WHAT DETERMES A CLUSTER/PATHWAY ? • Utilize Classification of Instructional Programs list-CIP CODE • Student has 7 or more credits in a programmatic area-Business education, welding, computers 44

45. (3) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(ii) enroll in postsecondary education in the same field or major as the secondary education tech prep students were enrolled at the secondary level. METHODS OF DETERMINING MAJOR OR CLUSTER/PATHWAY • May need Tech Prep consortia directors to utilize a Student Tech Prep “Registration” form • Form would include students “major area of interest” = MAJOR 45

46. (3) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(ii) enroll in postsecondary education in the same field or major as the secondary education tech prep students were enrolled at the secondary level. METHODS OF DETERMINING MAJOR OR CLUSTER/PATHWAY • What if found using clearing house and the student is at a University in OR out of state? • If Consortia Director has utilized a Student Registration form indicating career interest-use it 46

47. (3) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(ii) enroll in postsecondary education in the same field or major as the secondary education tech prep students were enrolled at the secondary level. METHODS OF DETERMINING MAJOR OR CLUSTER/PATHWAY • What if found using clearing house and the student is at a University in OR out of state? • Assume if no contradicting information is present and student is continuing to pursue career interest from secondary? 47

48. (3) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(ii) enroll in postsecondary education in the same field or major as the secondary education tech prep students were enrolled at the secondary level. Numerator #of secondary TP students enrolled in the current year in the same major or cluster/pathway as in high school the previous year same graduation Denominator # of secondary TP students who graduate last year We MUST accept the fact that this figure is A subset of a subset It may not be a high number 48

49. Numerator #of secondary TP students who graduated last year with a State or industry recognized certification, or licensure Denominator # of secondary TP students who graduated last year Collected & Percent In PS % of secondary TP with certification or licensure (4) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(iii) complete a State industry-recognized certification or licensure. 49

50. (4) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(iii) complete a State industry-recognized certification or licensure. Denominator # of secondary TP students who graduated last year Same as #2 above Same as #3 above 50