370 likes | 480 Views
Finally. . . Informed Decision Making. Presented by Stephanie Houston & Laura Evans Colton-Redlands-Yucaipa ROP. NACTEI Conference May 14, 2004. Introduction. What are Regional Occupational Programs/Centers? Where is CRY-ROP and who does it serve?
E N D
Finally. . . Informed Decision Making Presented by Stephanie Houston & Laura Evans Colton-Redlands-Yucaipa ROP NACTEI Conference May 14, 2004
Introduction • What are Regional Occupational Programs/Centers? • Where is CRY-ROP and who does it serve? • What threats is CRY-ROP facing and how does it respond? • What is CRY-ROP’s vision of using data to drive decision making?
Data and Student Academic Performance • High School Performance • No Child Left Behind • API Scores • SAT 9 Scores • HSEE passing rates
What are the implications of the NCLB legislation, API, HSEE…etc? • Emphasis on academic standards and course content • Emphasis on data analysis • Expanded attention to teaching strategies that reach all students • Potential impact on student electives • Expanded attention to assessment strategies • Development of intervention and remedial opportunities for under performing students and schools
Prepare. . . • Look at the NCLB legislation, HSEE & API as opportunities to show how ROP or other career & technical classes reinforce and support student achievement. • Anticipate change--and prepare for it!
Focus on the positive… • 2/3rds of the Stanford 9 reading comprehension questions are textual and functional reading items which are predominant in ROP courses • ROP or other career & technical instructors can show how they support and strengthen academic skills through occupational applications
Connect… • ROP or other career & technical courses can assist students who do not do well in traditional courses by teaching academic skills in context • ROP or other career & technical courses may provide alternative graduation requirements in some districts • ROP or other career & technical should be part of the solution in improving student performance
No Child Left Behind • Accountability utilizing scientifically based research • Use of rigorous systematic and empirical methods • Adequacy of data to justify the general conclusions • Reliance on methods that provide valid data across multiple measurements and observations • Use of control groups • Details for replication • Acceptance by a peer-reviewed journal or approved by a panel of independent experts
Data Collection Methods • Registration forms • Attendance/Completion forms • Certificate request forms • Perkins core indicators • Student surveys • Exit • Satisfaction • Follow-up • Student Transcript Data Collection Form • Shared data files/databases
Tools of the trade • Scantron • Customizable databases • Crystal Reports software • SPSS software • Partnerships with other schools • Research/studies
Partnerships for Advancing Student Success (PASS) P-16 Council Vision- To create a system of education that all students deserve, that our workforce expects, and that a democracy requires
P-16 Council • Pre-school through post-secondary education • “Systems” thinking to encompass the interdependent and interacting components of the education system • System-wide coherence providing a cohesive education from childhood to adulthood • Legal Memorandums of Understanding in place to ensure appropriate use of data
P-16 Council • Data elements are shared and analyzed to strengthen program quality and guide decision making • CRY-ROP is represented on the San Bernardino Consortium Data Oversight Committee • CRY-ROP is represented on the CAL-PASS Steering Committee/Users Group
UCR CAROCP Study • Completed by the University of California, Riverside - School Improvement Research Group (SIRG) • Multi-dimensional research project to study the impact of ROCP courses on 11th and 12th grade students
UCR CAROCP Study Goals • Documentation of the overall effectiveness of California’s Regional Occupational Centers and Programs by • Comparing ROCP students to a demographically comparable “control” group • Examining 7 outcome domains
UCR Study Outcome Domains • High school GPAs • SAT-9 test performance • Graduation rates • School attendance rates • Job placement • Job opportunities • Admissions to post-secondary education
UCR Study Design • An electronic database to integrate information • Three data sources • High school transcript records • Telephone follow-up interviews • High school satisfaction survey • 11th & 12th graders from • ROC/Ps • A control group of students NOT on a UC admission track, not in Special Day Classes
Inland Desert Tech Prep Consortium • Partnership among 43 high schools and community colleges • Perkins funded • Data collection automated • 23,399 high school students supported in 2003 • 1,171 vocational students transitioned to 3 colleges and took vocational courses in 2003
HORIZONS Study • Commissioned by San Bernardino County Superintendent of Schools School to Career Horizons Grant • Conducted on P-16 data files • Limited data available, study needs to be expanded • Generalizations only – sample too small
UCR CAROCP Study • Common elements that distinguish ROC/P courses involved in the study from traditional 9-12 educational programs: • Yearly labor market analysis • Business advisory committee • Inclusion of academic standards necessary for success in the career area taught • Student involvement in real-life practice of the career skills
UCR CAROCP Study • 2002 • 7 ROC/Ps • 5 Career Programs: Auto, Business, Child Development, Health & Marketing • 1545 ROC/P Students • 2004 • 22 ROC/Ps • 8 Career Programs: Auto, Business, Child Development, Environment Tech, Health, Public Safety, Marketing & Technology • 2282 ROC/P Students
UCR CAROCP Study Instrumentation • Four original data collection and management instruments were developed • Student Transcript Data Collection Form • Telephone Follow-up Survey • High School Student Satisfaction Survey • Integrative relational database capable of merging data form all sources, built in Microsoft Access
UCR CAROCP Study Major Findings • Raised/comparable high school GPAs • Improved class attendance • Better wages • More likely to be promoted on the job • Good rates of further education • Preference for ROC/P over high school • Low appreciation of value of education • Resistance to academic classes
UCR CAROCP Study • Better Wages • 2002: Average salary of $7-$10 per hour, with ROC/P students earning $1.44 more per hour • 2004: Average salary of $7-$13 per hour, with ROC/P students earning $2.40 more per hour
UCR CAROCP Study • Raised high school GPAs • 2002: ROC/P students entered training programs with academic records below Control Group. By the completion of 12th grade, ROC/P students raised their GPAs by more than three-tenths of a point – a better rate than the Control Group • 2004: ROC/P students entered training programs with academic records below Control Group. By the completion of 12th grade, ROC/P students raised their GPAs by about three-tenths of a point – same pace as the Control Group
UCR CAROCP Study • On the Job Promotions • 2002: ROC/P students 28%, Control Group 21% • 2004: ROC/P students 25%, Control Group 23% • Raises • 2004: ROC/P students 25%, Control Group 19%
UCR CAROCP Study • Further Education-Comparable • 2002: ROC/P students 54% transition rate; Control Group 53% transition rate • 2004: ROC/P students 51% transition rate; Control Group 52% transition rate
UCR CAROCP Study • Value Statements • ROC/P students “Very much” like career education course work • “Only a few” high school classes are relevant for ROC/P students in terms of getting jobs or preparing them for adult life • ROC/P students report low levels of appreciation for Math, Science and Social Studies • ROC/P students report matching enthusiasm for English Language Arts, Music, Art , Drama and ROC/P course work
Conclusions • California’s ROC/Ps have a positive impact on students • Positive impacts are evidenced in academic achievement, the labor market and continuing education • Full implementation of an accountability system for career and technical education can document the social and economic payoff of programs nationwide
Sources & Links CAROCP • http://www.carocp.org/ CAL-PASS • www.cal-pass.org P-16 • www.edtrust.org • www.csulb.edu/~acaproj/partnerships.html NCLB • www.nochildleftbehind.gov