Reporting Technical Skill Assessment Data

1. Reporting Technical Skill Assessment Data Presentation will start at 2:00 If you are using your phone for audio, please put it on mute. Submit questions through the chat feature For assistance go to: https://oregon.webex.com/oregon/mc and click on Support Oregon Dept. of Education, April 2011

2. ReportingTechnical Skill Assessment Data Oregon Department of Education April 5, 2011 Oregon Dept. of Education, April 2011

3. Target Audience • Secondary data-entry personnel • Postsecondary Perkins contacts • CTE Regional Coordinators • Perkins direct-recipient grant managers Oregon Dept. of Education, April 2011

4. Presentation Goals • Understand changes in technical skill attainment data reporting requirements for Perkins IV. • Understand timelines for new data reporting. • Understand what qualifies as a valid and reliable technical skill assessment. • Understand which programs should be reporting technical skill assessment data. Oregon Dept. of Education, April 2011

5. Presenter • Tom Thompson – ODE • Tom.thompson@state.or.us • (503) 947-5790 • Questions will be answered at the end of this presentation or posted on the ODE website. Oregon Dept. of Education, April 2011

6. Changes in Perkins IV • Key features of Perkins IV: • CTE Programs of Study • Accountability based on data • Assessment of Technical Skill Attainment • CTE Programs of Study beyond scope of today’s discussion • Accountability based on data • Perkins IV Performance Measurement: http://www.ode.state.or.us/teachlearn/pte/perkinsivperformancemeasurement.pdf • Data for program management and improvement: http://www.ode.state.or.us/data/stats/opte/ Oregon Dept. of Education, April 2011

7. Changes in Perkins IV (cont.) • Today’s focus is on how to collect and report the data for Perkins Performance Measure related to Technical Skill Attainment • Actually, two measures for Technical Skill Attainment for secondary and postsecondary: • 2S1(a) and 1P1(a). The long-time approach using grades in CTE courses (which will continue), and • 2S1(b) and 1P1(b). The use of valid and reliable assessment aligned with standards • We are required to report to USDOE using results from 2S1(b) and 1P1(b) this year. Oregon Dept. of Education, April 2011

8. Changes in Perkins IV (cont.) Oregon Dept. of Education, April 2011

9. What are the assessments? • Assessments selected locally from an approved list • List available through Oregon Skill Sets online database • http://www.ode.state.or.us/go/skillsets • Locally developed assessments allowable • Require approval from ODE in advance • Also included in the Oregon Skill Sets online database Oregon Dept. of Education, April 2011

10. http://www.ode.state.or.us/go/skillsets Click on Quick View Oregon Dept. of Education, April 2011

11. 2. Select Cluster 1. Select Career Area 3. Expand Assessments Oregon Dept. of Education, April 2011

12. Part of the Expanded Assessments List for Manufacturing Oregon Dept. of Education, April 2011

13. Who should be assessed? • Administered to program completers • Secondary completers • ODE online program listing • http://www.ode.state.or.us/data/stats/opte/ • Students completing the program must be assessed • Updates available online April 28, 2011 • Postsecondary completers • Complete a degree or certificate • AAS Degree • Independent certificate of 45 credits or more • http://www.ode.state.or.us/search/page/?id=2526 Oregon Dept. of Education, April 2011

14. Identifying Secondary Completers • http://www.ode.state.or.us/data/stats/opte/ Oregon Dept. of Education, April 2011

15. Oregon Dept. of Education, April 2011

16. Secondary Data Entry • Reporting on Secondary Technical Skill Assessment will be done through the CTE Student Data collection • CTE data collections open April 28 to June 30, 2011 • Student information systems should have been updated using file format data from: • https://district.ode.state.or.us/search/page/?id=191 • Specific data • Assessment date • Program code • Assessment Type Code • http://www.ode.state.or.us/teachlearn/pte/techskillassessmentcodes.pdf • Met or Did not meet (actual score not reported) Oregon Dept. of Education, April 2011

17. Program Strand Code Date Assessment Type Met = M; Did Not Meet = D Oregon Dept. of Education, April 2011

18. Program Strand Code Oregon Dept. of Education, April 2011

19. Secondary Assessment Type Codes • Divided into general types • Performance Assessments (1A, 1B, 1C) • Tests (2A, 2B, 2C) • Portfolios (3A, 3B, 3C) • Divided into source and use • Industry recognized license (1A, 2A, 3A) • Externally developed and no license (1B, 2B, 3B) • Locally developed (1C, 2C, 3C) • Full list available at: http://www.ode.state.or.us/search/page/?id=1656 Oregon Dept. of Education, April 2011

20. Most Common Secondary Performance Assessment Oregon Dept. of Education, April 2011

21. Most Common Secondary Test Oregon Dept. of Education, April 2011

22. Most Common Secondary Portfolio Assessment Oregon Dept. of Education, April 2011

23. Postsecondary Data Entry • Reported through OCCURS System • Fields and coding similar to secondary • Full list of codes available at: http://www.ode.state.or.us/search/page/?id=1656 Oregon Dept. of Education, April 2011

24. Postsecondary Code Examples Oregon Dept. of Education, April 2011

25. General Data Entry • Up to two assessments per student per year can be collected • Collection and reporting of grades will continue • Reporting by ODE to USDOE start 2010-2011 • Approved programs must report by 2012-2013 • Not all programs will have technical skill assessment data in 2010-2011. Oregon Dept. of Education, April 2011

26. Reporting System Student Assessment Student Information System State Data System • Chosen locally • Local system for reporting • Third-party data usually available • Proficiency score • Sample reporting forms available • Secondary vendors notified • Backup secondary online system • Colleges have made modifications • Statewide system (OCCURS or OAIS) • Able to collect data Oregon Dept. of Education, April 2011

27. Possible Reporting Templates • Optional secondary reporting document • http://www.ode.state.or.us/teachlearn/pte/secondarytsadatareport.doc • Optional postsecondary reporting document • http://www.ode.state.or.us/teachlearn/pte/tecskillassesssubmissiontemplateccc.xls Oregon Dept. of Education, April 2011

28. Your Next Steps • Make sure there is a local method to move data to the statewide system. • Identify programs that should or could be reporting data for 2010-2011. • Make sure data is being reported during the appropriate timeline. • Secondary – April 28 to June 30, 2011 • Postsecondary – deadline August 5, 2011 Oregon Dept. of Education, April 2011

29. Presentation Goals • Understand changes in technical skill attainment data reporting requirements for Perkins IV. • Understand timelines for new data reporting. • Understand what qualifies as a valid and reliable technical skill assessment. • Understand which programs should be reporting technical skill assessment data. Oregon Dept. of Education, April 2011

30. Questions? • This Webinar and Power Point will be posted on the ODE website at: http://www.ode.state.or.us/search/page/?id=1656 • All questions and responses will be posted on the ODE website. • For any additional questions contact Tom Thompson at tom.thompson@state.or.us Oregon Dept. of Education, April 2011

31. Resources • CTE Regional Coordinators or Perkins Grant Managers • ODE resources on technical skill assessment • http://www.ode.state.or.us/search/page/?id=1656 • ODE resources on CTE data quality • http://www.ode.state.or.us/search/page/?id=1623 • ODE staff • Technical Skill Assessment – Tom Thompson • Perkins Data Reporting – Brent Jacobsen Oregon Dept. of Education, April 2011

32. Webinar Q&A Q: Are the CTECS assessments and the NOCTI Oregon Agriculture assessment considered to be locally developed? A: Yes. They should be categorized as local assessments without an attached license. That would be code 2C for secondary and TESTLOC*** for postsecondary. Oregon Dept. of Education, April 2011

33. Webinar Q&A (cont.) Q: When reporting high school data, I think the program code for agriculture is 600 and the code for business is 250. Is that correct? A: Yes. The correct code for each program can be found on the website at: http://www.ode.state.or.us/data/stats/opte/apprprgs.aspx The code is a 3-digit number listed with the Program of Study title. Oregon Dept. of Education, April 2011

34. Webinar Q&A (cont.) Q: Should I input “met” and “dnm” in the student information system to indicate that the student met or did not meet the proficiency level of the assessment? A: Possibly. Different student information systems may use different terms. In the end, the community college data system (OCCURS) and K-12 data system will only accept specific characters. These data systems accept M for met and D for did not meet. It is the responsibility of the student information system vendor or developer to make sure the appropriate type of data can be submitted. Oregon Dept. of Education, April 2011