The CareerTech Testing Center

1. The CareerTech Testing Center …the provider of online testing solutions

2. CareerTech Assessment – A Snapshot • Aligning with state and national standards and certifications whenever possible • Assisting Skills Centers and Student Organizations • Life Skills • ~96,000+ tests administered in FY13 • 130+ skill standards & 130+ assessments • Tests free to OK teachers • Increasing development efforts towards national assessments • National Law, Public Safety, Security and Corrections Core Assessment

3. A System with Value Added… • State/National Industry Association Driven • 50% Aligned or Endorsed • Oklahoma Industry Validated • 3:1 Industry to Instructor Committee Ratio • Provides Students & Employers Independent Measure of Competency • Provides Valuable Analyses • Student…remediation • Program…program improvement • State…professional development • Item…assessment improvement

4. On The Horizon…. • Increase Number of Skills Standards & Assessments • Increase Alignments & Endorsements • Maintain Excellent Online Infrastructure • The Sky’s the Limit!

5. Competency Based Education Includes…. • Skills Standards • Competency Tests • Curriculum

6. Skills Standards…. • Include a body of knowledge, skills and abilities needed to successfully perform in an occupation • Are developed and validated by industry representatives • Are tied to industry standards whenever possible • Provide a basis for identifying/developing curriculum materials • Drive competency test development

7. So…What is a Competency Test Anyway? Four Key Characteristics • Measures readiness for a specific occupation • Follows the Skills Standards for that occupation • Aligns with occupational certification whenever possible • Provides meaningful information for program improvement

8. How is a CompetencyTest Created? • Once the Skills Standards list is completed, frequency and criticality ratings are used to determine the number of test questions • Questions are written by subject matter experts • Questions are then compiled and reviewed by a committee of subject matter experts before the test is administered to students

9. Who Should Take a Competency Test? ANY/EVERY student who… • is enrolled in the program for which the test was developed. • has completed training for an occupation and passed all related performance evaluations for an occupation. • is READY to take the test according to the instructor.

10. What Needs to be Done Before Testing Students? • determine which test is to be administered • be sure that each student who is being tested is READY to test • schedule a time/date to test the student(s) with the Testing Liaison (complete test referral form?) • provide the test number and the PIDCode to the Testing Liaison Instructorsshould…

11. Test Referral Process • Prior to administering any assessment, it is the responsibility of the testing liaison to obtain the following information for each student: • WAVE ID (obtained from Department of Education), the Student’s Social Security Number or a local Student ID number or some other number unique to that student • PID code (a unique code given to each program to identify it) • Instructor’s Last Name • Student’s First & Last Names • The type of program the student is enrolled in • The type of student (high school or post secondary)

12. Who Administers the Competency Tests? Testing Liaisons Administrators at each school designate a Testing Liaisonto administer the competency tests in a SECURE testing environment.

13. Security/Confidentiality Issues • NEVER give out username and password • Tests are not to be used for pre- or post-testing • Testing Liaisons are to maintain physical control of testing materials at all times • Instructors are NOT allowed to view tests (unless participating in the annual test review) • A student may use a unique ID in lieu of their SSN (Ex: a student ID number with zeros that precede it to create a nine character ID)

14. Test Administration • A set of instructions is provided at the beginning of each assessment. • In this set of instructions, any reference materials that may be used will be listed here. • At the end of the assessment, a link is provided to the Coaching Report. • Don’t forget that a copy should be provided to the student, the instructor, and that the testing liaison should also keep a copy

15. Testing Environment • The testing environment should be such that participants can concentrate on their assessments with minimal distractions. • Considerations regarding the testing environment include: • Consistent/adequate lighting levels • Temperature at a comfortable level with proper ventilation • Space is quiet with minimal distractions • Participants should be asked to behave consistently (no eating, getting up and moving about) • Avoid/delay the test administration when a participant appears hurried, troubled, or ill

16. Responsibilities of the Test Proctor • Participant authentication: a picture ID should always be shown and login should be handled quickly and quietly by the proctor • Protection of the security of the online testing system. Username AND password should NEVER be revealed • PROHIBIT THE USE OF ALL COMMUNICATION AND TECHNOLOGY DEVICES (photos of test items and text messaging are common problems) • Computer usage: Monitor whether participants are trying to access the internet or other programs

17. Responsibilities of the Test Proctor (continued) • The proctor should be vigilant in their observance of the testing environment: Note passing, hand gestures, etc. • Reference materials, texts, notes, etc., are not allowed in the testing area unless specifically allowed for in the exam or in a student’s Individualized Education Plan • If a candidate is caught cheating during an examination, testing will stop immediately The candidate will receive a failing result and the incident will be reported to the CareerTech Testing Center (CTTC) • Students with an IEP may have special accommodations as specified in an IEP, IRP, 504, LEP, and ELL

18. Re-Take Policy • In the event a participant fails his or her first (1st) attempt to pass a CTTC test examination (score was less than 70%), the CTTC does not require any specific waiting period between the first (1st) and second (2nd) attempt to pass such examination. • Remediation is required prior to the 2nd or any subsequent administration. • After the second (2nd) attempt, the participant will be required to wait three (3) calendar days to retake the examination. The 3rd and final attempt requires a wait of three calendar days prior to retake.

19. Cheating on Tests • If any candidate is caught cheating during an examination, testing will stop immediately The candidate will receive a failing result and the incident will be reported to the CareerTech Testing Center (CTTC). • Several factors to consider when cheating occurs: • Widespread cheating (e.g., answer copying) throws into question the validity of results • Leaking of items from your repository is expensive and damaging to an organizations reputation. • New technologies used in cheating.

20. Coaching Reports COACHING REPORT

21. Coaching Reports Cont. • The Coaching Report provides: • Mean performance by duty area • Percentage Score • Document competency attainment • Identify relative areas of individual remediation • A method for individual program improvement • A method for state program improvement

22. Coaching Reports

23. Updates • The Updates section on the testing website should be checked often: • You will find information on new alignments, endorsements, and various other information • If any test numbers change, that information will be listed here

24. The CareerTech Testing Center Blog Our Blog is a repository of information on a variety of topics. (www.careertechtesting.net) Some topics are original thought, some inspired by the world around us and some are articles and reports generated by others that have application to Testing and career and technology education in Oklahoma and throughout. We invite you to read and use the information that is provided. Please be aware that some links will lead to articles that do not represent an official view of ODCTE and we are not responsible for their content or accuracy.We hope that you find our Blog useful and informative! J.T.

25. Contact Us CareerTech Testing Center Oklahoma Department of Career and Technology Education 1500 W. Seventh Avenue Stillwater, OK  74074 Main Office:  405-743-5412 FAX:  405-743-6885 Robyn Drury 405-743-5413