1 / 30

Developing ESL Program Placement and exit criteria

This article discusses the development and revisions of ESL program placement and exit criteria, including challenges, benefits, and the use of multiple measures and testing technologies.

angie
Download Presentation

Developing ESL Program Placement and exit criteria

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Developing ESL Program Placement and exit criteria Jim Pettersson, Ph.D. Utah Valley University

  2. Are you sure I am in the right level?

  3. Original Placement Criteria • MTELP/MTAC composite score at least 80. • Passing courses.

  4. Original Placement Criteria Benefits • Easy to gather data. Challenges • As with exit criteria, MTELP/MTAC composite score problems (not balanced). • A grade of C- was considered passing. • Not rigorous enough. • Students frequently challenge placement.

  5. Changes to Placement Criteria • Raise the passing grade to at least C in each class and overall GPA of at least 2.0 in classes taken the previous semester. • Allow an MTELP/MTAC retest within the first 2 weeks of the semester. • Students interview with program coordinator and fill out an Exception to Standard Placement Form.

  6. 1st Revision of placement Criteria • MTELP/MTAC- New formula for determining scores. • Grades- Develop and implement grading guidelines. • Use of CALT program for students who challenge level placement • Teacher recommendations based on previous semester performance.

  7. 1st Revision of placement Criteria Benefits • Multiple measures. • 2 different tests to evaluate skills. • More comprehensive measurement of skills. • Grades more objective and reliable. Challenges • Resources needed (CALT only 4 computers available). • More time required to administer tests. • Staff time to organize data for evaluation of students. • Getting instructors to give reliable objective grades.

  8. 2nd Revision of Placement Criteria • Transition from MELTEP/MTAC to CESL. • Grades- Modified grade requirements. • Teacher recommendations based on previous semester performance. • Discontinue use of CALT.

  9. 2nd Revision of Placement Criteria Benefits • Use of a nationally accepted testing technology. • Simplified test administration. • Quicker turn-around time for results. • Being computer adaptive a larger corpus of questions is available to draw upon. • Human error in scoring of tests reduced.

  10. 2nd Revision of Placement Criteria Challenges • Development of reliable cut scores. • Students fear of technology (comfort level). • Equipment problems. • Test security.

  11. 3rd Revision of Placement Criteria • CESL scores- looked at subtest scores. • Course grades- Previous semester. • Must pass 3 of the 4 classes. • Must have a cumulative GPA of at least 2.0. • Exceptions require a learning contract with Program Coordinator or Program Director. • Oral Interview. • Writing sample. • Grammar and reading test based upon grammar text used in the program.

  12. 3rd Revision of Placement Criteria Benefits • Multiple measures. • 2 different tests to evaluate skills. • More comprehensive measures of skills. • Use of a nationally accepted testing technology. • Quicker turn-around time for results. • CESL being computer adaptive, a larger corpus of test questions is available to draw upon. • Human error in correcting of tests reduced. • Allowed for criteria referenced test.

  13. 3rd Revision of Placement Criteria Challenges • Time to administer oral interviews and writing samples. • Time to train staff in administration of oral interviews and writing samples. • Continuing challenge of reliable grades. • Time for staff to meet and discuss student placement. • Getting faculty to complete and submit placement recommendation forms. • Getting reliable objective grades from instructors.

  14. Can I get out of ESL now?

  15. Original Exit Criteria • Composite score of 80 or higher on the MTELP/MTAC. • Pass all Level 4 ESL classes.

  16. Original Exit Criteria Benefits • Administered by Testing Services. • Minimal cost to students ($15). • Liberal retake policy. • Reasonably quick term turn-around time to report scores. • Flexible testing schedule. • Only two measures to worry about.

  17. Original Exit Criteria Challenges • Use of one standardized test score provided evaluation at only one point in the time. • Disproportionate measure of test score: • Security of test environment. • Retakes allowed too frequently.

  18. 1st Revision of Exit Criteria • New method of calculating MTELP/MTAC Composite score of 80 (testing allowed at beginning, middle, end). • Course grades. • CLAT 80 (testing allowed at beginning, middle, end). • NSA- DRP scores and CWS scores.

  19. 1st Revision of Exit Criteria Benefits • Multiple measures (better picture of students skills and performance). • Semester measure of students skills and performance. • Could look at student performance on a class by class (skill) basis. • Consideration given to MTELP/MTAC subtest scores. • MTELP/MTAC paper pencil. • CALT technology based assessment (computer based testing). • NSA- hold students to native English speaker performance levels.

  20. 1st Revision of Exit Criteria Challenges • Lots of data to compile. • Expanded testing schedule (time out of class, Students who missed testing). • Convincing testing services of the appropriateness of the new MTELP/MTAC scoring procedure. • Reliable grades- no sympathy grades. • Development of grading guidelines. • Time and equipment necessary to administer the CALT.

  21. Changes to Exit Criteria Grading Guidelines

  22. Changes to Exit Criteria New MTELP/MTAC Scoring Formula MTAC Score 80 x 1= 80 MTELP Score 60 x 2= 120 Total= 200 / 3 = 66.7 Program Exit Recommendation Form

  23. 2nd Revision of Exit Criteria • Change from MTELP/MTAC to CESL. • CESL score of at least 90 (testing limited to the beginning and end of the semester). • Course grades. • NSA (DRP changed to an untimed format). • Teacher recommendations.

  24. 2nd Revision of Exit Criteria Benefits • More reliable information (broad base of data). • Quick access to test results. • All subtest scores weighted equally in calculation of CESL score. • Allowed for more direct teacher input. Challenges • Test Security • Determine reliable out-off scores • Anxiety about use computer based testing format. • Necessity of staff meeting to discuss students exiting the program. • Highlighted need for better placement criteria. • Reliable grades.

  25. Changes to Exit Criteria Minimum Grade Require in each class • Initially a grade of “C” was required in each class. • The first revision to the exit criteria changed this to a grade of a “B” in each class. • After concerns were expressed by faculty members and administrators this was again changed to a grade of “C”.

  26. Changes to Exit Criteria MTELP/MTAC to CESL Cut-off Scores

More Related