From Good to Great -- Administering a Successful LSAT Administration

1. From Good to Great -- Administering a Successful LSAT Administration Presented by: The Law School Admission Council Terri Neuman Frances Mercedes Dawn Troutman Anne McKernan 8/8/09

2. What do we mean by a successful administration? Overall goal: Valid scores • Accountability and security of test materials. • Satisfactory testing environment. • Detailed documentation.

3. Cheating Collusion Testing Environment Timing Pre- Knowledge Impersonation Stealing of Test Materials Staff Factors that affect score validity

4. Testing Environment Timing Staff Cheating Collusion Factors that affect score validity Pre- Knowledge Impersonation Stealing of Test Materials

5. Testing Environment Timing Staff Cheating Collusion Factors that affect score validity Pre- Knowledge Impersonation Stealing of Test Materials

6. Addressing Security Concerns Spacing and Seating Checking ID Prohibited Items Test Book Security

7. Addressing Security Concerns Spacing and Seating Checking ID Prohibited Items Test Book Security • Spacing between • test takers • There must be: • Room for proctors to • walk in front of and • behind all test takers. • At least 5 feet (side- • to-side) from one • test taker to the next.

8. Head Table  5 ft. 30" 30" 42" 42" LSAT Spacing Requirements

9. Some Notes on Random Seating… • Test takers should be seated in no discernible pattern • Definitely not alphabetical • Create seating charts in advance if possible.

10. Addressing Security Concerns Spacing and Seating Checking ID Prohibited Items Test Book Security We accept only government-issued ID that is current (not expired) and contains a photo and signature. Acceptable forms include passport books and driver’s licenses.

11. Addressing Security Concerns Spacing and Seating Checking ID Prohibited Items Test Book Security First & last name on admission ticket must match ID EXACTLY. We do not accept government-issued employment ID’s or passport cards. Exceptions are made for some international students on a case-by-case basis

12. Addressing Security Concerns Spacing and Seating Checking ID Prohibited Items Test Book Security We distinguish between electronic and non-electronic items.

13. Addressing Security Concerns Spacing and Seating Checking ID Prohibited Items Test Book Security After “Check-In,” test takers who are seen with electronic items are immediately dismissed and reported.

14. Addressing Security Concerns Spacing and Seating Checking ID Prohibited Items Test Book Security After “Check-In,” non-electronic prohibited items are confiscated and reported.

15. If you see it…

16. Warning Notice Act on it. For more details see our manual, pages 31-32 • Steps to take every time: • Verbal notification to test taker. • Written citation to test taker. • Detailed SMIR form to LSAC.

17. Addressing Security Concerns Spacing and Seating Checking ID Prohibited Items Test Book Security 1. Prior to test day: Keep test materials secure. 2. On test day: Never leave materials unguarded. 3. Follow published procedures.

18. Ensuring Test Material Security Receive shipment of test materials from LSAC Count materials Step #1 Reminder: Retain the cardboard carton! Repack and store materials securely Fax or e-mail acknowledgment form Distribute to Room Supervisors on test day Check on stored material from time to time

19. Ensuring Test Material Security Distribute to Room Supervisors on test day Count materials Step #2 Record serial numbers on SRF Room Supervisor counts materials Proctors distribute to test takers Record serial numbers on RSRF

20. Ensuring Test Material Security Proctors distribute to test takers Serpentine style only Step #3 In serial number order Directly place each packet on each desk Collect materials at break Record used/ unused numbers on RSRF

21. “Serpentine” Book Distribution Back of the Room Front of the Room

22. Ensuring Test Material Security Re-distribute after the break Check every ID Step #4 Redistribute in the same order as collected. Serpentine style only Collect materials before the writing sample Directly place each packet on each desk

23. Ensuring Test Material Security Collect answer sheets Collect test booklets Confirm receipt of all answer sheets and test booklets Distribute writing sample topic sheets Collect materials before the writing sample Step #5 Steps to take during and after the writing sample

24. Ensuring Test Material Security After the writing sample, collect response sheets During the writing sample Re-verify receipt of all answer sheets and test booklets Step #6 After the writing sample Collect topic sheets Confirm receipt of all response sheets and topic sheets Prepare materials for return to LSAC Allow test takers to leave

25. Ensuring Test Material Security Reminder: For further details, see p. 42 of the Supervisor’s Manual Prepare appropriate materials for return to LSAC within 48 hours Pack requested materials into white Tyvek envelopes Step #7 Print identifying info on white envelopes Check off appropriate boxes on white envelopes Place white envelopes into UPS “Next Day Air Packs” Deliver to UPS Place “ExpressPak” labels on the UPS envelopes

26. Ensuring Test Material Security Reminder: For further details, see p. 43 of the Supervisor’s Manual Prepare remaining materials for return to LSAC within 72 hrs. Pack remaining materials into plastic container Step #8 Secure plastic container with fasteners (provided) Place plastic container into cardboard carton Seal carton with two kinds of tape (provided) Deliver to UPS Affix UPS “Ground Service” label on carton

27. Testing Environment Timing Staff Cheating Collusion Factors that affect score validity Pre- Knowledge Impersonation Stealing of Test Materials

28. Testing Environment Timing Staff Cheating Collusion Factors that affect score validity Pre- Knowledge Impersonation Stealing of Test Materials

29. Factors that affect the Testing Environment • Timing • Lighting • Temperature • Noise • traffic, construction, other campus events • Writing Surface • Restroom accessibility

30. Tips from our Supervisors: Identifying Staff • Recruit from academic institutions. • Your own and nearby schools. • Faculty, staff, and graduate students. • Consider other mature, responsible individuals. • Key qualities and skills include: • Respect for the testing process. • Reliability and trustworthiness. • Ability to follow directions and work quietly.

31. Tips from our Supervisors: Retaining Staff • Stay in touch with staff between tests. • Create an e-mail list so you can easily send reminders or tips every 6-8 weeks. • Evaluate performance after each test. • The group as a whole and each staff person. • Focus on professional development. • Mentoring or “teaming up.” • Encourage proctors to develop “Room Supervisor” skills.

32. Tips from our Supervisors: Retaining Staff • Provide training. • LSAC launched its training program in November, 2008. • Present setting is an interactive workshop format that provides a forum for: • Explanation of our procedures. • Exchange of ideas. • Resolution of center-specific concerns. • Future plans include online tools.

33. Wrap-Up: In today’s presentation we shared some high-level information about: • Factors that affect score validity. • How LSAC is addressing test security issues. • Some of our procedures for handling test materials and administering our test. • Advice from our Supervisors about identifying and retaining staff. • Our new training program.

34. Q & A