2014 K-Prep BAC Training

1. K-PREP Testing WindowMay 14th – May 21st(Makeup testing– May 22nd – May 28th) 2014 K-Prep BAC Training Unbridled Learning: College & Career Readiness for All

2. Testing Unit Team Erica Thompson – District Assessment Coordinator Tammy Durham – Testing Unit Clerk Jacque Queenan– Assessment Support Manager Ryan Goepper – Data Management/Research Technician Jessica Lyons –Data Management/Research Technician Donna Heun– Data Management/Research Technician

3. Agenda • Important Dates • New for 2014 • Hot Topics • Test Security/Data Quality • Part 1: Security Requirements & BAC Responsibilities • Part 2: Rosters, Accountability & Testing Verifications • Part 3: Who should be tested? • Part 4: Accommodations • Part 5: Scheduling Testing Sessions • Part 6: BAC Instructions

4. …It’s important to listen… Please put laptops away and avoid checking emails except during breaks. Be knowledgeable and avoid potential allegations.

5. …It’s important to listen… http://www.huffingtonpost.co.uk/2014/03/12/linda-honey-listen-toddler-demanding-cupcakes-convincing-argument-video_n_4947963.html

6. …Have a plan… Prepare Organize Implement Succeed

7. IMPORTANT DATES

8. NEW FOR 2014

9. Hot Topics Increased emphasis on “getting the rosters right” to support data quality. Data returned from vendors should match roster information. At the end of data review, students remaining on the roster, without an approved exemption or a score from the vendor, will have a zero score applied in reporting.

10. Hot Topics 3. Administration Code and Inclusion of Special Populations regulations are under revision for next school year. The 2009 versions are still effective for spring 2014. • Time chart for K-PREP grades 3-8 is revised slightly. In 2014, no field testing in mathematics has reduced testing time. • BAC manual has complete time chart. • Each TAM has appropriate grade-based chart.

11. Hot Topics • 5. Text-reader is a new accommodation option for read aloud/reader for K-PREP (Pearson) in grades 3-8. • Schools will only return scorable student response booklets to Pearson this year. • No void or blank student response booklets. ·

12. Hot Topics • Alternate K-PREP offers a retest option for the high school Transition Attainment Record (TAR) reported with College/Career Readiness. • 8. KDE is providing guidance on applying G- Codes in Infinite Campus for Alternate K-PREP students. ·

13. Hot Topics 9. ACT will return online End-of-Course scores from paper/pencil testing faster this year (5 days from receipt of answer documents at ACT). 10. CIITS access is tied to IC at the district level. All superintendents, principals and teachers should have access. District and other school staff would need customized roles in IC given by the KSIS point of contact. This page contains the information on how to get additional roles assigned and other general questions. http://education.ky.gov/districts/tech/ciits/Pages/CIITS-Login-Support.aspx

14. TEST SECURITY AND DATA QUALITY Key assessment themes require the focus of schools, districts and the state.

15. Key Assessment Themes DATA QUALITY—collaborative process between OAA and school/district staff to ensure accurate reporting of test results TEST SECURITY—checks and processes to monitor appropriate administration of state-required tests

16. Data Quality • The authoritative source of student data in Kentucky is the state student data system, Infinite Campus (IC). • Data are downloaded from IC for vendors and to populate internal applications (i.e., SDRR). • Accountability requests made to OAA are cross-checked with Infinite Campus.

17. Data Quality KDE/OAA Student Data Review and Reporting (SDRR) Application, organized by test, has two critical data accuracy functions: • Rosters • Required by regulation • Accurate, thorough work now = less work later in Data Review • Record of accountability for all grades 3-12 • (Grade 9 is needed for PLAN and grade 12 is needed for College/Career Readiness reporting.) • Data Review (cleanup before reporting)

18. Data Quality Keys to Improved Data Matching • Correct entry of student information in IC is critical (name, date of birth and SSID). • Consistently use the student’s name as it appears in IC on all testing records. • State-testing programs are provided SSIDs. • DO NOT USE THE JCPS STUDENT ID • Accurate, thorough work now = less work later in Data Review

19. Data Quality Get the Rosters Right = Students left on roster, after data review, without an approved exemption or test score, will be included in reporting as a zero (0) score.

20. Data Quality Importance of Rosters Clean Rosters in Spring *Longer roster window means more time for work. *Flexible routine changes include student add or delete. *Demographic changes made directly in Infinite Campus. *Better availability of school staff to assist. Easier Data Review and Cleanup in August *Data review changes require documentation and KDE approval. *Data review goal should be for a small number of changes. Accurate Data for Public Release

21. Test Security • Continues to be a critical issue in Kentucky and nationally. • Loss of certification for Kentucky educators emphasizes the seriousness of the issue. • OAA implements and monitors the recommendations from Kentucky’s security audit. • Increased analysis of test results for irregularities and triggers for follow up from KDE’s allegations coordinator.

22. Test Security: Local Requirements Training • Administration Code and Inclusion of Special Populations (2009 versions) Signatures • Student Honor Code • Appropriate Practices Form and Administration Code • BAC testing certification Documentation of Testing • Seating charts (all required tests) • Testing room location codes (K-PREP Pearson)

23. Test Security: Training Requires annual training on regulations • Administration Code • Inclusion Regulation

24. Test Security: Signatures Appropriate Practices Form Student Honor Code

25. Test Security: Signatures Certification Form BACs • E-mail from DAC • Completed at end of year to reflect all required testing in the school year • DACs collect from BACs

26. Test Security:Documentation of Testing • Seating Charts are required for • all state-required test administrations. • optional tests that are included in accountability if the test is administered by the school. Group Seating Chart

27. Test Security:Documentation of Testing • DAC will collect and maintain in case of potential investigations. • Templates are provided by JCPS Testing Unit and may be modified at the local level. Individual Seating Chart

28. Test Security:Documentation of Testing • Collection of testing room location codes on each Student Response Booklet allows security data analysis at the room level.

29. Test Security: State Monitoring • Test window visits • Review of seating charts • Collection of DAC certification forms • Review/audit of randomly collected AAA Folders for alternate assessment students • Analysis of outlier test results by Office of Education Accountability • Analysis by vendors (i.e., erasure and others) Pearson has hired Caveon to performance data analysis

30. Test Security: State Monitoring Analysis by vendor can produce multiple types of information/reports at room, school or district levels. • Erasure analysis (Right (R) to Wrong (W), RTR, WTR) • Large score changes for a student • Large mean score increases • Probability of matched response analysis • Previous year’s distribution around scores • Pattern analysis • Comparison of individual student scores by item type Analysis can trigger/identify schools and districts for follow up with KDE Allegations Coordinator.

31. Test SecurityReporting of Allegations Get the facts straight. Call the Testing Unit for guidance.

32. Test SecurityReporting of Allegations Complete Allegation Reporting Form Available on Testing Unit website.

33. Test SecurityReporting of Allegations Complete Allegation Reporting Form • Principal will be sent School Allegations Packet • Complete School Allegations Packet, collect all supporting documents and return to Erica Thompson by the deadline provided. • Unless you are directly involved in the allegation, you will not receive notice about KDE’s resolution of the allegation case.

34. Test Security • Jefferson County Public Schools will continue to run an ethical, clean testing program because it is what is best for our students.

35. PART 1 SECURITY REQUIREMENTS AND RESPONSIBILITIES

36. Responsibilities for BACsTest Security Required Activities • Appropriate training of regulations—Administration Code and Inclusion of Special Populations (2009 versions) • Signatures on Appropriate Practices Form and Administration Code • Provide a copy of the Test Administrator’s Manual (TAM) to every test administrator/proctor • Scheduling Test Sessions • School Test Materials Security Checklist • Seating charts that reflect everyone in each testing room (adults and students) • Bubbling of testing room location codes by content area tests on student response booklets

37. SECURE TEST MATERIALSConfidentiality • From receipt to return of testing materials, no school personnel may review, edit or share, either verbally or nonverbally, the contents of test and scorable booklets without approval from KDE. • Students may not be given access to test booklets by any school personnel prior to testing. • School personnel may not reproduce any portion of the test booklets or scorablebooklets. • School personnel may NOT keep any hand-copied portions of the test used for transcription. School personnel may NOT audiotape, videotape, photograph or photocopy materials.

38. SECURE TEST MATERIALSInventorying and Tracking Test Materials • It is mandatory to use the Test Materials Security Checklist. • It will be collected during your test materials check in appointment. • Any irregularities regarding the use or tracking of documents or the information captured on them must be investigated. • If a security breach is discovered, contact The JCPS Testing Unit immediately. • Store test materials in a secure area when not in use for testing. • Storage locations within CLASSROOMS must be secured with DOUBLE locks. • BACs may keep secure test materials secure under single lock and key. No other staff may have access to the BAC secure storage.

39. SUPERVISING TEST SESSIONS WITH AND WITHOUT ACCOMMODATIONS • Test administrators are responsible for providing appropriate accommodations as defined in Kentucky regulation 703 KAR:070, Inclusion of Special Populations in the State-Required Assessment and Accountability Programs • Provide the required accommodations identified in the student’s current Individualized Education Plan (IEP), 504 Plan or Program Services Plan (PSP).

40. SUPERVISING TEST SESSIONS WITH AND WITHOUT ACCOMMODATIONS • Test administrators providing accommodations may NOT leave students unsupervised at any time. • Administrators must focus their full attention on students and their testing environment while supervising testing. • Under no circumstances will a student be allowed to modify his or her response to a question in a part of the test that has been completed, nor will a student be allowed to work ahead in a part not yet administered.

41. ALERT PAPERS • Written student response that raises concern about the safety or welfare of the student or others. • If an alert paper is found, the BAC or school administrator should be notified and the student response booklet must be provided to the BAC immediately following the end of the testing session. • The BAC and school administrator (as a witness) will then copy only the response. The copy must be kept secure as it is considered testing material. If another testing session is scheduled, the student response booklet may be returned to the test administrator.  

42. ALERT PAPERS • The BAC or school administrator is responsible for reporting the situation to proper school and district authorities, including the DAC. • Those authorities should follow school or district policy for handling the situation. • If there is a need for local authorities or parents to see the student response, security should be explained and a nondisclosure form signed by all parties before viewing the response. • A copy of the nondisclosure form should be submitted to the Testing Unit. The nondisclosure form is located on Testing Unit website.

43. Student Pre-ID Listing The Student Pre-ID Listing is a list of all students that have pre-printed student response booklets. STUDENT PRE-ID LISTING KENTUCKY SPRING 2014 K-PREP School Code: 999999 School: SCHOOL NAME District: DISTRICT NAME Grade: 99

44. Test Forms There is one operational form (items that are included) for accountability. The difference in the forms are the pre-test items.

45. Calculator Use Policy

46. Approved Testing Resource Materials

47. Unapproved Testing Resource Materials • Students are NOT permitted to use the tools and resource materials listed below: • Books other than those specified above (e.g., encyclopedias, textbooks) Note: Once testing has been completed and a student’s testing materials have been removed from the student’s work area, the student may read. • Copies of acronyms • Graphic organizers • Computers • Editing devices (e.g., spell-checker or grammar-checker) • Cell phones, Smart phones • Electronic devices (e.g., iPods, iPads, or other music players, pocket translators, PDAs) • Items with internet accessibility • Highlighters • No scratch paper allowed for on-demand writing. Highlighters

48. Test Booklets & Test MaterialsResources • Extended Response and Short-Answer Scoring Guides (grade 3-8) • On-Demand Writing Scoring Criteria (grades 5, 6, 8, 10 & 11) • On-Demand Pre-Writing Area (grades 5, 6, 8, 10 & 11) Remind teachers to distribute the additional resources for the appropriate test sessions according to directions in the TAMs. • Mathematics Reference Sheets • Writer’s Reference Sheets • Calculators • Rulers • Protractors or Angle Rulers

49. Test Resources – K-PREP Scoring

50. PART 2 ROSTERS, ACCOUNTABILITY & TESTING VERIFICATIONS