2012 February DAC Meeting

1. 2012 February DAC Meeting

2. Key Assessment Themes TEST SECURITY—addition of new checks and processes to monitor appropriate administration of state-required tests DATA QUALITY—collaborative process between OAA and school/district staff to ensure accurate reporting of test results

3. Test Security • Recent loss of certification for Kentucky educators emphasizes a serious issue. • Senate Bill 64 (2012 Kentucky General Assembly) an ACT relating to assessment ethics has been filed. • authorize prosecution of violations (a prosecuting attorney and the Attorney General may investigate allegations of violations and prosecute violations); • require the Office of Education Accountability to periodically review assessment results and anomalies; and provide for fine upon conviction of not more than $1,000 and disciplinary action by the Education Professional Standards Board.

4. Test Security Senate Bill 64 requirements • unlawful for any school district employee to allow examinees to view assessment questions in advance, copy test booklet contents, provide guidance to assist examinees to arrive at correct answers, change student responses, make answer keys available; • fail to follow test security protocol, fail to report violations, or follow any rules established by the Kentucky Board of Education (KBE); • require superintendent and principal to enforce policies; • require the KBE to adopt statistical guidelines for determining testing irregularities;

5. Test Security Required Activities • Appropriate training for Administration Code and Inclusion rules • Signatures on Appropriate Practices Form and Administration Code • Seating charts that reflect everyone in each testing room (adults and students) • Bubbling of testing room location codes by content area tests on student response booklets • DACs collect BAC certification and KDE collects DAC certification form (provided by KDE, not vendor)

6. Test Security Required Activities Certification Form DACs and BACs • E-mail from KDE/OAA and copy in DAC/BAC manual • Completed at end of year to reflect all testing • Certification form similar to prior years

7. Test Security State Monitoring • Test window visits • Review of seating charts • Collection of DAC certification forms • Review/audit of randomly collected AAA Folders for alternate assessment students • Analysis of outlier test results by Office of Education Accountability • Analysis by vendors (i.e., erasure and others)

8. Test Security State Monitoring Analysis by vendor can produce multiple types of information/reports at room, school or district levels. • Large score changes for a student • Large mean score increases • Probability of matched response analysis • Previous year’s distribution around scores • Pattern analysis • Comparison of individual student scores by item type

9. Test SecurityReporting of Allegations Get the facts straight. • Record the date and time of the incident. • List all involved (i.e., staff, volunteers, students). • Identify content area and test parts impacted. • Identify specific content question(s), if applicable. • Record what you learn. • Report the incident.

10. Test SecurityReporting of Allegations Support Documents • Testing Allegation Reporting Form • Notarized Statements written and signed by each individual involved (teacher, proctor,BAC, principal and/or others). One statement signed by multiple individuals is notacceptable. • Testing Schedule • Seating Chart

11. Test SecurityReporting of Allegations Support Documents • Verification of Administration Code Training • Verify/Proctor Signature Sheet • Non-disclosure Agreement (classified/volunteers) • Student Name & SSID • For an allegation involving special education: • verification of student test accommodation(s). • verification of Inclusion of Special Populations training. • a signed copy of the Code of Ethics, record of testing room and test administrator for allegations regarding alternate assessment.

12. Data Accuracy • Correctness must happen first in Infinite Campus • KDE/OAA Student Data Review and Reporting (SDRR) Application will be used for two critical data accuracy functions: • Rosters • Required by regulation • Record of accountability for all grades 3-12 • Testing information for some tests • Data Review (cleanup before reporting)

13. Accountability Rule forNext-Generation Learners • Students enrolled a full academic year, any 100 instructional days, shall be included in calculations for Achievement, Gap, Growth and College/Career Readiness. • Graduation Rate calculations shall include both students enrolled and students earning diplomas.

14. Accountability Rule forNext-Generation Learners • INSERT TABLE

15. Who Takes the Test • Every student enrolled on the first day of the test window must be tested. (Participation rate still reported.) • Every student in grades 3-12 must be placed in a grade for assessment purposes. • Students take the tests associated with the grade in which they are enrolled on the first day of the test window. • Grade 3 students are tested whether or not they are exiting primary or moving to grade 4. • If a grade 3 student is in grade 3 again next year, the student repeats the grade 3 test. • If a student skips a grade, the students takes only the tests associated with the current grade of enrollment.

16. New Assessment and Accountability Terms for Schools • “A1” means a school under administrative control of a principal and eligible to establish a school-based decision-making council. • “A1” school is not a alternative program operated by, or as a part of, another school. • “Alternative” program means all other education programs not classified as A1.

17. Flowchart for Determining Accountability For Students in A1 Schools for the 2012 Kentucky Performance Rating for Educational Progress (K-PREP) Student scores will count in state’s accountability only. START Every student enrolled on the first day of the testing window will be tested for participation rate purposes. Accountability will be determined by full academic year. NO Has this student not been in any one school but has been enrolled in this district for 100 instructional days this school year? Has this student been enrolled in a school or district outside this district for 100 instructional days this school year? NO Has this student been enrolled in another school in this district for 100 instructional days this school year? Has this student been enrolled in this school for 100 instructional days this school year? NO NO YES YES YES YES Student scores will count in this school’s accountability. Student scores will count in other school’s Accountability. Student scores will count in district’s accountability. Student scores will count in another school’s or district’s accountability.

18. Flowchart for Determining Accountability For Students in Alternative Programs for the 2012 Kentucky Performance Rating for Educational Progress (K-PREP) an A1 school’s or district’spolicy? START: Was the student placed in the alternative program by: a governmental agency or the court system? YES Accountable to A1 school and/or district where student was enrolled a full academic year or where the student would have attended if not enrolled in the alternative program. Was the student enrolled in an A1 school or district for a full academic year before placement in an alternative program? Was the student enrolled a full academic year in the A1 and alternative program combined or in the alternative program only? YES YES YES Accountable to the state NO NO

19. Heads Up Topics • The Kentucky Board of Education approved new accommodation rules with revisions to Inclusion regulation on February 1, 2012. • The new rules will impact the 2012-2013 academic year and will impact state-required testing beginning in August 2012.

20. Heads Up Topics • All grades (3-8 and HS writing) have separate test booklets and student answer booklets. • Test booklets are larger. • New printing process has increased the size of the test booklets (i.e., number of pages), the occurrence of blank pages and pages with one multiple-choice items. • Bigger books mean more boxes in shipment.

21. Heads Up Topics • Tests are timed. • Timing chart has been revised and first-year transitional buffer has been added. • Timing charts display the expected time needed to complete each K-PREP test.

22. Revised Times for 2012

23. Revised Times for 2012

24. Transitional Year Time Buffer • In spring 2012, any student that does not complete Parts B or C in the expected time may use up to an additional twenty minutes, for all content areas except writing. • During the first K-PREP administration, the Kentucky Department of Education will study completion times for Parts B and C. This additional time will be reviewed for its use in future.

25. Heads Up Topics • Every English Learner (EL) student in grades k-12 must take an English Language Proficiency (ELP) assessment annually. • ACCESS—ELP test for ELs has an Alternate ACCESS available. • Districts determine the most appropriate ELP assessment to use (ACCESS—grades k-12 or Alternate ACCESS—grades1-12). • The Participation Guidelines for Alternate Assessment are an important reference.