Florida Alternate Assessment Administrators’ Management Meeting September 17-19, 2008

1. Florida Alternate AssessmentAdministrators’ Management Meeting September 17-19, 2008

2. 2008 Standard Setting

3. Initial Standard Setting • April 7-11 • Field test data • 14 standard setting panels • Panels of special educators, general educators, administrators and parents • Alternate achievement standards set for all grade levels and content areas

4. Initial Standard Setting • Using descriptors of Levels of Complexity and Performance Level Descriptors • Panelists set cuts for Levels of Complexity (LOC) • Panelists set Performance Level cuts within each of the LOCs

5. Levels of Complexity • Participatory, Supported, Independent • FDOE provided descriptors of the levels of complexity to panels • Panels provided feedback on descriptors

6. Standard Setting

7. Performance Levels • Basic: Students at the basic performance level have little success with the challenging access points • Proficient: Students at the proficient level are having some success mastering the access points • Advanced: Students at the advanced level are very successful with the access points • At each grade level and content are these are tied to specific access points measured on the assessment

8. Performance Levels • Basic: Students who score as basic can independently demonstrate less than 50% of all skills measured in the _____ level access points. • Proficient: Students who score as basic can independently demonstrate between 50% and 75% of all skills measured in the _____ level access points. • Advanced: Students who score as basic can independently demonstrate more than 75% of all skills measured in the _____ level access points.

9. Performance Levels • Performance level descriptors at a grade level are lengthy • Include all access points assessed • Example: 3rd grade math • 3 Big Ideas and 4 Supporting Ideas • 19 (independent), 16 (supported), and 20 (participatory) access points • 11 (independent), 9 (supported), and 11 (participatory) access points assessed

10. Standard Setting Validation • July 15-18 • Operational test data • Same procedures • Panelists set Performance Level cuts within each LOC • Preliminary results under review

11. Standard Setting - Next Steps • State Board Rule under development • Establishes the cut scores • Out for comment in the Fall • Revision to performance level descriptors and labels based on feedback from standard setting and Technical Advisory Committee

12. 2008 Results

13. Spring 2008 Administration • 27,683 answer sheets scanned • 3,616 not assessment for various reasons • 734 duplicates or invalid bubble • 126 cannot be scored in any content area • 23,207 students have at least one valid content score

14. Spring 2008 Administration • Invalid Records • Incomplete scoring within a content area • Double bubbles • Grade level and content area mismatch • Invalid bubble filled in on document

15. Spring 2008 Administration • Districts Received • Individual student reports • School reports • District reports

24. Spring 2008 - 1% Cap • Calculation • Numerator = Number of SWD reported as proficient or advanced on Florida Alternate Assessment in grades 3-10 • Denominator = Number of students participating in an assessment in grades 3-10 • Calculated separately for reading and math • Calculated at the district level

25. Spring 2008 - 1% Cap • Decision Rules • If district exceeds cap, students with a primary exceptionality of specific learning disability and no other exceptionalities are reverted to non-proficient • Calculations are re-run • If district still exceeds the cap, they may apply for a waiver

26. Spring 2008 - 1% Cap • Waiver consideration is given to districts who submit data in support of the following explanations: • House multi-district programs for students with significant cognitive disabilities • Are very small, such that a slight change in number of students produces a large change in percentage

27. Spring 2008 - 1% Cap • Waiver consideration is given to districts who submit data in support of the following explanations: • House high-quality, research based programs for students with significant cognitive disabilities that attract families from around the state and country

28. Spring 2009 - 1% Cap • Districts will need to submit waiver requests by May 15, 2009 • Decisions about waiver requests will be made prior to final AYP calculations

29. 2008-2009 Activities

30. Train-The-Trainer • June 23 & 24, 2008 • Provided updated materials and information • Reading fluency items • Renaming of materials • Test book wording – Teacher will script • Four field test items per content area

31. Content/Bias Review • June 25 & 26, 2008 • Approximately 120 participants • Panelists include content expects (general and special education teachers, and administrators • New item review • Eight items per grade in Reading, Mathematics, and Writing • Twenty-five Items for Science based on newly approved standards

32. Item Specs for New Development • Revisions to standards/access pts. • Item development occurs between January and May for the following year • New items for field testing in 2009-2010 for revised math access points • Language arts will depend on when revised standards/access points are approved by the State Board

33. Item Specs for New Development • Item specifications • Reading Passages • Length • Readability • Addition of Reading Fluency Strand • Elementary – letter and word identification • Secondary – range from reading sentences to one to two paragraphs

34. Item Specs for New Development • Graphics • PECs symbols • Heavier line weight • Reduced detail

35. Accommodations • Accommodations Workgroup • Met via conference call on August 13 • Approximately 25 special education teachers and administrators participated in one of three conference calls • Developed recommendations for additional accommodations for VI, DHH, ASD, MH and ELL students

36. Accommodations • Preliminary Recommendations • Light box • Touch points on number cards • Broader use of concrete items • Use of total communication

37. Web-Base Ordering • Available through Piedra Data Services website • Braille and tactile graphics for students with visual impairments • One sided response booklets • One sided materials will allow teachers to cut out items to have flexibility in item placement

38. Web-Base Ordering • Available September 4-17, 2008 • http://www.piedradata.com/VIS/Login.php

39. Practice Materials • Released items from Spring 2008 administration • Delivered to school district alternate assessment coordinators week of September 8th • Includes two items per content area and grade

40. Practice Materials • All grades and content areas packaged together • Test Booklet • Response Booklet • Passage Booklet • Cards Packet • Strips Packet

41. Test Booklet • Items for all grades and content area are in one test booklet • Content standards assessed are listed in the front of the test booklet • Required teacher gathered materials are provided by content area • Item Identifiers • Item number, grade level, content area, and LOC

46. Passage Booklet • Passages and passages picture cards for all grades are in one test booklet • Items are presented grouped by grade • Item Identifiers – Coded by content area, grade level, and item number • Ex: Reading Grade 3 Item 1

49. Response Booklet • With the exception of Writing and a few cutouts, the response items are provided in one 11 by 17 booklet • Items are presented grouped by grade and content area