Selecting Appropriate Students Virginia Modified Achievement Standards Test (VMAST)

1. Selecting Appropriate Students Virginia Modified Achievement Standards Test (VMAST) Virginia Department of Education Division of Student Assessment and School Improvement

2. Purpose of this Presentation To provide Division Directors of Testing, Special Education Directors, and other school leaders with information that can be shared with IEP team members responsible for making assessment decisions for students that may be appropriate for the Virginia Modified Achievement Standards Test (VMAST).

3. Presentation Topics • IEP Team Assessment Responsibilities and Requirements • Virginia Assessment Options for Students with Disabilities • VMAST Overview and Sample Items • Selecting VMAST Participants • VMAST Implementation • Questions

4. IEP Team Assessment Responsibilities and Requirements

5. IEP Team Assessment Responsibilities Federal and state laws require students with disabilities to participate in the assessment component of the state accountability system. Students with disabilities must participate in all content area assessments that are available to students without disabilities enrolled in the same grade level. The student’s IEP team is responsible for determining how the student will participate and the appropriate assessment option.

6. State Assessment RequirementsThe IEP must include...

7. Virginia Assessment Options Students with Disabilities

8. Federal Alternate Assessment Terms

9. Assessment Options forStudents with Disabilities

10. Assessment Options forStudents with Disabilities

11. Assessment Options forStudents with Disabilities

12. Virginia Modified Achievement Standards Test Overview Sample Items

13. United States Department of Education (USDOE) Announcement... In April 2007, USDOE sanctioned the development of modified achievement standards and assessments for a small group of students with disabilities.

14. Content Standards Statements of the knowledge and skills teachers are expected to teach and students are expected to learn. Achievement Standards Statements of how students demonstrate their knowledge and skills of the content standards What’s the Difference?

15. VMAST Development Overview • Research conducted with Virginia educators to identify learner characteristics, develop participation criteria and identify supports and simplifications used in classroom instruction and assessments. • Supports and simplifications applied to existing on-line SOL mathematics and reading test items • Pilot studies and field tests conducted with students with disabilities likely to meet participation criteria to evaluate the effectiveness of supports and simplifications.

16. What is the VMAST? • An alternate assessment based on modified achievement standards • “Modified” does not mean that the content is modified. Items are based on grade level content • Only available in on-line delivery • Maintains test constructs, but is less difficult than the SOL assessments • Is 20% shorter than SOL assessments

17. What is the VMAST? • Research based supports and simplifications identified by Virginia educators are applied to existing SOL mathematics and reading test items. • Assesses grades 3-8 mathematics and Algebra I (available in 2011-2012) • Assesses grade 3-8 reading and EOC English: Reading (available in 2012-2013)

18. VMASTSupports and Simplifications • Reduce answer options from 4 to 3 • Simpler structure or vocabulary • Add precise language for clarification • Reduce number of variables, or simplify digits in mathematics problems • Divide item into discrete steps

19. VMASTSupports and Simplifications • Highlight, color code or box important information • Provide strategies – reminders, hints, formulas • Provide additional instructions • Provide interactive tools • Add/alter graphics • Present items near relevant sections of short reading passages

20. VMAST Practice Items http://www.doe.virginia.gov/testing/alternative_assessments/vmast_va_mod_achievement_stds_test/practice_items/index.shtml

21. Selecting VMAST Participants Federal Requirements Learner Characteristics VMAST Participation Criteria Student Profiles

22. Federal Requirements... Participants • Student has been provided high quality instruction including special education and related services and is still unlikely to achieve grade-level proficiency within the school year as evidenced by multiple valid measures of student progress over time.

23. Federal Requirements...Participants • May be within any of the 13 disability categories defined in IDEA. Students with 504 Plans are not eligible. • Student’s IEP must include grade-level academic content goals or standards-based goals. • Students’ disabilities preclude them from achieving grade-level proficiency, as demonstrated by objective evidence.

24. Virginia Eligible Participants • Students with Disabilities • Identified by IEP Teams • Instructed in grade level content • Disability prevents students from reaching grade level achievement in the same time frame as other students

25. Learner Characteristics Identified by Virginia Educators • Works at a slower pace • Has deficits in factual knowledge • Has difficulties engaging with materials • Benefits from differentiated instruction and additional instructional time • Requires a high level of support • May have below grade level reading ability • May have retention or memory deficits

26. VMAST Participation Criteria Introductory Statement Students participating in the VMAST are expected to learn grade-level content; however, they may require additional time and a variety of instructional and assessment supports. Students participating in VMAST do not receive a modified curriculum; the achievement expectations are modified and difficulty is reduced by including tools and supports that allow participating students to access and demonstrate knowledge of grade level content. Eligibility for VMAST must be determined separately for reading and mathematics.

27. VMAST Participation Criteria Required Components: • The student has a current IEP with grade-level content goals. • Student’s disability precludes him or her from achieving and progressing commensurate with grade-level expectations • Student achievement and progress is evaluated using multiple, objective sources of evidence. • Student’s daily instruction and assessment modifications are clearly documented.

28. VMAST Participation Criteria Qualifying Questions: 1. Does the student need significant instructional supports to access grade level Standards of Learning and show progress? 2. Does the student need modified classroom assessments in order to demonstrate knowledge of grade level content? 3. Is the student not expected to achieve grade-level proficiency within the year? All criteria must be met and supporting documentation provided.

29. Does the student need significant instructional modifications to access grade level Standards of Learning and show progress?

30. Does the student need modified classroom assessments in order to demonstrate knowledge of grade level content?

31. Is the student not expected to achieve grade-level proficiency within the year?

32. A Starting Point for IEP Teams... GATHER IMPORTANT STUDENT INFORMATION • Student Grade Level or Course Enrollment • Instructional Content (Grade Level or Alternative Curriculum) • Disability • Learner Characteristics • Accommodations • Instructional Supports and/or Strategies Provided • Timeframe Expected for Learning Instructional Content • Assessment Performance

33. Critical Questions to Guide Assessment Considerations 1. Is the student instructed in grade level content? If the student is instructed in grade level content, then the IEP team must consider participation in the SOL assessment. 2. Can the student participate in the standard administration of the SOL assessment or are accommodations appropriate? If the student’s disability impacts test accessibility, then the IEP team must consider appropriate accommodations.

34. Critical Questions to Guide Assessment Considerations 3. Can the student demonstrate knowledge and skill through assessments in the multiple choice format? If there is an indication that the student’s disability prevents the demonstration knowledge and skills in a multiple choice format even with accommodations, then the IEP team must consider the VGLA or the VSEP as appropriate. 4. Does the student show the need for extensive supports (beyond accommodations) in classroom instruction and assessments? If the student needs extensive supports, then the IEP team should consider participation in the VMAST. The IEP team must answer “Yes” to each qualifying question and provide supporting documentation.

35. Student Profile #1 - Mary • Student Grade Level – 8th • Content Area/Course Considered - Algebra I • Instructional Content – Grade Level Curriculum • Disability – Learning Disability in the areas of Mathematics and Reading • Learner Characteristics – Cooperative, completes assignments, poor decoding, but above average comprehension; difficulty with multi-step directions, poor visual memory. • Accommodations –Read-aloud/audio • Instructional supports and/or strategies provided – Extended time, manipulatives, repetition, one-to-one instruction. Computer-based Remediation program; Highlighting, Cue Cards. • Timeframe Expected for Learning – More than one year needed • Assessment Performance – Failed Grade 8 Math SOL and Science SOL (below 400) Below grade level performance on Algebra Readiness test; Passed VGLA Grade 8-Reading.

36. Student Profile #1 - Mary Should the IEP team consider the VMAST Algebra I test for Mary? YES NO Rationale: Mary’s profile states that she is currently being instructed in grade level curriculum. Although she has been provided with supports such as extended time, repetition, and one to one instruction, the read-aloud/audio accommodation, and a specialized remediation program, it is expected that she will need more than one year to learn grade level content. Next Steps: TheIEP team should prepare a packet of documentation to include instructional supports and strategies provided, graded classroom assessments in which accommodations have been provided, records from teachers showing Mary’s progress in the content area. Standards-based IEP goals will also be needed. √

37. VMAST Participation Criteria Form

38. MaryContent Area/Course Considered – Algebra I Section I: Brief Overview of Student’s Disability Mary was found eligible for special education services as a student with Learning Disabilities in reading and mathematics in grade 4. Specific areas of weakness include visual-spatial processing, visual memory, and processing speed. Evaluations of academic achievement conducted in March 2010 included the Basic Reading Inventory which measures reading and listening skills. This inventory indicated that Mary’s overall reading skills were at the 4th grade level with a specific weakness in decoding skills. Scores from the 8th Grade Algebra Readiness test indicated below grade level performance as follows: Number and Number Sense (5th grade level), Measurement and Geometry (6th grade level), Probability and Statistics, Patterns, Functions, and Algebra (4th grade level).

39. MaryContent Area/Course Considered – Algebra I Section I: Impact of disability on classroom performance Mary is unable to decode unfamiliar words and often has difficulty understanding new vocabulary presented across all content areas. Reading comprehension is improved in the classroom setting when information is presented orally through classroom discussions, texts in audio format, and the read-aloud accommodation. In the areas of mathematics, Mary shows weaknesses in general concepts, number sense, and in the interpretation of graphs and diagrams and other pictures. Mary also has difficulty attending to operational signs and the sequencing of steps in complex operations and frequently demonstrates computation errors and the incorrect application of the correct steps needed in problem-solving.

40. MaryContent Area/Course Considered – Algebra I Section II: Qualifying Questions and Supporting Documentation 1. Does the student need significant instructional supports to access grade-level Standards of Learning (SOL) and show progress? Yes No 2. Does the student need modified classroom assessments in order to demonstrate knowledge of grade level or course content? Yes No 3. Is the student not expected to achieve grade level proficiency within the year? Yes No

41. MaryContent Area/Course Considered – Algebra I Section III: Justification Statement Mary’s learning disability in mathematics has presented significant challenges as Mary engages in the grade 8 curriculum. Grade 8 mathematics includes concepts such as solving multistep equations and inequalities, graphing, visualizing three-dimensional shapes represented in two-dimensional drawings, transformations, etc. Mary’s mastery of these concepts appears to be negatively impacted by her weakness in visual- spatial processing, visual memory and processing speed. Her learning is further hampered by difficulties with sequencing and in applying operational signs. It appears, however that Mary benefits from individualized supports such as highlighting, underlining, and cues which focus her attention on critical information needed in problem solving. The use of read-aloud/ audio accommodation is not sufficient to provide access. Additional supports are needed in the testing environment to provide Mary with the opportunity to demonstrate her knowledge and skill. Based on this information the IEP team has determined that Mary is eligible for participation in the Algebra I VMAST.

42. Student Profile #2 - Jordon • Student Grade Level – 3rd • Content Area/Course Considered – Grade 4 Mathematics • Instructional Content – Grade Level Curriculum • Disability – Not Specified • Learner Characteristics – Difficulties in retrieving information, organizing new information, and completing tasks, interacts socially at inappropriate times • Accommodations – Small setting for testing, frequent breaks, manipulatives • Instructional supports and/or strategies provided – Verbal prompts. • Timeframe Expected for Learning – Likely to complete in one year • Assessment Performance – State assessment data not provided.

43. Student Profile #2 - Jordon Should the IEP team consider the VMAST Grade 4 Mathematics test for Jordon? √ YES NO Rationale: Jordon is currently being instructed in grade level curriculum. His profile suggest that although he has some of the learner characteristics (i.e. difficulties with retrieval and organization) associated with VMAST participants, measures such as the Woodcock –Johnson and classroom observations, suggest that he is making excellent progress. Accommodations and supports provided to Jordon are effective in providing access, but not considered extensive. With the progress currently being made, Jordon is likely to master grade level content in one school year. Next Steps: IEP team should strongly considered participation in the Grade 4 SOL mathematics assessment. Individual or small group testing accommodations should also be considered to reduce distractions.

44. Student Profile #3 - William • Student Grade Level – 7th • Content Area/Course Considered – Grade 8 Mathematics • Instructional Content – Grade Level Curriculum • Disability – Intellectual Disability • Learner Characteristics – Strong verbally, Below grade level reading skills • Accommodations – Assistive Technology (Speech to Text, Spell Checker, Word Prediction Software, Dictation to a Scribe, Read/Aloud • Instructional supports and/or strategies provided – Checklist with pictures of steps for solving multi-step equations • Timeframe Expected for Learning – More than one year needed • Assessment Performance – Passed SOL Grade 7 Reading and Math test using accommodations.

45. Student Profile #3 - William Should the IEP team consider the VMAST Grade 8 Mathematics test for William? YES NO √ Rationale: William is able to access the grade 8 curriculum, although he has reading skills that are significantly lower than his grade level. Assistive technology, dictation to a scribe and the read-aloud accommodations have had a positive impact on William performance across content areas, including mathematics. Performance on measure such as the STAR and Math Assessments, SOL tests and a review of the Algebra I standards suggest that William’s disability will not preclude him from meeting grade level expectations if he continues to be provided with the appropriate accommodations. Next Steps: IEP team should strongly consider participation in the Grade 8 SOL mathematics test. Accommodations used in instruction should also be considered for SOL testing.

46. Student Profile #4 - Amanda • Student Grade Level – 7th • Content Area/Course Considered – Grade 8 Mathematics • Instructional Content – Grade Level Curriculum • Disability – Learning Disability in the areas of Reading and Mathematics • Learner Characteristics – Poor decoding skills, Below grade level mathematics performance, Difficulty with abstract concepts. • Accommodations – Books on tape, Text to Speech software, Calculator, Concrete Models, Read-Aloud. • Instructional supports and/or strategies provided – Visual organizers • Timeframe Expected for Learning – • Assessment Performance – None provided

47. Student Profile #4 - Amanda Should the IEP team consider the VMAST Grade 8 mathematics test for Amanda? YES NO Rationale: Amanda is receiving grade level content instruction. Her profile states that she is easily distracted, has poor reading skills and has difficulty with abstract concepts especially in mathematics. Her current skills are well below grade level and she continues to have difficulty mastering concepts such as order of operations, single and multiple step problems. Continued use of accommodations along with additional mathematic instruction will be needed as Amanda moves forward with grade level content. Next Steps: IEP team should discuss VMAST qualifying questions along with supporting documentation. Standards-based IEP goals will also be needed. √

48. VMAST Implementation Implementation Schedule VMAST Mathematics Field Testing Resources

49. VMAST Implementation Schedule

50. VMAST Resources • Available at: http://www.doe.virginia.gov/testing/alternative_assessments/index.shtml • Participation Criteria • Practice Tests (will be updated in 2011) • Practice Test Guides (will be updated in 2011) • Examiner’s Manuals (will be updated 2011)