Intro to aimsweb Plus (Secondary Edition)

1. Intro to aimsweb Plus (Secondary Edition) September 20, 2016 Jane Sturgell, S. Psy. S., NCSP School Psychologist & MTSS Consultant

2. Today’s Agenda • Overview of Admin / Scoring aimsweb Plus assessments • Online assessment (TestNav) • Digital Record Form (DRF) • Adding Survey Level Assessments • Adding Monitoring / Goals

3. OVERVIEW of AIMSWEB PLUS • All NEW measures with strong technical adequacy • “Digital record forms” for Kindergarten / First Grade • “Digital record forms” for Oral Reading Fluency (Grades 1-8) • Online, Group administered assessments for Grades 2-8 in “Test Nav” • Eliminates paper / hand scoring  Eliminates calculating raw scores  Eliminates data entry! • Reporting capabilities

4. Estimated Benchmarking Time for Fall aimsweb Plus Benchmarks * All measures in grades 7-8 are completed whole group on iPad except Oral reading Fluency

5. SEVENTH GRADE • Fall Reading • SRI • aimsweb Plus Vocabulary SBA (student identifies meanings of words – multiple choice, untimed – 4-8 minutes in Test Nav) • aimsweb Plus Silent Reading Fluency (student reads 3 stories divided into 4 parts and answers multiple choice questions about each story in Test Nav – untimed – 4-6 minutes) • M-Step (Fall only) • Fall Math • aimsweb Plus Number Comparison Fluency – Triads (student mentally solves multiple choice magnitude problems for 3 minutes in Test Nav) • aimsweb Plus Mental Computation Fluency (student solves multiple choice math computation problems for 4 minutes in Test Nav) • aimsweb Plus Concepts & Applications SBA (student mentally solves various types of math problems in Test Nav, untimed - 7–25 min) • M-Step (Fall only)

6. EIGHTH GRADE • Fall Reading • SRI • aimsweb Plus Vocabulary SBA (student identifies meanings of words – multiple choice, untimed – 4-8 minutes in Test Nav) • aimsweb Plus Silent Reading Fluency (student reads 3 stories divided into 4 parts and answers multiple choice questions about each story in Test Nav – untimed – 4-6 minutes) • M-Step (Fall only) • Fall Math • aimsweb Plus Number Comparison Fluency – Triads (student mentally solves multiple choice magnitude problems for 3 minutes in Test Nav) • aimsweb Plus Mental Computation Fluency (student solves multiple choice math computation problems for 4 minutes in Test Nav) • aimsweb Plus Concepts & Applications SBA (student mentally solves various types of math problems in Test Nav, untimed - 7–25 min) • M-Step (Fall only)

7. Overview of aimsweb Plus http://www.aimswebplus.com Customer ID: 4982 User Name: JaneSturgell Password: Auto-generated

8. Why use General Outcome Measurement? • Medicine measures height, weight, temperature, and/or blood pressure • Federal Reserve Board measures the Consumer Price Index • Wall Street measures the Dow-Jones Industrial Average • Companies report earnings per share • McDonald’s measures how many hamburgers they sell

9. Curriculum-Based Measurement • CBM is one type of Curriculum-Based Assessment. • CBA is the direct assessment of what is taught in the classroom. • CBM is a standardized set of methods for assessing students’skills in different areas. • Reading, Spelling, Mathematics and Writing • Most helpful in lower elementary grades and struggling learners through grade 8 • Oral Reading Fluency is the single best predictor of general reading achievement through 8th grade

10. Overview of the Measures “How Can We Help” Measures Videos How To’s

11. Number Comparison Fluency – Triads (Group) Second Grade to Eighth Grade Student mentally solves MC math problems, each requiring assessment of magnitude while comparing a set of three numbers, for 3 minutes on the iPad 2 practice items (self-paced)

12. Mental Computation Fluency (Group) Second Grade to Eighth Grade Studentmentallysolves math computation problems for 4 minutes on the iPad 2 practice items (self-paced)

13. Concepts & Applications (Group) Kindergarten to Eighth Grade Benchmark ONLY Student solves various types of math problems (1:1 in K/1 and on the iPad in 2-8) – untimed but estimated to take 7-25 minutes 1 practice item

14. Oral Reading Fluency (1:1) First Grade to Eighth Grade For Benchmarking - Student reads TWO stories aloud, for one minute each

15. Vocabulary (Group) Second Grade to Eighth Grade Student identifies the meanings of target words (MC on iPad), untimed but estimated to take 4-8 minutes 1 practice item & Grade 2 = 18 questions, Grades 3 – 8 = 24 questions Audio available for all students (directions / text) Student can go back to change responses Benchmark ONLY

16. Silent Reading Fluency (Group) Fourth Grade to Eighth Grade 2 practice items Directions only able to be read aloud Student reads three stories, each divided into four brief sections and answers MC questions about each story on the iPad – untimed but estimated to take 4-6 minutes Student cannot go back to change answers (system indicates whether each question was correct or incorrect) The time students spend on each screen is captured to determine reading rates for each story Student cannot go back to change a response

17. Silent Reading Fluency (Group)

18. Passage Reading Comprehension SBA (Group) Second Grade to Eighth Grade Benchmark ONLY Student reads six passages of text and answers 4 MC questions about each passage on their iPad – untimed, but estimated to take 15-25 minutes (24 questions total) Students are able to go back to correct a response Text is visible when answering questions

19. Passage Reading Comprehension SBA (Group)

20. What questions might you have so far?

21. Administration: General Considerations Altering instructions or presentation of test forms, providing hints, giving corrective feedback or using test forms as teaching tools will invalidate results 1:1 & Online testing completed in a quiet space (limited distractions) 1:1 – position yourself so you are across from a student at a small table or the corner of a larger table If testing is spoiled (interrupted during fluency measures), students can retake the test a few days later

22. Administration: General Considerations • Accommodations – changes made to test setting, timing, presentation format or response format that minimize obstacles to perceiving / respond to test content WITHOUT changing the test – are permitted • TestNav – has a menu of special accommodations tools / features for SWD (contract settings, magnifier, answering masking, show / hide line reader • ORF – enlarging / modifying • Special lighting, adaptive furniture, etc. • Modifications – changes made to the testing process or content – are not permitted • Hints • Corrective feedback • Extended time on timed measures (ORF, MCF, etc.)

23. Administration: Math Grades 2 - 8 • No calculators are permitted on any measure • Number Comparison Fluency – Triads (NCF-T) & Mental Computation Fluency (MCF) are fluency measures with strict time limits • Concepts & Applications (screening only) • Students are allowed scratch paper and pencil • Untimed • Audio available

24. Administration: Math Grades 2-8 • Online measures (NCF-T, MCF and C&A) – all test directions & content are presented on iPad using the TestNav app (Self-Service) • Each student will need headphones / ear buds (have student test audio before beginning) • Examiners present and supervise (proctor) sessions

25. Administration: Math Grades 2-8 • NCF-T – comparison of a set of 3 numbers. Student determines if the top number in the triad is closer to the value of the bottom left number, the bottom right number or exactly in between the numbers • Directions / audio included • 2 practice items • Attempts as many as possible for 3 minutes (max 40 items – 4 items per screen) • MCF – 1 or 2 step mental computation problems • Directions / audio included • 2 practice items • Attempts as many as possible for 4 minutes (max 42 items – 2 items per screen) • Scoring Rules: NCF-T is combined with MCF and reported as a Number Sense Fluency (NSF) score (40 points max)

26. Administration: Math Grades 2-8 • C&A – one & two step word problems • 1 practice item • No time limit • Student attempts all items • Allowed to use scratch paper / pencil to solve test items • Audio is available • 29-31 items (depending on grade)

27. Math: Online Test Sessions • Encourage students to take any bathroom or water breaks before testing begins • Consider using a DND sign • Be an active proctor • Do not allow students to talk • Address questions individually by going TO the student with a question • Do not answer any questions about the test items themselves • Encourage students to answer test items based on what they think each item is asking and to the best of their abilities • Students should complete each assessment at his / her own pace • Test sessions consist of several sections. Be sure each student completes all sections assigned • Read script (found in Appendix A in Administration & Scoring Guide) • Walk around the room to make sure students are progressing through the test and answer any questions that arise (students should remain seated)

28. Administration: Reading Grades 2-8 • Online measures (VO, RC, SRF) – all test directions & content are presented on iPad using the TestNav app (Self-Service) • Each student will need headphones / ear buds (have student test audio before beginning) • Examiners present and supervise (proctor) sessions • Oral Reading Fluency – examiner uses a DRF to admin / score, but students need a stimulus book (2 stories each for benchmarking) • Directions pop up / stop watch built in • Score as you go including SC and score is automatically generated

29. Reading: Online Test Sessions • Encourage students to take any bathroom or water breaks before testing begins • Consider using a DND sign • Be an active proctor • Do not allow students to talk • Address questions individually by going TO the student with a question • Do not answer any questions about the test items themselves • Encourage students to answer test items based on what they think each item is asking and to the best of their abilities • Students should complete each assessment at his / her own pace • Test sessions consist of several sections. Be sure each student completes all sections assigned • Read script (found in Appendix A in Administration & Scoring Guide) • Walk around the room to make sure students are progressing through the test and answer any questions that arise (student should remain seated)

30. Oral Reading Fluency (ORF) MUST complete online portions (Grades 2+) before you can assess ORF 1:1 using a Digital Record Form (DRF) - just like AIMSweb 1.0 Live) Directions appear in bold on screen Preview student passage to make sure it matches Begin when student begins reading Allow 3 seconds for the student to respond (timer in top right corner) Allow 10 seconds for student to sound out / subvocalize before saying the word and marking it incorrect Mark skipped lines, but do not redirect or give corrective feedback If student self-corrects within 3 seconds, record response as correct (re-click word)

31. ORF • “When I say Begin, start reading aloud at the top of this page. Read across the page (demonstrate by moving finger across the page). Try to read each word. Ready? Begin.” • After 1 minute, say “Stop” & record last word student read. • For Benchmarking, have student turn to the second story page and say: “Let’s try another one. Be sure to do your best reading. Ready? Begin.” • Note: if a student finishes in less than one minute, click the pause button and select “Score Completed Form” from the pop-up menu • Discontinue rule: if student reads 10 or fewer words on the first story, do not administer the second story. Click the pause icon and select “Discontinue Form” from the pop-up menu

32. ORF • Words are incorrect if: • A word is skipped • Any sound in a word is mispronounced • A different word is substituted • A word is not read in its proper sequence • An abbreviation is read rather than the full word it presents • The student self-corrects after 3 seconds have elapsed, or • No attempt is made within 3 seconds • Do not penalize for: • Self-corrections made within 3 seconds • Repeated words • Inserted words • Regional dialects, or • Articulation disorders

33. To assess ORF: Open Digital Record Form Click “Students” & “Benchmark Comparison”

34. ORF

35. ORF

39. aimsweb Plus Terms (PLAAFP & SLA) PM slightly below proficient (Below Average range)

40. PR Tables: Click on Groups, Norms Tables, Select Measure & Grade (Expand out PR)

41. Student #1 Profile

42. SRF If SRF score is considered invalid, system will not provide a Reading Composite

44. Student #2 Profile

45. Individual Benchmark Report

46. Score Snapshot

47. Skills Plan

48. Skills Plan Continued

49. Adding Survey Level Assessments Click on Student’s Profile & then SLA Click PLUS sign to add new assessment

50. Survey Level Assessments Example #1 Example #2