Increase the Reliability of the Administration of the MI-Access P/SI Assessments

1. Increase the Reliability of the Administration of the MI-Access P/SI Assessments Angela Dalhoe Michigan Department of Education Assessment for Students with Disabilities Program

2. Today’s Focus • Help those charged with training Primary Assessment Administrators (PAAs) and Shadow Assessment Administrators (SAAs) learn ways to effectively conduct training for the administration of the Participation and Supported Independence Assessments.

3. Tools to Assist in Training • Coordinator and Assessment Administrator Manual (CAAM) • Online Learning • Released Items • Item Analysis • EGLCEs and EHSCEs

4. 2007/2008 CAAM Manual • The manual is located online at www.michigan.gov/mi-access • You may want to include portions of the manual in your group or individual training. • Picture Card Presentation • P/SI Rubric

5. Picture Card Presentation • Correct presentation of picture cards will assist in obtaining valid results on P/SI Selected Response Items. • An explanation of picture card presentation is provided in the CAAM in Appendix D (a copy is in your binder)

6. Selecting 1 Word from a Set of 4 • Presented with all 4 words visually accessible at one time • Student can select correct word OR • Assessed using a “yes/no” response by presenting each word beginning with an unrelated and moving to a related

7. Selecting 2 Words from a Set of 4 • Presented with all 4 words visually accessible at one time. • Student can select correct words

8. Selecting 2 Words from a Set of 4 • Assessed using a “yes/no” response • Presenting 2 sets of 2 words (one related and one unrelated in each set).

9. Selecting 3 Words from a Set of 6 • Presented with all 6 words visually accessible at one time • Assessed using a “yes/no” response by presenting 3 sets of 2 words (one related and one unrelated in each set).

10. Scoring Rubric • Knowledge of the scoring rubric is very important for increasing the reliability of the P/SI Assessments. • The PAA and SAA work together prior to the assessment to determine the student’s anticipated response mode. • The PAA and the SAA score the student simultaneously and independently. • Flow Charts for P and SI are located in Appendix E and F in the CAAM (a copy is available in your binder).

11. Scoring Rubric- Participation

12. Scoring Rubric – Supported Independence

15. Online Learning • The MI-Access Participation and Supported Independence Scoring Rubrics Online Learning is located at www.mighigan.gov/mi-access under the Professional Development Opportunities section. • The online learning is still labeled “pilot” • There are 7 modules

33. Released Items • Released items are useful for PAA and SAA to discuss item formats and practice item administration. • Released item booklets are available online. • There is a booklet for each population and subject and at each level: • FI – Grades 3,4,5,6,7,8, and 11 • P/SI – Grades 3-5, 6-8, 11

38. Item Analysis • Item analysis documents allow the PAA and the SAA to observe how released items were scored by both assessment administrators. • Can be used at a district and/or building level to discuss issues of consistency. • Differences in item format • Differences in standards/strands

41. EGLCEs and EHSCEs • Becoming familiar with the EGLCEs and EHSCEs will make the PAA and the SAA more likely to consistently recognize the scoring focus when they observe a student and score an assessment item. • www.michigan.gov/mi-access • Updated documents are posted on at this site and available for download

43. Select EGLCEs or EHSCEs

47. Questions?