1 / 18

WESTELL Putting it All Together

WESTELL Putting it All Together. WV Department of Education. Agenda. Overview Standards-Based Assessment Design Language Domains Validity Issues Challenges. Overview. Collaborative Initiative funded by $1.3 million dollar USDE grant

zoltan
Download Presentation

WESTELL Putting it All Together

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. WESTELLPutting it All Together WV Department of Education Amelia Courts, aadavis@access.k12.wv.us

  2. Agenda • Overview • Standards-Based • Assessment Design • Language Domains • Validity Issues • Challenges Amelia Courts, aadavis@access.k12.wv.us

  3. Overview • Collaborative Initiative funded by $1.3 million dollar USDE grant • Chief Council of School State Officers (CCSSO), LEP SCASS (State Collaborative on Standards and Assessment), American Institutes for Research (AIR) • Census Operational / Field test 2004 • Goal of balance: • Language proficiency development • Psychometric requirements • Practical feasibility needs • Cost Amelia Courts, aadavis@access.k12.wv.us

  4. Standards-based • Title III requirements • Performance Standards • Steering Committee collected and analyzed all ELP standards from member states • Rigorous definition of FEP • Realistic expectations for beginning LEPs • Informative levels between the two • Content Standards Amelia Courts, aadavis@access.k12.wv.us

  5. Assessment Design • Align with Content and Performance Standards • Four Content Areas • English Language Arts • Math / Science / Technology • Social Studies • Social / School Interactions • Four Grade Clusters • K-2 * not yet developed • 3-5 • 6-8 • 9-12 Amelia Courts, aadavis@access.k12.wv.us

  6. Assessment Design • Report Performance • Reading • Listening • Writing • Speaking • Comprehension • RLWS and C scores Amelia Courts, aadavis@access.k12.wv.us

  7. Language Domains • Listening • Focus on comprehension of academic English • Authentic, self-contained events • 6 Standards (e.g., follow spoken directions, making inferences) • 5 Text Types (phrases, extended presentations) Amelia Courts, aadavis@access.k12.wv.us

  8. 3-5 6-8 9-12 Number of Items in final form 50 50 60 Item Types Multiple choice* Multiple choice Multiple choice Approx. Administration times 60 min. 60 min. 75 min. Administration type Group Group Group Language Domains • Listening Amelia Courts, aadavis@access.k12.wv.us

  9. Language Domains • Reading • 8 Broad Categories (e.g., early reading skills, making inferences) • 3 Text Types (150-300 word passages with 5-8 comprehension questions) Amelia Courts, aadavis@access.k12.wv.us

  10. 3-5 6-8 9-12 Number of Items in final form 50 50 60 Item Types Multiple choice Multiple choice Multiple choice Approx. Administration times 60 min. 60 min. 75 min. Administration type Group Group Group Language Domains • Reading Specifications Amelia Courts, aadavis@access.k12.wv.us

  11. Language Domains • Writing • Constructed Response • Comprehensibility and discourse features • Short (3-5 per form) • Extended (1-2 per form) • Multiple Choice • Editing and Revising • Planning and Organizing Amelia Courts, aadavis@access.k12.wv.us

  12. 3-5 6-8 9-12 Number of Items in final form 1 Extended CR 3 SCR 15 Multiple Choice 1 Extended CR 3 SCR 15 Multiple Choice 1 Extended CR 4 SCR 15 Multiple Choice Item Types ECR SCR Multiple choice ECR SCR Multiple choice ECR SCR Multiple choice Approx. Administration times 60 min. 60 min. 65 min. Administration type Group Group Group Language Domains • Writing Specifications Amelia Courts, aadavis@access.k12.wv.us

  13. Language Domains • Speaking • Task Structure • Input • Prompt • Scaffold • Prompt Repeated Amelia Courts, aadavis@access.k12.wv.us

  14. 3-5 6-8 9-12 Number of Items in final form 16 16 16 Item Types Prompted oral response** Prompted oral response* Prompted oral response* Approx. Administration times 15 (Plus field test items and instructions) 15 (Plus field test items and instructions) 20 (Plus field test items and instructions) Administration type Group Group Group Language Domains • Speaking Specifications Amelia Courts, aadavis@access.k12.wv.us

  15. Psychometrics • Score reporting scales • Pilot test Spring 2003 • 12 states, 31 schools, 100 students per cluster • Encouraging results • Score reliabilities: .77-.92, mostly mid-80s • Improve item clarity Amelia Courts, aadavis@access.k12.wv.us

  16. Validity Research Agenda • Alignment of items with standards • Item-level analysis (scoring, difficulty) • Test-level analysis (reliability, scaling/equating) • Internal structure/construct validity • Correlations with external measures Amelia Courts, aadavis@access.k12.wv.us

  17. Challenges • Spring 2004 Field test • Screen and select items • Produce 1 operational form • Establish item bank • Produce student scores for Title III reporting • Speaking Component • Design to meet intent of law / administrative feasibility • Cost Amelia Courts, aadavis@access.k12.wv.us

  18. You are the key…to putting it all together! WESTELL

More Related