Best Assessment Practices

1. BestAssessmentPractices

2. Introductions & History Jon S. Twing, Ph.D., Pearson • Where Do We Go From Here? Lisa Ehrlich, Ph.D., Measured Progress • How To Use the Best Practices Joe Willhoft, Ph.D., Washington DOE Wes Bruce, Indiana DOE • Distinguished Commentary and Vision Gene Wilhoit, Executive Director, Council of Chief State School Officers (CCSSO) Agenda

3. Introductions & History Jon S. Twing, Ph.D., Pearson

4. Long Duration-Collaborative Effort • 2007-2010 • ATP, CCSSO • A lot of hard work by a lot of people • Purpose was to define and describe best practices in operational fulfillment of large-scale, high-stakes assessment • Voluntary, inclusive and non-proprietary • Tells us what to do, not how to do it • Applicable to other venues like Common Core • Process involved internal and external review, professional editing and publishing History

5. Many requests made for the Best Practices document have already been made: • US Inspector General • GAO • States for inclusion in RFP’s • Service Providers for inclusion in Proposals • For use as Training Materials • The need seems present and time will tell if the publication is a success Foreshadows of the Future

6. Where Do We Go From Here? Lisa Ehrlich, Ph.D., Measured Progress

7. Use of Best Practices document by service providers • How do I get a copy? • Version II – yikes! Where do we go from here?

8. Guideline for statewide assessment programs • RFP requirement for contract work • Baseline for operational program standards • Used to improve or refine existing procedures or processes • Gap analysis to identify area(s) needing attention • Training document for new employees Service Provider Use

9. To be notified when the document is on Amazon, please send an email to: operationalbestpractices@gmail.com • Complementary copies for States and ATP publishers/vendors • Posted for sale on central site linked to CCSSO and ATP sites • Comprehensive Best Practices communication plan with AAP Test Committee developed • A webinar will be held on July 28th to introduce the document, for more information please send an email to: operationalbestpractices@gmail.com How do I get a copy?

10. Convene new working group in 2011 to begin work on Version II document. • On line assessment expanded • Accommodations • Race to the Top program requirements • Want to participate? Please contact Bob Olsen (roberto@ccsso.org) or Alan Thiemann (ajthiemann@gmail.com). Version II of Best Practices

11. How To Use the Best Practices Joe Willhoft, Ph.D., Washington DOE

12. Race to the Top • Consortia & Common Core Standards and Assessment • Integrated Comprehensive Assessment System • Developed Over Next four Years • Includes Summative and Formative Components • Includes Common Achievement Standards, Item Bank, and Reporting System • Computer Adaptive Changes in our Work

13. Timeline • Proposals Due to U.S Department of Education (USED) June 23 • USED Decision to states by end of September • Work Beginning October 2010 • Assessments in place 2014-2015 Changes in our Work (cont’d)

14. Teacher Involvement Like Never Before • Need to Understand the Basic Process and Collaborate on the Plan • Consortia and State Policy must follow Best Practices • More than ever we require common language for states, districts, teachers, and vendors Changes in our Work (cont’d)

15. Near-term work for states and vendors • Next 3-4 Years for Ongoing Activities • Need for continuation of best practices • New Contracts and Amendments • New Staff and Training • Online Testing Using Best Practice Here and Now

16. How To Use the Best Practices Wes Bruce, Indiana DOE

17. States have much to lose when operational breakdowns occur • Direct impact on students and families • Loss of credibility for the assessment • Impact on Federal & State Accountability Systems • Provides a reason for “change” • Policy implications • Legislative/budget implications Why States Need Best Practices

18. Capacity of SEA staffing • Turnover at SEAs • Capacity building and training • Removes some of client/service provider tensions • Cooperation critical to success – provides common goal • “Partnership” model can be more flexible than a strict procurement model • Helps provide metrics, success indicators and early warning mechanisms in a systemic fashion • Helps planning and avoids reacting on short notice to unexpected events Why States Need Best Practices(cont’d)

19. Professional Development • Procurement • Policy Guidance/Defense How will States use the “Best Practices”?

20. New State Assessment Director • Has an “Owner’s Manual” • New Assessment Staff Member • Specific chapters based on responsibility • Working committees • A resource to help understand complexities and demands of large scale Professional Development

21. Inclusion in RFP • Specific portions • By reference • Use as a tool for proposal evaluation • Ability to demonstrate adherence to these standards • Contract • Establishing common expectations for quality and deliverables Procurement

22. Reference for policy makers, legislators and staff on the how and why of assessment practice • Use when testifying to committees • State Policy Makers • A reference to demonstrate our estimates of time needed for quality are supported by the industry • A demonstration of where costs come from in the assessment program Policy Guidance/Defense

23. Distinguished Commentary and Vision Gene Wilhoit, Executive Director, Council of Chief State School Officers (CCSSO)