Dr. Mary E. Yakimowski Ms. Sarah D. Newton University of Connecticut

1. Fostering Evidence-based Cultures in K-12 Schools: Gathering Data from an Online Application System Dr. Mary E. Yakimowski Ms. Sarah D. Newton University of Connecticut Transition to the Connecticut State Standards and System of Assessments Third Annual Connecticut Assessment Crown Plaza, Cromwell Rocky Hill, CT August, 2012 PowerPoint available at: http://www.education.uconn.edu/assessment/

2. Session Description • The University of Connecticut’s Neag School of Education is well-known for a culture in evidence-based decisions leading to continuous improvement (Freed & Huba, 2000; Neag Assessment Committee, 2012; Yakimowski & Coleman, 2009). Among the tools that are used is an on-line application system, which affords the opportunity to efficiently gather data from different stakeholders. Then, the information is analyzed and multi-angulated to make changes so that courses, programs, departments, or the school can improve. As school district personnel are aware, grade K-12 institutions need data to inform for evidenced-based decisions as well. Personnel need information from students, parents, alumni, staff, and community members. In this interactive session, presenters will share and discuss the Neag School’s use of an online application system as generalized to a K-12 setting. For example, presenters will facilitate discussions about accessing and using an on-line application system to gather data on such things as students’ feelings about the school climate, alumni’s opinions regarding about the strengths and areas for improvement regarding their high school education, teachers’ professional development needs, and parents’ perceptions of strengths and areas for improvement with regard to transportation and other issues. Additionally, the presenters will discuss item format, electronic dissemination, and reporting functions.

3. Overview • Purpose • Comparisons (K-12 with HE) • Planning Stages • Identifying Stakeholders • Specifying Information Needed • Merging Stakeholders with Information Needed • Selecting Tool to Acquire Information (Evidence) • If selecting online application system… • General Examples • Specific Examples • Process • Group Activities

4. Purpose • School Improvement • Continuous Improvement • Response to Intervention • Assessment • Evidence-based • Culture

5. Comparisons • Similarities and Differences • Stakeholders • Policy Makers • Accreditation Agencies • Employers Formal/informal decisions Committee Structures Incorporation of “Good” Data

6. Cycle of Continuous Improvement

7. Neag School of Education

8. Neag School of Education Assessment Plan

9. Assessment Plan

11. Overview • Purpose • Comparisons (K-12 with HE) • Planning Stages • Identifying Stakeholders • Specifying Information Needed • Merging Stakeholders with Information Needed • Selecting Tool to Acquire Information (Evidence) • If selecting online application system… • General Examples • Specific Examples • Process • Group Activities

12. Planning Stages: Identifying Stakeholders • Students • Staff • Teachers • Administrators • Board of Education • Community Members • CSDE (maybe)

13. Planning Stages: Specifying Info Needed Professional Development School Climate Parent Interest Teacher Evaluation/Assessment Employer Survey Alumni Opinions Transportation Issues

14. Planning Stages: Merging Stakeholders with Info Needed Information Needed: Professional Development School Climate • Stakeholders: • Students • Staff • Teachers • Administrators • Board of Education • Community Members

15. Planning Stages: Merging Stakeholders with Info Needed Information Needed: Professional Development School Climate • Stakeholders: • Students • Staff • Teachers • Administrators • Board of Education • Community Members

16. Planning Stages: Selecting a “Tool” Based Upon Info Needed • Existing Data • Acquiring New Data

17. Online Application System

18. Online Application Design(Item = Question)

19. Application Writing Tips

20. Item Options

21. Radio Buttons • List – horizontal or vertical - from which one option may be selected • Examples from the Professional Development Evaluation:

22. Drop Down Lists • A drop down menu from which one option can be selected • Example from the School Climate Questionnaire:

23. Checkboxes • List from which multiple options can be selected. • Examples from the Parent Education Interest Inventory:

24. Rating Scales • Radio button scale consisting of consecutively-numbered options • Example from the Employee Survey:

25. Matrices • A grid of questions • Examples from the High School Climate Survey:

26. Open-Ended Single-Line Text • Free-form text with formatting rules • Examples from the Parent Education Interest Inventory:

27. Open-Ended Multi-Line Text • Free-form text in a box with a specified number of rows and columns • Examples from the Elementary School Climate Survey:

28. Selecting Online System: Process • Invitation to Participate with Cover Letter • Purpose • Why THEY are asked for info • Anonymous, confidential, aggregate info • Timeline

29. Invitation to Participate Example:

30. Cover Letter Example:

31. School Climate Questionnaire Example

36. Application Example • Parent Education Interest Inventory – Invitation to Participate

37. Application Example • Parent Education Interest Inventory – Cover Letter

38. Application Example • Parent Education Interest Inventory – Invitation Letter

39. Application Example • Parent Education Interest Inventory – Invitation Letter

40. Application Example • Parent Education Interest Inventory – Invitation Letter

41. Application Example • Parent Education Interest Inventory – Invitation Letter

42. Examples • Elementary School Climate Survey http://uconn.checkboxonline.com/esclimate2012.aspx • Employee Survey • http://uconn.checkboxonline.com/employee2012.aspx • High School Climate Survey http://uconn.checkboxonline.com/hsclimate2012.aspx • Parent Education Interest Inventory http://uconn.checkboxonline.com/parentinterest2012.aspx • Professional Development Evaluation http://uconn.checkboxonline.com/profdev2012.aspx • School Climate Questionnaire http://uconn.checkboxonline.com/climate2012.aspx

43. Report Examples • Pie charts • Bar graphs • Tables • Qualitative responses

44. Checkbox Live Demo

48. Examples and Live Demo An offer … to you Dr. Mary E. Yakimowski mary.yakimowski@uconn.edu 860-486-2848 Ms. Sarah D. Newton University of Connecticut