150 likes | 166 Views
Learn how to collect and analyze data using various methods such as surveys, interviews, classroom observations, and secondary analysis. Discover strategies for writing effective evaluation questions and explore different types of data sources. Next steps include completing a matrix and receiving personalized feedback.
E N D
MassCUE Evaluators Data Collection Creating Questions Mapped to Indicators
Evidence/Data Collection • Quantitative and qualitative data • Classroom observation, interviews, and work-product review • Focus groups and surveys • Student assessment data • Data sources for secondary analysis • Triangulation among data sources
Writing Good Questions • “Yes/No” questions • Leading questions • Open-ended questions • Multiple choice/controlled vocabulary questions • Likert scale issues
Surveys • Creating good surveys • Length • Differentiation (teachers, staff, parents, community, etc..) • Quantitative data • Attitudinal data • Timing/response rates (getting returns!) • www.sun-associates.com/masscue/othertools.html
Focus Groups/Interviews • Focus Groups/Interviews • Teachers • Parents • Students • Administrators • Other stakeholders • www.sun-associates.com/masscue/samplequestions.html
Classroom Observations • Using an observation template • www.sun-associates.com/masscue/sampletmplt.pdf • Setting up the observation • Providing opportunity for short interviews
Data Collection Issues • Sampling • Confidentiality • Objectivity
Secondary Analysis • Utilizing existing assessments • Cross-year comparisons • MCAS item analysis • Remember, any data you use needs to be mapped to your indicators!
Other Data? • Artifact analysis • A rubric for analyzing teacher and student work? • www.sun-associates.com/masscue/samplelprubric.doc • Other types of rubrics • www.sun-associates.com/masscue/EssenCondRubric.pdf • Solicitation of teacher/parent/student stories • This is a way to gather truly qualitative data • What does the community say about the use and impact of technology? • Student Drawings
Writing Good Questions • “Yes/No” questions • Leading questions • Open-ended questions • Multiple choice/controlled vocabulary questions • Likert scale issues
Next Steps,Your Work • Work on the matrix today • There will be sharing later this afternoon • Complete the matrix and send it to us before Day 3 (we’ll set that date by the end of this month) • Jeff and Jeanne will provide feedback to each team