480 likes | 674 Views
School Counselors Data-Based Decision-Making . Washington School Counselors Association John Carey National Center for School Counseling Outcome Research UMass Amherst www.cscor.org. Seven Steps in Using Data in Advocacy and Systems Change. 1. Describe the Problem. 2. Generate Vision
E N D
School Counselors Data-Based Decision-Making Washington School Counselors Association John Carey National Center for School Counseling Outcome Research UMass Amherst www.cscor.org
Seven Steps in Using Data in Advocacy and Systems Change 1. Describe the Problem 2. Generate Vision Data 3. Commit To Benchmarks 4. Identify Places to Intervene: First Order Change? Second Order Change? 6. Evaluate Implementation 5. Select Interventions 7. Monitor Problem Data
Seven Steps in Using Data in Advocacy and Systems Change 2. Generate Vision Data 3. Commit To Benchmarks 1. Describe the Problem 4. Identify Places to Intervene: First Order Change? Second Order Change? 6. Evaluate Implementation 5. Select Interventions 7. Monitor Problem Data
Seven Steps in Using Data in Advocacy and Systems Change 1. Describe the Problem 2. Generate Vision Data 3. Commit To Benchmarks 4. Identify Places to Intervene: First Order Change? Second Order Change? 6. Evaluate Implementation 5. Select Interventions 7. Monitor Problem Data
Seven Steps in Using Data in Advocacy and Systems Change 1. Describe the Problem 2. Generate Vision Data 3. Commit To Benchmarks 4. Identify Places to Intervene: First Order Change? Second Order Change? 6. Evaluate Implementation 5. Select Interventions 7. Monitor Problem Data
Seven Steps in Using Data in Advocacy and Systems Change 1. Describe the Problem 2. Generate Vision Data 3. Commit To Benchmarks 4. Identify Places to Intervene: First Order Change? Second Order Change? 6. Evaluate Implementation 5. Select Interventions 7. Monitor Problem Data
Seven Steps in Using Data in Advocacy and Systems Change 1. Describe the Problem 2. Generate Vision Data 3. Commit To Benchmarks 4. Identify Places to Intervene: First Order Change? Second Order Change? 6. Evaluate Implementation 5. Select Interventions 7. Monitor Problem Data
Seven Steps in Using Data in Advocacy and Systems Change 1. Describe the Problem 2. Generate Vision Data 3. Commit To Benchmarks 4. Identify Places to Intervene: First Order Change? Second Order Change? 6. Evaluate Implementation 5. Select Interventions 7. Monitor Problem Data
Seven Steps in Using Data in Advocacy and Systems Change 1. Describe the Problem 2. Generate Vision Data 3. Commit To Benchmarks 4. Identify Places to Intervene: First Order Change? Second Order Change? 6. Evaluate Implementation 5. Select Interventions 7. Monitor Problem Data
Seven Steps in Using Data in Advocacy and Systems Change 2. Generate Vision Data 3. Commit To Benchmarks 1. Describe the Problem 4. Identify Places to Intervene: First Order Change? Second Order Change? 6. Evaluate Implementation 5. Select Interventions 7. Monitor Problem Data
Step 1: Describe the Problem • Disaggregation Tools • Triangulation Tools
Disaggregating Data • Comparing and contrasting the performance of different groups of students on some outcome measure. (Results Data) • Comparing and contrasting the rates of participation of different groups of students in school programs and activities related to outcomes. (Process Data) • Comparing and contrasting the perceptions of different groups of students on factors related to outcomes. (Perceptual Data)
Disaggregation Categories • Race • Gender • Limited English Proficient • Academic/Vocational Track • English Language Learners • Free or Reduced School Lunch • Mobility • Special Needs • Achievement Quartile • Grade
Disaggregating DataAchievement Outcomes2002 10th Grade MCAS English Language Arts
Disaggregating DataAchievement Outcomes2002 10th Grade MCAS English Language Arts
Disaggregating DataAchievement Outcomes2002 10th Grade MCAS English Language Arts
Disaggregating DataAchievement Outcomes2002 10th Grade MCAS Mathematics
Disaggregating DataAchievement Outcomes2002 10th Grade MCAS Mathematics
Disaggregating DataAchievement Outcomes2002 10th Grade MCAS Mathematics
Disaggregating School Process Data% Attending Gateway ClassesPartnership District Data
Disaggregating Perceptual DataSchool Climate SurveyMinority Student Achievement Project I work hard in school because the teacher demands it.
Disaggregating Perceptual DataSchool Climate SurveyMinority Student Achievement Project I am happy to be at this school.
Disaggregating Perceptual DataSchool Climate SurveyMinority Student Achievement Project How many teachers know how capable you are to do well in school?
Triangulate • Use three different independent sources of data to describe the problem. • Results Data • School Process Data • Perceptual Data
Triangulating Results Data School Process Data THE PROBLEM Perceptual Data
Triangulating High percentages of African American Students Fail 10th grade MCAS. School Process Data THE PROBLEM Perceptual Data
Triangulating High percentages of African American Students Fail 10th grade MCAS. Low percentages of African American Students Take 8th Grade Algebra and Algebra 2 THE PROBLEM Perceptual Data
Triangulating High percentages of African American Students Fail 10th grade MCAS. Low percentages of African American Students Take 8th Grade Algebra and Algebra 2 THE PROBLEM Many African American Students Report Teachers Do Not Think They Are Able To Go To College.
Seven Steps in Using Data in Advocacy and Systems Change 1. Describe the Problem 2. Generate Vision Data 3. Commit To Benchmarks 4. Identify Places to Intervene: First Order Change? Second Order Change? 6. Evaluate Implementation 5. Select Interventions 7. Monitor Problem Data
Step 2: Generate Vision Data • Successful Vision Data is: • Agreed upon by most members of the system • Concrete and specific • Measurable • Related to student learning outcomes • Ambitious • Attainable • Tied to a deadline • Related to Values and Passion
Generate Vision Data: How to do it • Start with a description of the status quo • What pleases you about the students’ current achievement data? • What disturbs you about your students’ current achievement data? • Generate a quantitative description of achievement data some specific time in the future. • What should the data look like in five years?
Vision Data: MCAS Pass Rates for History and Social Studies in 2003
Vision Data: MCAS Pass Rates for History and Social Studies in 2008
Seven Steps in Using Data in Advocacy and Systems Change 1. Describe the Problem 2. Generate Vision Data 3. Commit To Benchmarks 4. Identify Places to Intervene: First Order Change? Second Order Change? 6. Evaluate Implementation 5. Select Interventions 7. Monitor Problem Data
Step 3: Commit to Benchmarks The term “benchmarking” was originally used by land surveyors to mark reference points (buildings, rocks, landmarks) measuring the distance from a particular spot. Setting a benchmark told you how far away you were from a certain reference point (Vision Data).
Commit to Benchmarks • What are the yearly markers we will use to determine how far away we are from our goals and vision? (Expected Results Over Time) • How will we know that we are getting closer? What are our measurements?
Seven Steps in Using Data in Advocacy and Systems Change 1. Describe the Problem 2. Generate Vision Data 3. Commit To Benchmarks 4. Identify Places to Intervene: First Order Change? Second Order Change? 6. Evaluate Implementation 5. Select Interventions 7. Monitor Problem Data
Step 4: Identify Places to Intervene • Level • Student • Peer • Teachers • School Climate and Policies • Family • Community
Seven Steps in Using Data in Advocacy and Systems Change 1. Describe the Problem 2. Generate Vision Data 3. Commit To Benchmarks 4. Identify Places to Intervene: First Order Change? Second Order Change? 6. Evaluate Implementation 5. Select Interventions 7. Monitor Problem Data
Step 5: Select Interventions • Identify Possible Interventions • Individual Interventions • Systemic Interventions • Align with Levels (Student thru Community) • Align with Evidence Base • Identify Expertise and Learning Needs • Identify Community Resources • Identify Possible Roadblocks and Resistance • Write Action Plan
Seven Steps in Using Data in Advocacy and Systems Change 1. Describe the Problem 2. Generate Vision Data 3. Commit To Benchmarks 4. Identify Places to Intervene: First Order Change? Second Order Change? 6. Evaluate Implementation 5. Select Interventions 7. Monitor Problem Data
Step 6 Evaluate Intervention • Formative Evaluation—Process • Monitor Implementation • Correct Problems • Summative Evaluation • Perceptual Data • Results Data
Seven Steps in Using Data in Advocacy and Systems Change 1. Describe the Problem 2. Generate Vision Data 3. Commit To Benchmarks 4. Identify Places to Intervene: First Order Change? Second Order Change? 6. Evaluate Implementation 5. Select Interventions 7. Monitor Problem Data
Step 7: Monitor Problem Data • Evaluate Results Over Time • Alter Implementation Strategy • Stay the Course • Celebrate • Disseminate • Publicize
National Center for School Counseling Outcome Research http://www.umass.edu/schoolcounseling/ Thank You