1 / 58

Technology Apps that Close Achievement Gaps and Boost the Achievement of All Students

Technology Apps that Close Achievement Gaps and Boost the Achievement of All Students. Nancy W. Sindelar, Ph.D . C 2013. Nancy W, Sindelar. About Me. Teacher Teacher, Department Chair, Assistant Principal, Assistant Superintendent, University Professor Consultant

stacey
Download Presentation

Technology Apps that Close Achievement Gaps and Boost the Achievement of All Students

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Technology Apps that Close Achievement Gaps and Boost the Achievement of All Students Nancy W. Sindelar, Ph.D. C 2013. Nancy W, Sindelar

  2. About Me • Teacher Teacher, Department Chair, Assistant Principal, Assistant Superintendent, University Professor • Consultant Works with schools to align curriculum and assessments to standards, develops high performing teacher teams, and guides administrators, teachers and parents through the maze of testing and use of data • Author Assessment Powered Teaching, Corwin, 2010 Using Test Data for Student Achievement: Answers to NCLB and CCSS, Rowman and Littlefield, 2011 (2nd ed.)

  3. Session Outcomes • Overview of research on assessment and the use of technology • Data analysis applications being used by high-achieving schools to monitor students’ progress toward meeting standards and close achievement gaps. • Strategies for Success with the Common Core State Standards • Align existing curriculum and assessments to Common Core State Standards • Use classroom test data to monitor students’ progress toward meeting standards and closing achievement gaps • Motivate students with the results of their learning • Engage parents in the Common Core State Standards Curriculum and Assessment Process.

  4. RESEARCH: IMPROVING LEARNING THROUGH ASSESSMENTTHE POSITIVE FACTORS OF USING ASSESSMENT TECHNOLOGY INCLUDE: • ADJUSTING TEACHING TO TAKE ACCOUNT OF THE RESULTS OF ASSESSMENTS Fullan (2001) Leading in a Culture of Change • PROVIDING EFFECTIVE FEEDBACK TO STUDENTS Sindelar (2010) Assessment-Powered Teaching • MOTIVATING STUDENTS TO BE ACTIVELY INVOLVED IN THEIR OWN LEARNING Sindelar (2010) Assessment-Powered Teaching • PROVIDING STUDENTS WITH THE ABILITY TO SELF-ASSESS THEMSELVES AND UNDERSTAND HOW TO IMPROVE Fullan (2001) Leading in a Culture of Change

  5. RESEARCH: IMPROVING LEARNING THROUGH ASSESSMENTTHE INHIBITING FACTORS INCLUDE: • TEACHERS TEND TO ASSESS QUANITY OF WORK AND PRESENTATION RATHER THAN THE QUALITY OF LEARNING AND LEARNING NEEDS Fullan (2001) Leading in a Culture of Change • “Schools and teachers suffer from the DRIP syndrome---DATA RICH, INFORMATION POOR.” DuFour, R. (2002) What Is a “Professional Learning Community”? Educational Leadership. 61 (8) 6-11. • “Colleges of education often fail to include…assessment training in their programs…and assessment training of any sort remains virtually nonexistent in leadership training programs.” Stiggins. R., & Chappuis, J. (2006) Assessment FOR learning rather than assessment OF learning helps students succeed, Journal of Staff Development, 27 (1) 2. • U.S. educators remain “a national faculty unschooled in the principles of sound assessment.”Stiggins,R. (2002, June) Assessment crisis: The absence of assessment for learning. Phi Delta Kappan, 83(10), 758-765. • Teachers don’t trust the use of data. Over 33% of the 1000 teachers surveyed nationally reported that LMS solutions “made them feel like they were being monitored.” Education Community Attitudes toward SIS/L MS Solutions (2013) @http:www.turningdataintoaction.org • Teachers have very little involvement in instructional technology decisions. Data analysis and learning management system (LMS) implementation efforts are being led by information technology leaders rather that curriculum and instruction leaders. Implementation and Selection Approaches toward SIS/LMS Solutions (2013)@http:www.turningdataintoaction.org

  6. Poll Questions • How many of you are IT leaders? • How many of you are curriculum and instruction leaders? • How many of you are teachers?

  7. Assessment Analysis Improves Teaching and Learning • Use data to inform instruction • Use data to monitor students’ progress toward meeting standards • Use disaggregated data to close achievement gaps • Use data to motivate students with the results of their learning

  8. Four Steps for Gathering and Using Classroom Test Data to Inform Teaching and Monitor Student Progress 1. Align curriculum and classroom assessments to the Common Core State Standards. 2. Create a data-based system to monitor each student’s progress toward standards and learning targets. Focus on evidence of achievement or lack of it---outputs rather than inputs. 3. Decide which assessments will go through item analysis and which reports will be used. 4. Use PLC time to discuss student achievement. Begin with data. Focus on results, not opinions.

  9. Item Analysis ReportApperson Data Link SoftwareUsed with permission

  10. Class Proficiency ReportApperson Data Link SoftwareUsed with permission

  11. Assessment Analysis for Rubric-Graded PerformancesDuPage High School District 88 Used with permission

  12. Summary for Rubric-Graded Speech AssessmentDuPage High School District 88 Used with permission • Summary Report for Local Speech Assessment • After the district speech assessment was given to all sophomore Speech students, the online scoring was summarized in the following report for 470 students: • Willowbrook High School 2002-2003 Speech Local Assessment • Topic Not Meet Meets Exceeds • ___________________________________________________________ • Attention-Getting Opening 12 3% 37 8% 421 90% • Introduction-Preview 9 2% 167 36% 294 63% • Body-Supporting Detail 48 10% 193 41% 229 49% • Body-Transition 48 10% 193 41% 229 49% • Body-Main Points 16 3% 99 21% 355 75% • Body-Sequence 24 5% 217 46% 229 49% • Conclusion-Topic Summary 21 4% 229 49% 220 47% • Conclusion-Clincher 29 6% 322 69% 119 25% • Presentation-Facial 7 1% 236 50% 227 48% • Presentation-Eye Contact 42 9% 203 43% 225 48% • Presentation-Posture 10 2% 345 73% 115 24% • Presentation-Gestures 8 2% 372 79% 90 19% • Voice-Articulation 12 3% 292 62% 166 35% • Voice-Rate of Speaking 15 3% 138 29% 317 67% • Voice-Fluency 19 4% 350 74% 101 21% • Voice-Volume 9 2% 111 24% 350 74% • Voice-Emphasis/Enthusiasm 26 6% 240 51% 204 43% • Supplemental Materials 42 9% 167 36% 261 56% • Organization/Outline 28 6% 83 18% 359 76% • ___________________________________________________________ • Overall 436 4% 4285 46% 4678 50%

  13. Four steps for using disaggregated data to identify low achieving subgroups and close achievement gaps. • Run an item analysis by subgroup. • Focus on achievement of specific standards and specific subgroups. Stop focusing on averages. • Using subgroup assessment data, strategically reteach key standards and learning targets. • Be aware that performance assessments may more accurately measure the knowledge of certain subgroups than forced-choice tests, which depend on the understanding of standard English.

  14. DisaggregatedState Test Data

  15. Mastery Report by StandardNon-disaggregated DataThe Assessor by Progress Educationused with permission

  16. Disaggregated Data by StandardThe Assessor by Progress EducationUsed with permission

  17. Scanable Rubric for World LanguagesDuPage High School District 88 Used with permission

  18. Disaggregated Data for World LanguagesDuPage High School District 88 Used with permission

  19. TYPES OF FORMATIVE ASSESSMENTS • Mid-lesson assessments: • clickers • 3x5 notecards for checks for understanding • “clipboard cruising” • Post-lesson assessments: • forced choice tests with item analysis by class or student • performance assessments with rubric analysis by class or student • force-choice or performance assessments with disaggregated data analysis Note: A summative assessment can be used formatively to change curriculum, course materials and test questions.

  20. Remote Clickers for Formative Assessments

  21. Cudos for Clickers • Christina Grimsley, 16, a junior at Coeur d'Alene High School in Idaho, first used the clicker during a third-year Spanish class earlier this academic year. She said instantaneous feedback was a huge advantage. • "You don't have to wait for someone to sit down and grade them by hand," she said of class assignments. "Right away you're able to get your answers back." • Mike Nelson, Grimsley's Spanish teacher in Coeur d'Alene, said he had proof that clickers enhanced the lessons. • "I have noticed about a 15 to 20 percent increase in their oral grades and their quiz grades, because now I don't need to guess whether kids know it to the best of their ability," he said. "I can actually see it now."

  22. The Rationale for COMMON CORE STANDARDS 1. EQUITY---Common Core Standards are a means to ensure all students have access to a similar education and provide the ability to make better comparisons of student achievement from state to state. “The idea of 50 states each doing their own thing just doesn’t make sense.” (A Duncan, quoted by J. Jennings, “National Standards.” American School Board Journal, Sept. 2009) 2. ECONOMICS---Eliminates the need for financially strapped states to each spend their limited resources on the development of standards, assessments and resources. 3. FUTURE SUCCESS---It’s believed that achievement of these standards will prepare students to succeed in college, job training programs and careers. Four out of ten new college students need to take remedial courses. (U.S. Dept of Education, Blueprint for Reform College and Career Ready Students, 2010)

  23. Strategies for Success with Common Core State Standards • Align existing curriculum and assessments to Common Core State Standards • Use classroom test data to monitor students’ progress toward meeting standards and closing achievement gaps • Motivate students with the results of their learning • Engage parents in the Common Core State Standards Curriculum and Assessment Process.

  24. HOW ARE COMMON CORE STANDARDS DIFFERENT FROM STATE STANDARDS? 1. To date Common Core Standards have been written for English-Language Arts, Math, Literacy in History/ Social Studies (6-12) and Literacy in Science and Technical Subjects (6-12). There are no changes to other standards at this time. Additional standards will be adopted for Science. 2. As with the state standards, grade levels expectations have been developed. Real-world applications and examples are embedded in the standards. 3. Common Core Standards incorporate “college and career readiness.” Capacities include: independence, strong content knowledge, responding to varying demands of audience, task, purpose and discipline, ability to comprehend as well as critique, value evidence, ability to use technology and digital media strategically and capably, and ability to understand the perspectives of other cultures. 4. The ultimate responsibility for ensuring that students master the knowledge and skills in the CCSS rests with districts and schools. Districts will have flexibility in meeting the standards, but many will need to change their curriculum, instruction and local assessments to align with the CCSS. According to Center of Education Policy 61% of districts are developing new curriculum to meet CCSS.

  25. Poll Question How many of you are currently engaged in realigning your current curriculum and classroom assessments to the new Common Core State Standards?

  26. HOW ARE THE COMMON CORE STANDARDS ORGANIZED? Common Core Standards are organized by grade level, (English-Lang Arts K-8, 9-10,11-12; math K-8, 9-12) strand and standard. English-Language Arts strands: READING-LITERATURE (RL) READING-INFORMATIONAL TEXT(RI) READING FOUNDATION SKILLS (RF) (K-5) WRITING (W) SPEAKING LISTENING (SL) LANGUAGE (L) READING HISTORY (RH) (6-12) READING IN SCIENCE AND TECHNICAL TEXT (RST) (6-12) WRITING HISTORY (WHST) (6-12) College and Career Readiness Standards are listed with English and Language Arts

  27. HOW ARE THE COMMON CORE STANDARDS ORGANIZED? Common Core Standards are organized by grade level (K-8 and 9-12), strand and standard. Key Math strands: • OA=Operations and Algebraic Thinking • NBT=Number and Operations in Base 10 • MD=Measurements and Data • G=Geometry • NF=Number and Operations-Fractions • RP=Rations and Proportional Relationships • NS= Number System • EE=Expressions and Equations • SP=Statistics and Probability • A=Algebra.

  28. HOW WILL THE COMMON CORE STANDARDS BE ASSESSED? The 44 states and the District of Columbia have adopted the new K-12 Common Core State Standards in English and math and are pooling their resources for an internationally benchmarked assessment system. The new online assessments, which will be ready for states to administer by the 2014-15 school year, will be better aligned with higher education demands. More than 200 higher education institutions across the 26 states have committed to participate in the partnership and will contribute to the design of the high school assessments. Compared to traditional tests, the online assessments will aim to engage students in more meaningful demonstrations of their knowledge and understanding. The New Learning Standards incorporate more real-world situations so students can learn important skills to utilize in the workplace and higher education. The proposed plan has students in grades 6-11 taking the assessment online. Grades 3-5 is proposed to be paper and pencil, with the hope they can all be move to online in the future. A review of districts’ abilities to administer the assessment online is being implemented.

  29. NOW WHAT? Begin aligning local curriculum to the Common Core standards Begin aligning local classroom assessments to the Common Core standards Analyze local test data to see what students know and what they don’t know before students take the high-stakes tests. Strategically reteach when necessary Use local analyzed test data to engage students (and their parents) in their learning and academic progress.

  30. Monitor Students’ Progress toward Meeting the New Standards • Item Analysis by Standard or Learning Target---WHAT DO STUDENTS KNOW? • Disaggregated Data Reports by Standard or Learning Target---WHAT DO SUBGROUPS KNOW? • Individual Student Reports---WHAT DO I KNOW? WHAT ARE MY NEXT STEPS?

  31. Item Analysis ReportApperson Data Link SoftwareUsed with permission

  32. Class Proficiency ReportApperson Data Link SoftwareUsed with permission

  33. Assessment Analysis for Rubric-Graded PerformancesDuPage High School District 88 Used with permission

  34. Summary for Rubric-Graded Speech AssessmentDuPage High School District 88 Used with permission • Summary Report for Local Speech Assessment • After the district speech assessment was given to all sophomore Speech students, the online scoring was summarized in the following report for 470 students: • Willowbrook High School 2002-2003 Speech Local Assessment • Topic Not Meet Meets Exceeds • ___________________________________________________________ • Attention-Getting Opening 12 3% 37 8% 421 90% • Introduction-Preview 9 2% 167 36% 294 63% • Body-Supporting Detail 48 10% 193 41% 229 49% • Body-Transition 48 10% 193 41% 229 49% • Body-Main Points 16 3% 99 21% 355 75% • Body-Sequence 24 5% 217 46% 229 49% • Conclusion-Topic Summary 21 4% 229 49% 220 47% • Conclusion-Clincher 29 6% 322 69% 119 25% • Presentation-Facial 7 1% 236 50% 227 48% • Presentation-Eye Contact 42 9% 203 43% 225 48% • Presentation-Posture 10 2% 345 73% 115 24% • Presentation-Gestures 8 2% 372 79% 90 19% • Voice-Articulation 12 3% 292 62% 166 35% • Voice-Rate of Speaking 15 3% 138 29% 317 67% • Voice-Fluency 19 4% 350 74% 101 21% • Voice-Volume 9 2% 111 24% 350 74% • Voice-Emphasis/Enthusiasm 26 6% 240 51% 204 43% • Supplemental Materials 42 9% 167 36% 261 56% • Organization/Outline 28 6% 83 18% 359 76% • ___________________________________________________________ • Overall 436 4% 4285 46% 4678 50%

  35. Four steps for using disaggregated data to identify low achieving subgroups and close achievement gaps. • Run an item analysis by subgroup. • Focus on achievement of specific standards and specific subgroups. Stop focusing on averages. • Using subgroup assessment data, strategically reteach key standards and learning targets. • Be aware that performance assessments may more accurately measure the knowledge of certain subgroups than forced-choice tests, which depend on the understanding of standard English.

  36. Mastery Report by StandardNon-disaggregated DataThe Assessor by Progress Educationused with permission

  37. Disaggregated Data by StandardThe Assessor by Progress EducationUsed with permission

  38. Scanable Rubric for World LanguagesDuPage High School District 88 Used with permission

  39. Disaggregated Data for World LanguagesDuPage High School District 88 Used with permission

  40. Motivating students with the results of their learning • John Hattie reviewed 7,827 studies on learning and instruction. His conclusion: “The most powerful single innovation that enhances achievement is feedback. The simplest prescription for improving education must be ‘dollops’ of feedback” Hattie, J. (1992) The power of feedback. Review of Educational Research. 77(1), 81-112. • Susan Brookhart points out that “good feedback gives students information they need so they understand where they are in their learning and what to do next…a cognitive factor. Once they feel they understand what to do and why, most students develop a feeling that they have control over their learning…a motivational factor. • Brookhart, S. (2008) How to Give Effective Feedback to Your Students

  41. Four steps for using data to provide effective feedback and motivate students with the results of their learning. • Use analyzed test data to provide specific feedback in student friendly format that helps students see the next steps they need to take in order to be successful. • Structure class time for students to understand feedback and think about the next steps they need to take. • Be aware that the difference between good students and weak students is that good students can find pathways to success. Weak students don’t understand how to improve and often dismiss school as “stupid” or simply say “I don’t care.” Use test data to engage students in their learning and to see their “next steps” for improvement. • Be aware that feedback is more helpful than a grade.

  42. Guidelines for Feedback or Getting Beyond “Good Job” • Students need: • Descriptive, focused feedback in student friendly language • Feedback that’s directly connected to an assignment through a test analysis report, a rubric or checklist • Information about their strengths • Information about their weaknesses and specific “next steps” about what to do next.

  43. Student Proficiency ReportApperson Data Link SoftwareUsed with permission

  44. Assessment Analysis for Rubric-Graded PerformancesDuPage High School District 88 Used with permission.

  45. Engage parents and other adults in the standards • The Common Core State Standards clearly define what students should know and be able to do at each grade level. Share this information with parents. • Encourage parents to partner with you by implementing real-world examples at home. • Share with parents the enrichment and remediation programs that are offered to students at your school. • Understand test reports and be able to fully explain them to parents. • If it’s not possible to contact a parent, reach out to a coach, tutor or other family member. “If there is a parent that doesn’t care or isn’t around, I call an auntie, the coach or whomever. They know I’m very serious.” (KamilRajagopal, Grant HS, Sacramento, CA)

  46. Real-world CCSS examples that can be reinforced at home Kindergarten Math: Identify and describe shapes (squares, circles, triangles, rectangles, hexagons, cubes cones, cylinders, and spheres. CCKG2 “Correctly name shapes regardless of their orientation or overall size.” Grade 2 Math: Work with time and money. CC2MD 8 “Solve word problems involving dollar bills, quarters, dimes, nickels, and pennies…” Example, You have 2 dimes and 3 pennies. How many cents do you have?” Grade 6 English/Language Arts: Language/ Vocabulary-Acquisition and Use CC6L4 c. Consult reference materials, (e.g. dictionaries, glossaries, thesauruses) both print and digital, to find the pronunciation of a word or determine clarity or its precise meaning or part of speech. Grades 9-12 Literacy in History/Social Studies: Writing Standards for Literacy in History/Social Studies-Research to Build and Present Knowledge CC9-12 WHST9 “Draw evidence from informational texts to support analysis, reflection and research.” Grades 9-12 Math: Statistics and Probability-Using probability to make decisions CC9-12 S-MD4 “Develop a probability distribution for a random variable defined for a sample space in which probabilities are assigned empirically, find the expected value. For example, find a current data distribution on the number of TV sets per household in the United States and calculate the expected number of sets per household. How many TV sets would you expect to find in 100 randomly selected households?”

  47. POLL QUESTION:IDENTIFY THREE APPS YOU CAN USE TO ENGAGE PARENTS WITH THE COMMON CORE STATE STANDARDS 1. 2. 3.

  48. Using Assessment Data Increases Student Achievement and Helps Schools and Teachers to Meet the Challenges Being Presented by the Common Core State Standards • Improves the curriculum. Using data helps us make better decisions about materials that work well and those that don’t. • Informs teaching and encourages targeted instruction and differentiated interventions. Data helps us understand what our students know and don’t know and what they can and cannot do. • Works to close achievement gaps. Using data helps us to become problem-solvers on behalf of our students. PLC meetings become focused on results, not opinions. • Helps motivate students with the results of their learning by identifying specific next steps for improvement. Data helps us give our students specific feedback that is understandable to them and actionable by them. • Helps parents to understand what their children are expected to know and where their children are in the learning process. • c. N. Sindelar, 2010.

  49. Think about this. Not analyzing and using test data is the equivalent of going to the doctor, being diagnosed, but then tuning him or her out and refusing to treat the ailment.

  50. As a teacher “One of the best teaching tools introduced to my school was the provision of data to teachers that identified the percentage of students selecting each option in a force-choice test. Back in 1993, as a new advanced-placement teacher, I began using the information to direct the reteaching and review efforts in my economics classroom. The result was stunning---consistently high scores on the AP test year after year due to the diagnostic benefits of using item analysis. I could not have been as effective a teacher without it!” Joy Joyce, Social Studies Teacher, DuPage HS District 88

More Related