Assessment Literacy

1. Assessment Literacy Sheboygan Area School District Staff Development 2010-11

2. Thought for the Day… A good teacher makes you think even when you don’t want to.

3. Agenda for Tonight’s Inservice • Purpose of inservice: overview of assessments for and of learning – 10 minutes • Stiggins’ video presentation – 10 minutes • PowerPoint presentation and discussion – 45 minutes • Break – 15 minutes • ‘Jigsaw’ an article – 25 minutes • Assessment rubric – 15 minutes • Samples of quality assessments/discussion – 30 minutes • Your own assessment activity – 30 minutes

4. Current practices in classrooms… • Many students are engaged only in lower-order thinking; i.e. they receive, or recite, or participate in routine practice. In no activities during the lesson do students go beyond simple reproduction of knowledge. • Or…many students are primarily engaged in routine lower-order thinking for a good share of the lesson. There is at least one significant question or activity in which some students perform some higher-order thinking. • Or,…almost all students, almost all of the time are engaged in higher-order thinking. 

5. Why is good assessment essential? To gather evidence of student learning that will inform instructional decisions in ways that maximize learning…

7. Wisconsin’s Balanced Assessment System http://www.dpi.state.wi.us/oea/pdf/balsystem.pdf

8. What are assessments for and of learning? FOR LEARNING • Question to ask: What do my students need to know and understand to be ready to show mastery of the standards? • Assessments diagnose student needs • Assessment is an ongoing process for student achievement • Assessments help teachers and students watch things get better over time • Used by students and teachers during the learning process • Student motivation: success becomes its own reward OF LEARNING • Question to ask: What have my students learned and to what degree of proficiency? • Assessments measure student knowledge • State or district standardized assessments are used to determine what has been learned • Classroom assessments are used for report card grades or other high stakes grading • Used by students and teachers after the learning process • Motivation is a result of a high stakes situation

9. The Balanced Assessment Model Formative Assessment Process: Assessment for learning Summative Assessment Process: Assessment of Learning Formal oral interview Conference with student Formal observation Final copy of written work Final learning log entries Final journal entries Mathematics final solution Final science experiment • Informal teacher questions • Conversation with student • Informal observation • Rough drafts of written work • Learning log ( in progress) • Reflective journals (multiple drafts) • Mathematics problem-solving sets • Practice science experiment

10. The Balanced Assessment Model Formative Assessment Process: Assessment for learning Summative Assessment Process: Assessment of Learning Final presentation Showcase portfolio Final checklist Final rubrics (analytical/holistic) Teacher made tests High stakes standardized tests • Rehearsal of presentation • Working portfolio • Practice checklist of do-overs • Practice rubrics (analytical) • Homework, quizzes • Benchmark/interim tests

11. Seven strategies of Assessment for learning Where am I going? • Provide students with a clear and understandable vision of the learning target • Use examples and models of strong and weak work Where am I now? 3. Offer regular descriptive feedback. 4. Teach students to self- assess and set goals How can I close the gap? 5. Design lessons to focus on one learning target at a time 6. Teach students focused revision 7. Engage students in self-reflection, and let them keep track of and share their learning.

12. Remember… • Quality questioning is essential for quality lessons…. • and • Quality lessons demand quality assessments…

13. How can ‘questioning’inform assessment? What can we use from what we already know that will help us build quality assessments for and of learning?

14. Let’s use some of what we already know to help us in our discussion of assessment…

15. Remember BloomAnd his Taxonomy…?? • In 1956, Benjamin Bloom found that over 95 % of the test questions students encounter require them to think only at the lowest possible level...the recall of information. • Bloom identified six levels within the cognitive domain, from the simple recall or recognition of facts, as the lowest level, through increasingly more complex and abstract mental levels, to the highest order which is classified as evaluation.

16. 1956-2001… • Evaluation • Synthesis • Analysis • Application • Comprehension • Knowledge Bloom’s original taxonomy…

17. The ‘New’ Bloom’s Taxonomy- A Worthwhile Revision • In 1996 a revision was led by David Krathwohl, a cognitive psychologist who worked with Bloom on the original taxonomy. The revision was completed in 2001. • The use of verbs in the new taxonomy, rather than nouns, is critical since the verbs represent the cognitive processes that students use on or with the content so that learning occurs.

18. Bloom’s Taxonomy Original Terms New Terms • Evaluation • Synthesis • Analysis • Application • Comprehension • Knowledge • Creating • Evaluating • Analyzing • Applying • Understanding • Remembering

19. BLOOM’S REVISED TAXONOMY CreatingGenerating new ideas, products, or ways of viewing thingsDesigning, constructing, planning, producing, inventing.EvaluatingJustifying a decision or course of actionChecking, hypothesizing, critiquing, experimenting, judgingAnalyzingBreaking information into parts to explore understandings and relationshipsComparing, organizing, deconstructing, interrogating, findingApplyingUsing information in another familiar situationImplementing, carrying out, using, executingUnderstandingExplaining ideas or conceptsInterpreting, summarizing, paraphrasing, classifying, explainingRememberingRecalling informationRecognizing, listing, describing, retrieving, naming, finding

20. Remembering Understanding Recognizing Listing Naming Finding Recalling Retrieving Classifying Summarizing Inferring Comparing Explaining Interpreting Cognitive Processes

21. Applying Analyzing Evaluating Creating Executing/Using Implementing Comparing Differentiating Organizing Attributing Checking Critiquing Generating Planning Producing Cognitive Processes

22. Questioning… If you want a wise answer, ask a reasonable question. Johann Wolfgang Von Goethe(1749-1832) German poet, novelist and dramatist.

23. What happened after...? How many...? What is...? Who was it that...? Can you name ...? Find the definition of… Describe what happened after… Who spoke to...? Which is true or false...? (Pohl, Learning to Think, Thinking to Learn, p. 12 Assessment questions to check for Remembering(lowest level)

24. Remembering, cont’ • List • Memorize • Relate • Show • Locate • Distinguish • Give example • Reproduce • Quote • Repeat • Label • Recall • Know • Group • Read • Write • Outline Recall or recognition of specific information • Listen • Group • Choose • Recite • Review • Quote • Record • Match • Select • Underline • Cite • Sort • Assessments include: • Quizzes • Definitions • Facts: true/false • Worksheets • Vocabulary quizzes • Reproductions • Label diagrams • List facts • Workbook pages

25. Can you explain why…? Can you write in your own words? How would you explain…? Can you write a brief outline...? What do you think could have happened next...? Who do you think...? What was the main idea...? Can you clarify…? Can you illustrate…? Does everyone act in the way that …….. does? (Pohl, Learning to Think, Thinking to Learn, p. 12 Assessment questions to check for Understanding

26. Understanding, cont. • Restate • Identify • Discuss • Retell • Research • Annotate • Translate • Give examples of • Paraphrase • Reorganize Understanding of given information • Describe • Report • Recognize • Review • Observe • Outline • Account for • Interpret • Give main • idea • Estimate • Define • Assessments include: • Recitation • Summaries • Collections • Explanations • Examples • Quizzes • Lists • Labels • Outlines

27. Do you know of another instance where…? Can you group by characteristics such as…? Which factors would you change if…? What questions would you ask of…? From the information given, can you develop a set of instructions about…? (Pohl, Learning to Think, Thinking to Learn, P 13) Assessment questions to check for Applying

28. Applying, cont’ • Translate • Manipulate • Exhibit • Illustrate • Calculate • Interpret • Make • Practice • Apply • Operate • Interview • Paint • Change • Compute • Sequence • Show • Solve • Collect • Demonstrate • Dramatize • Construct • Use • Adapt • Draw Using strategies, concepts, principles and theories in new situations • Assessments include: • Photographs • Illustrations • Simulations • Demonstrations • Journal entries • Presentations • Interviews • Performances • Diary entries

29. Which events could not have happened? If. ..happened, what might the ending have been? How is...similar to...? What do you see as other possible outcomes? Why did...changes occur? Can you explain what must have happened when...? What are some or the problems of...? Can you distinguish between...? What were some of the motives behind..? What was the turning point? What was the problem with...? (Pohl, Learning to Think, Thinking to Learn, p. 13) Assessment questions to check for Analyzing

30. Analyzing cont’ • Compare • Contrast • Survey • Detect • Group • Order • Sequence • Test • Debate • Analyze • Diagram • Relate • Dissect • Categorize • Discriminate • Distinguish • Question • Appraise • Experiment • Inspect • Examine • Probe • Separate • Inquire • Arrange • Investigate • Sift • Research • Calculate • Criticize Breaking information down into its component elements • Assessments include: • Graph • Spreadsheet • Checklist • Chart • Outline • Survey • Database • Mobile • Abstract • Report

31. Is there a better solution to...? Judge the value of... What do you think about...? Can you defend your position about...? Do you think...is a good or bad thing? How would you have handled...? What changes to.. would you recommend? Do you believe...? How would you feel if. ..? How effective are. ..? What are the consequences..? What influence will....have on our lives? What are the pros and cons of....? Why is ....of value? What are the alternatives? Who will gain & who will loose?  (Pohl, Learning to Think, Thinking to Learn, p. 14) Assessment questions to check for Evaluating

32. Evaluating, cont’ • Judge • Rate • Validate • Predict • Assess • Score • Revise • Infer • Determine • Prioritize • Tell why • Compare • Evaluate • Defend • Select • Measure • Choose • Conclude • Deduce • Debate • Justify • Recommend • Discriminate • Appraise • Value • Probe • Argue • Decide • Criticize • Rank • Reject Judging the value of ideas, materials and methods by developing and applying standards and criteria. • Assessments include: • Debates • Panels • Reports • Evaluation • Investigations • Verdicts • Persuasive speeches

33. Can you design a...to...? Can you see a possible solution to...? If you had access to all resources, how would you deal with...? Why don't you devise your own way to...? What would happen if ...? How many ways can you...? Can you create new and unusual uses for...? Can you develop a proposal which would...? (Pohl, Learning to Think, Thinking to Learn, p. 14) Assessment questions to check for Creating(highest level)

34. Creating, cont’ • Compose • Assemble • Organize • Invent • Compile • Forecast • Devise • Propose • Construct • Plan • Prepare • Develop • Originate • Imagine • Generate • Formulate • Improve • Act • Predict • Produce • Blend • Set up • Devise • Concoct • Compile Putting together ideas or elements to develop a original idea or engage in creative thinking. • Assessments include: • Film • Projects • Plan • Media products • Song • Newspaper • Advertisements • Paintings

35. Questions to think about when developing assessments… • Did I decide on the purpose(s) of my questions? • Did I choose important--rather than trivial--material to emphasize students' in-depth exploration of essential/key questions? • Did I differentiate my questions to ensure that all my students reached my targets? • Did I encourage discussion in my classroom by using open-ended questions? • Did I avoid "yes" and "no" questions? • Did I use "probe" questions to encourage students to elaborate and support assertions and claims?

36. Questions to think about when developing assessments… • Did I ensure that students clearly understood my questions--and avoided a "guessing game?” • Did I avoid questions that "contain the answer"? • Did I anticipate students' responses to my questions, yet allow for divergent thinking and original responses? • Did I use purposeful strategies for helping students deal with incorrect responses?

37. References • Bloom's(1956) Revised Taxonomy http://rite.ed.qut.edu.au/oz-teachernet/training/bloom.html • Bloom’s Revised Taxonomy http://coe.sdsu.edu/eet/articles/bloomrev/index.htm • http://www.fno.org/nov97/toolkit.html • http://rite.ed.qut.edu.au/oz-teachernet/training/bloom.html • http://serc.carleton.edu/introgeo/socratic/guiding.html • http://serc.carleton.edu/introgeo/socratic/third.html • http://changingminds.org/techniques/questioning/questioning.html • http://serc.carleton.edu/introgeo/socratic/second.html • http://images.google.com/images?hl=en&q=Questioning&um=1&ie=UTF-8&sa=N&tab=wi • Duncan, D. (2008). Blooms’ Taxonomy in relation to Social Studies. Powerpoint Presentation. • Pohl, Michael. (2000). Learning to Think, Thinking to Learn: Models and Strategies to Develop a Classroom Culture of Thinking. Cheltenham, Vic.: Hawker Brownlow.

38. References • Stiggins, R. et al. (2006), Classroom assessment for student learning: Doing it right. Portland, OR: Pearson Assessment Training Institute. • Tarlinton, D. (2003) Bloom’s Revised Taxonomy. bloomspres.ppt.Powerpoint Presentation. • Balanced assessment (2010). Solution Tree Press. Go.solution-tree.com/assessment