Formative Assessment

1. Formative Assessment of Student Understanding in Large Introductory Biology LecturesScott Cooper William Cerbin Deborah HanmerUniversity of Wisconsin-La Crosse

2. Formative Assessment • Assess students while they are learning material. • Give quick feedback which is not graded. • Avoid the standard “Are there any questions?” • Use in large lectures was pioneered in Physics courses using multiple choice questions. • Case studies and problem-based learning often incorporate formative assessment. • This method is a challenge in large lectures with more open-ended or complex problems to solve.

4. UW-System Curricular Redesign Grant • 15 instructors and a cognitive psychologist • 5 campuses • UW-La Crosse, Stout, Stevens Point, Milwaukee, and River Falls • Develop and test formative assessment modules for large introductory biology lectures • Measure effectiveness with summative assessment tools • Submitted a 3 year NSF-ASA proposal

5. Lecture on Phylogenetic Trees(Students are shown three examples by the instructor) time

6. Students make trees based upon three lines of evidence. • Observations of habitat and traits • Observations of skeletons • Observations of gene sequences • After each observation the students modify their trees

7. Black bear (Ursus americanus)Terrestrial Omnivore Hippopotamus amphibiusTerrestrial/Aquatic, Herbivore Harp Seal (Phoca groenlandica)Aquatic/Terrestrial, Carnivore Sea Otter (Enhydra lutris)Aquatic, Carnivore

8. King Penguin (Aptenodytes patagonicus)Aquatic/Terrestrial, Carnivore Blue Whale (Balaenoptera musculus)Aquatic, Omnivore Harbor Porpoise (Phocoena phocoena)Aquatic, Carnivore

9. Now draw a tree similar to this example

12. Homologous structures Vestigial structures Analogous structures

13. Harp Seal (Phoca groenlandica) King Penguin (Aptenodytes patagonicus) Cave Bear(Ursus spelaeus) Hippopotamus antiquus (Extinct) Sea Otter (Enhydra lutris)

14. Harbor Porpoise (Phocoena phocoena)

15. Modify your tree with skeletal evidence

17. Figure 22.11  Molecular data and the evolutionary relationships of vertebrates

18. A portion of the aligned sequences

19. Part of the aligned DNA sequences

20. Modify your tree with molecular evidence

22. Proto-whale skeleton

23. Current best tree

24. Assessment • Formative Assessment • Summative Assessment • Pre and post-tests • Short answer and multiple choice • Student evaluations • Instructor evaluations • Video taping

25. Rubric for Formative Assessment

28. Formative Assessment(n = 127 groups) * * * * * Significant difference

29. Control Experiment:Do formative assessment and instructor feedback affect student learning? • Used the same materials as a lecture without the in-class problem solving and formative assessment.

30. horses asses zebras Equus Merychippus Hyracotherium Fifty million years ago an ancestor to modern horses, Hyracotherium, roamed much of North America. These ancestors to the modern horse were the size of a small dog and lived primarily in forests and scrub. As the climate became warmer and drier the forests were replaced with grasslands. The impact of this climate change on horse evolution can be seen in fossils of Merychippus, a longer legged ancestor of modern horses that roamed grasslands fifteen million years ago. Equus is the only surviving genus in the once diverse family of horses.   Species of Equus lived from 5 million years ago until the present.   Living species include horses, asses, and zebras.   Diagram an evolutionary tree that includes all five species mentioned in the passage above. present 5 million   years ago   15 million years ago

31. Rubric for Summative Assessment

32. Summative Assessment:Short Answer Problem * * * * Significant difference

33. Pre-test results were significantly higher in majors. * Significant difference

34. Summative Assessment:Multiple Choice Problems * (n = 366) (n = 512) * Significant difference

35. Multiple Choice (lecture material) • If we took a modern horse and tried to breed it with Merychippus they could not produce viable offspring. Merychippus and modern horses • Do not have a common ancestor • Are different species • Would look the same • Would be adapted to similar environments • Are both extinct • If Equus is the only surviving genus in the once diverse family of horses, what happened to the other genuses? • They became horses • There were no other genuses • They became extinct • They wouldn’t fit on Noah’s Ark

36. MC Q1: Speciation (lecture) * * * * * Significant difference

37. MC Q2: Extinction (lecture) * * Significant difference

38. Multiple Choice (module material) • Horses and frogs both have front legs, while fish do not. This can be explained by • Frogs and horses can’t swim • Horses and frogs have a more recent common ancestor • Horses and frogs are adapted to the same environment • Horses evolved from frogs • A branch point in an evolutionary tree represents • A modern species that gave rise to a new species • An extinct common ancestor to species found on the branches • An extinct ancestor to just one of the species found on the branches • A specific mating between two different species • A time when natural selection did not occur

39. MC Q3: Grouping (module) * * * * Significant difference

40. MC Q4: Ancestry (module) * * * * Significant difference

41. Student Evaluation of Module(5=Strongly Agree, 4=Agree, 3=Neutral, 2=Disagree 1=Strongly Disagree) n = 38 n = 131

42. Conclusions • Formative Assessment can be effectively used with complex problem-solving in large lecture settings. • Student performance, especially that of non-majors, is improved by active-learning and formative assessment.

43. Any Questions? (Assessment Humor)