Using Data to Improve Learning and Improve Teaching

Using Data to Improve Learning and Improve Teaching Steven A Ackerman

Outline • A bit about me • A bit about you (well maybe not) • The Literacies • What I do… and why… • … the value of data… • Summary

A bit about who I am • Faculty in Department of Atmospheric and Oceanic Sciences (Univ. Wisc.-Madison) • Director of the Cooperative Institute for Meteorological Satellite Studies • Research focuses on satellite observations of weather and climate. • Teaching focuses on weather and remote sensing courses • All levels • Also outreach

Outline Again… • Information Literacy • K-12 • College level intro for non-science majors • Data Literacy • College level; meteorology majors • Statistical Literacy • College level intro for non-science majors

3-literacies • Information literacy requires that an individual (student or teacher) recognize that information is needed and be able to locate and evaluate the needed information. They also have to effectively and efficiently access the information.

3-literacies • To be data literate, students must be familiar with a variety of tools for accessing, manipulating and visualizing data.

3-literacies • Statistical literacy requires that a student knows how to use statistics to develop evidence in an argument. They need to demonstrate an ability to assemble data into a summary form, and know what comparisons to make between data sets.

A Conceptual Model… Science Literacy Information Literacy Data Literacy Statistical Literacy

A Conceptual Model… Science Literacy Data Literacy Statistical Literacy Information Literacy

A Conceptual Model… Science Literacy Statistical Literacy Information Literacy Data Literacy

Information Literacy • How do we enable students to know they need data, and what type of data? • One way is through stories

Wisconsin Weather Stories • Classroom-tested lessons that: • integrate earth science, social studies, language arts and math; • are adaptable for different grade levels, and • focus on Wisconsin weather, culture and narrative arts

Wisconsin Weather Stories AC Hi. I'm AC. I'm interviewing my mom, DC. So tell me a little bit about yourself DC Well, I was born and raised in Columbus, Ohio. I grew up in a family of eight people. Pretty much played music most of my life with my parents. Right now currently in school, going to be a pharmacist some day, working at the library school, plus I work at a Pharmacy and I sing in the band.

AC So have you ever been in a major weather storm? DC Actually I have. Back in 1995. I was performing on the Carnival Cruise Line in Florida playing on the M.S. Fantasy and we were about five weeks into the gig when we got caught in Hurricane Aaron. AC How bad was the weather? DC Pretty bad. The boat was pretty rocky. 144-foot waves. Hit the side of the ship, broke a stabilizer. People were sick. We were confined to our rooms, weren't able to go aboard the ship. They didn't want us wandering the halls. Pretty much for about three days we weren't able to land, to dock, do anything. We circled around the eye of the hurricane 180 miles out and it was not a fun ride.

AC Did you get sick at all? DC I was very sick. I ended up having to go to the ship doctor. Got a shot. Knocked me out for two days. AC Where did this take place? Where exactly in the ocean were you?

A satellite view of Hurricane Aaron on August 3, 1995

Where were you on December 31, 1967? You probably wanted to be at Lambeau Field in Green Bay, Wisconsin. This was the site of the National Football League’s (NFL) Championship game between the Green Bay Packers and the Dallas Cowboys. Anyone alive will remember this game known as the historic “Ice Bowl”. Daily Maximum (Red) and Minimum (Blue) Temperature - December 1967 - Green Bay, WI

Applied to undergrad nonmajor • Write/Tell a personal weather story • Grouped students by common story • Developed questions • How much…, how many…, when does… • Why does… • Collected data • Analyzed • Presented data

Approaching a teaching/learning problem How do we learn?

Activity

Learning Diagram(Conceptual Model) • Input: New stimulus. Can be self generated or obtained otherwise • Reception: Student’s filter to an input. Motivation, social and physical environment. • Processing: Re-working the input by integrating reception with accumulated experiences and knowledge • Practice: Use of re-worked input • Feedback: Evaluation of re-worked input

Learning Diagram Bloom’s Taxonomy

So, how does learning diagram help? Bloom’s Taxonomy

Interactive web pages – contouring http://profhorn.aos.wisc.edu/wxwise/AckermanKnox/

Formative Evaluation • Students were surveyed regarding the applets using field-tested questions from “The Flashlight Project” (Ehrmann 1997). • 82% “believed” or “somewhat believed” that the applets helped them to master skills and concepts more quickly than with traditional methods. • 75% “believed” or “somewhat believed” that the applets helped to develop their skills and under-standing better than through traditional reading and pencil-and-paper exercises. • 71% “believed” or “somewhat believed” that the applets allowed them to learn more on their own, with less assistance from the TA.

Assessment of Learning Gains

What we learn on applets? Immediate Recall • TOTAL understanding F = 4.380, p < .038 • RH-temp relationship F = 49.160, p < .001 • RH as moisture indicator F = 7.898, p < .005 Delayed Recall • TOTAL understanding F = 3.562, p < .06 • RH as moisture indicator F = 5.062, p < .025

A teaching conceptual model…

A teaching conceptual model… Good Teaching Learning Through Diversity Learning Community Teaching as Research

A teaching conceptual model… Good Teaching Learning Community Teaching as Research Learning through Diversity

A teaching conceptual model… Good Teaching Learning Community Learning through Diversity Teaching as Research

Why these differences between classes… • The AOS101 meets an extra time during the week and while students are exposed to new material during this 50 minute meeting, these extra meetings may help identify material in the lecture class that is not fully understood by the student • Small group work projects in the discussion section may benefit the targeted group. • Self selection, there may be a certain population that self selects out of the AOS101 class.

How do we fix this? • The AOS101 discussion section focuses more on weather analysis than in the lecture class. So, going to a hybrid class structure, part lecture, part on-line group work, will enable us to include more real-time weather map discussions and interpretation. Addresses: …AOS101 meets an extra time during the week

How do we fix this? • Including some sort of social networking tools in the lecture class may help reduce the adverse outcomes of the targeted minority. Addresses: … Small group work projects in the discussion section

How do we fix this? • We are not sure that technologies will impact this explanation of the difference. Addresses: … Self selection

Why use technology?

Why use the Web specifically… • The Web can make teaching more effective. • The Web can augment traditional resources. • The Web can save time for students and teachers.

Why use the Web specifically… • The Web can make teaching less effective. • The Web can distract traditional resources. • The Web can cost time for students and teachers.

Why use the Web specifically… • Program with funding…

The issue: Can we simulate lab based activities/learning in a large lecture for the Introduction to Weather and Climate course. The course: Two major groups of students AOS 100 No lab section, three credits: n=319 AOS 101 Lab section, four credits: n=125 Mostly non-science majors Plurality are sophomores The solution? Will on-line activities work? Photo: Classroom Management

Forecast Contest

Using Data to Improve Learning and Improve Teaching