Patrick Edwards Portland State University Center for Science Education

1. Best Education Practices (BEPs) for Water Outreach Professionals June 2-4 A Preliminary Study on Improving The Quality Of Aquatic Insect Data Collected By Students and Volunteers Patrick Edwards Portland State University Center for Science Education

2. Purpose: • Examine the factors that affect both identification accuracy and taxonomic precision. • Report findings from a research project to improve the accuracy of student identifications of live insects in the field while advancing the taxonomic scope of students’ biomonitoring projects to the family level

3. Biomonitoring is the use of living organisms as indicators of environmental pollution. • Aquatic Macroinvertebrate (insects) Biomonitoring: • Advantages • Engaging • Inexpensive • Educationally Appropriate • Scientifically Relevant • Disadvantages • Identification is Difficult • Resources for Educators are Limited • Course Measure • Accuracy of Student Data is Suspect

4. Difficulty in Identifying Order Family Genus Species Increasing Precision Taxonomy and Precision: As the taxonomic focus moves towards the genus and species level, a biomonitoring study gains precision, while insect identification becomes more difficult

5. Too Difficult for Ed-Based Studies Current Proposed Order Family Genus Species Scientific Research and Policy Advancing the Taxonomic Scope: Current and proposed taxonomic alignment of education-based biomonitoring. At the family level, education-based biomonitoring data are more precise and accurate than order level, and better aligned to inform science and policy.

6. Limitations of Resources for Educators • Guides and Keys • Taxonomically unaligned with the goals of education. • Photographs of preserved insects • No reference for scale • No comparison views • Wide geographic scope • Either too broad (Order) or too narrow (Genus)

7. Flat-Head Golden Stonefly Small Minnow Mayfly Yellow Stonefly • Redesigned Guide • Limited Scope (EPT&D) • Scale Photos • Organized by Family • Live Insects • Scale and Comparison views

8. Flat-Head Mayfly (Heptageniidae) Identification: Flat-head Mayflies are identified by their flat-broad bodies and wide oval-shaped head (A). They range in color from light brown to black, with a prominent row of gills along the side of the abdomen. The gills are oval and flat with a mass of fibers (B) that can be seen with a magnifying glass (image 19). Heptageniidae have two (C) or three (D) long tails (image 20). A ID Tips: The most recognizable characteristics of the this family is their flattened bodies and large heads, which are the widest part of the body. Nymphs are much wider flatter than other mayflies, such as small minnow (image 22). Flat-Headed Mayflies are generally crawlers, but they can swim, and do so with an odd flopping motion. Similar looking families: Small-Minnow Mayfly (pg. 18) and the Spiny-Crawler Mayfly (pg. 19). Image 18: Live Flat Head Image 19: Magnified gills of a Flat Head Mayfly B C D C Flat-Head Mayflies Image 20: Scale view showing 3 specimens of the Flat Head Mayflies. Notice the varying number of tails and the wide range of coloration. 16 Family Overview: In the Willamette Valley, the Flat Head is one of the more abundant and widespread Mayflies families. There are at least nine genera of Heptageniidae in streams and rivers of the Northwest (1). Tolerance: Flat Head Mayfly represents a wide range of tolerance to pollution. Some genera are are quite sensitive to pollution, while other are more tolerant. FBI Value: 4 Image 21: Three-tailed Flat Head Ecology: Flat Head Mayflies cling to the surface of rocks and woody debris where they scrape algae and collect detritus (8). Their flattened, streamlined bodies are well adapted to life along the bottom of fast-moving streams. Their wide mouths with a row of thick hairs are used to collect algae by scraping the surface of rocks and other substrates. Flat-Head Small Minnow Mayfly Image 23: Flat-Head Mayfly. Note the wide, oval-shaped head. Image 22: Scale view comparing Flat Head to Small Minnow Image 24: Two-Tailed Flat Head Mayfly 17

9. Methods • Participants: Upper Division college students enrolled in a 10 week water quality course for non-science majors. • Experiment 1:Guide Only - Compared redesigned guide to standard guides. • Experiment 2: Key ID Characteristics - Students learned the Key ID features of 15 families of aquatic insects through photographic slides and discussion • Experiment 3 - Students were given a tray of insects to use a reference

10. Jar # Students ID’s Instructor Verification Correct? 1 5 Baetidae 3 Baetidae, 2 Heptageniidae Yes 2 5 Ephemerillidae 1 Ephemerillidae, 4 Baetidae No 3 75 Heptageniidae 70 Heptageniidae, 4 Baeitade Yes Methods Determining in Accuracy: Students data were compared to the verified sample

11. Methods • Data Analysis:Two approaches were used to calculate Accuracy - Percent Correct and Percent Total Difference (PTD) • Percent Correct – Is the total number of correctly identified (>50% of the organisms correct) • PTD - Represents the percent difference between the students’ identifications and the verified sample (cite). Lower PTD indicates higher accuracy. • PTD = [ 1- (comppos / N] X 100 • Limitations • The Percent Correct tend to overestimate accuracy • The PTD tends to underestimate accuracy in samples with high numbers of individuals from one family

12. Results: Guide Only Study 9 9 Results of the accuracy tests on the guides only. * p >.025 • Major Findings: • Redesigned guide likely resulted in improved accuracy, but not at a sufficient level of certainty. • Confounding variables influenced the outcome of the study. • Students felt that the scale shots, comparison views, and descriptions were helpful. • Not a good way to teach students how to identify aquatic insects.

13. Results: Interventions 9 10 12 Results of the intervention experiments. p >.25 • Major Findings: • Key ID characteristics improved identification accuracy • Reference tray improved identification to better than the recommended PTD of 15% • Does not represent an effective cognitive model for learning. • Further statistical tests are required to detect any statistical differences.

14. PTD Percent Correct Graph 2: Percent Taxonomical Difference for all interventions. A small PTD value indicates higher accuracy. Line represents suggested max PTD Graph 1: Percent Correct for all interventions.

15. Conclusions • Guides designed with photos of live insects, scale photos, comparison views, and good key ID descriptions will likely result in more accurate field identifications. • Students report less frustration using redesigned guides • Providing a reference tray of insects will result in data that is of sufficient accuracy for volunteer-based biomonitoring programs and official reports. • Reference tray approach is not a good way to teach how to identify aquatic insects.

16. Considerations • This study only represents how well students can identify insects, not how well they can conduct a biomonitoring project • Study not randomized (both in student selections and insect selections) • Experience and practice identifying insects likely played a role in the results • Future Directions • Redesign and re-test guide • Study the accuracy of student’s ability to biomonitor • Create a PNW index for major families

17. Patrick Edwards Portland State Universtiy Center for Science Education 503.725.8303 psu22536@pdx.edu