1 / 23

Assessing the State of STEM Concept Inventories: A National Workshop

Assessing the State of STEM Concept Inventories: A National Workshop. May 10 – 12, 2007 The Melrose Hotel Washington, DC. Welcome!. Agenda Historical Perspective Parking Lot. Steering Committee. Teri Reed-Rhoads (chair), Purdue University; Kirk Allen, Purdue University;

vin
Download Presentation

Assessing the State of STEM Concept Inventories: A National Workshop

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Assessing the State of STEM Concept Inventories: A National Workshop May 10 – 12, 2007 The Melrose Hotel Washington, DC

  2. Welcome! • Agenda • Historical Perspective • Parking Lot

  3. Steering Committee Teri Reed-Rhoads (chair), Purdue University; Kirk Allen, Purdue University; Jeff Froyd, Texas A&M University; PK Imbrie, Purdue University; Jay Martin, University of Wisconsin-Madison; Ron Miller, Colorado School of Mines Paul Steif, Carnegie Mellon University Andrea Stone, Consultant Robert Terry, University of Oklahoma

  4. Supported by the National Science Foundation(DUE - 0731232) Directorate for Education and Human Resources (EHR) Division of Undergraduate Education (DUE)

  5. Historical Perspective of Concept Inventories Development May 10 – 12, 2007 The Melrose Hotel Washington, DC

  6. Based on a manuscript titled“Concept Inventories: Literature Review of an Assessment Methodology for Engineering and Beyond” Kirk Allen, Andrea Stone, Teri Reed-Rhoads, and Teri J. Murphy

  7. So…how do we know when Concept Inventories have “made it”?

  8. Only one possible indicator

  9. Engineering Education Research Colloquies • EERC - An NSF Sponsored Initiative to • develop a systematic framework for engineering education research • increase our capacity for engineering education research • A collaboration of engineering, science, and mathematics educators and researchers, learning scientists, and practitioners all working together to meet these needs. • EERC Steering Committee: Robin Adams, Norman Fortenberry, P. K. Imbrie, Kamyar Haghighi, Leah Jamieson, Jack Lohmann, Teri Reed-Rhoads, Karl Smith

  10. Report appears in the October 2006 issue of JEE

  11. The Framework Engineering Epistemologies Research on what constitutes engineering now and into the future Engineering Diversity and Inclusiveness Research on how diverse human talents contribute to the social and global relevance of our profession Engineering Learning Mechanisms Research on developing Engineering Learners’ Knowledge and Expertise Engineering Learning Systems Research on the instructional culture and epistemology of engineering educators Engineering Assessment Research on, and development of, assessment methods, instruments and metrics to enhance engineering education

  12. What can we learn from the FCI?

  13. Cited references of major FCI publications Web of Science Cited Reference Search; September 6, 2006

  14. Cited references of 1985 FCI publication, by journal type

  15. Potential from Collaborations • Symbiosis between instruments is possible, with one inventory able to demarcate a mastery threshold for performance on follow-up instruments (e.g., chemistry as a pre-requisite for thermodynamics). • Engineering programs might select deployment of a suite of instruments at the sophomore, junior, and senior years. With SM participants, it could include the freshman year. • Analysis of results from large numbers of students might reveal patterns in development and curriculum, which, in turn, might stimulate curricular renewal. • Assessment of students from diverse institutions might reveal bias due to gender, race/ethnicity, or institution type. Revisions could be made to reduce bias.

  16. Concept Inventories • Engineering Related • 20 instruments • Science and Mathematics Related • 8 instruments • Physics and Astronomy Specific • 12 instruments

  17. Engineering Related CI

  18. Science and Mathematics CI

  19. Physics and Astronomy CI* *Rebecca S. Lindell, Elizabeth Peak and Thomas M. Foster, “Are They All Created Equal? A Comparison of Different Concept Inventory Development Methodologies”, 2006 Physics Education Research Conference Proceedings, American Institute of Physics.

  20. Workshop Questions • What is the current state of concept inventory development across the STEM disciplines? • What CI’s are missing from the current portfolio of CI’s? • What infrastructural needs (e.g., a national database and strategies for organizing and supporting the ongoing efforts) would facilitate CI development and refinement? • How can the results of CI’s be disseminated to inform faculty how to utilize CI’s to assess their teaching and ultimately change pedagogical practice?

  21. CI Community Goals • Provide the opportunity to create a collaborative national database where concept inventory data can be gathered and analyzed in a common way • Provide mechanisms for further development and increasing reliability and validity of concept inventories • Enhance communication between concept inventory developers • Expand the breadth and number of concept inventory users • Make concept inventory use more beneficial to instructors • Catalyze discussions about student conceptual understanding

  22. Parking Lot • Fields/areas/topics that are ripe for CI development • Design • Problem Solving • Economics • Quality Control • …

More Related