1 / 32

C16 – Tools for Assessing Learning in Engineering Teri Reed-Rhoads Purdue University School of Engineering Education

C16 – Tools for Assessing Learning in Engineering Teri Reed-Rhoads Purdue University School of Engineering Education. Inventions and Impact 2: Building Excellence in Undergraduate Science, Technology, Engineering, and Mathematics (STEM) Education 13-15 August 2008 Washington, DC.

akio
Download Presentation

C16 – Tools for Assessing Learning in Engineering Teri Reed-Rhoads Purdue University School of Engineering Education

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. C16 – Tools for Assessing Learning in EngineeringTeri Reed-RhoadsPurdue UniversitySchool of Engineering Education Inventions and Impact 2: Building Excellence in Undergraduate Science, Technology, Engineering, and Mathematics (STEM) Education 13-15 August 2008 Washington, DC

  2. Engineering Education Grant Writing Workshop ASEE Section Meeting April 3, 2008 Teri Reed-Rhoads Purdue University trhoads@purdue.edu

  3. Assessment • Formative – checking along the way • Summative – final analysis of achieving research goals • Consider an outside evaluator – unbiased, measurable feedback • Consider an external advisory board • Give details, actual tools, timelines, etc.

  4. Assessment • Course • Curriculum • Program • Project

  5. Types of Assessment • Cognitive Domain • Content knowledge (Concepts) • Process knowledge, e.g., teamwork (Skills, Abilities) • Student interest, perceptions, and attitudes (Affective) • Rate change (Achievement)

  6. PD’s Response – Goals on Cognitive Changes • Goals on cognitive changes • Increase understanding of concepts • Ability to solve statics problems • Ability to construct free-body diagrams • Ability to describe verbally the effect of external forces on a solid object • Increase processing skills • Ability to solve out-of-context problems • Ability to visualize 3-D problems • Ability to communicate technical problems Connie Della-Piana, Russ Pimmel, Bev Watford “Project Evaluation”, Workshop for Faculty from Minority Serving Institutions, Feb. 8 –10, 2006.

  7. Concept Inventories https://engineering.purdue.edu/SCI/workshop/tools.html • Engineering Related • 20 instruments • Science and Mathematics Related • 8 instruments • Physics and Astronomy Specific • 12 instruments

  8. Engineering Related CI

  9. Science and Mathematics CI

  10. Physics and Astronomy CI* *Rebecca S. Lindell, Elizabeth Peak and Thomas M. Foster, “Are They All Created Equal? A Comparison of Different Concept Inventory Development Methodologies”, 2006 Physics Education Research Conference Proceedings, American Institute of Physics.

  11. Goals on Process Knowledge • Teamwork • Team Effectiveness (Imbrie) • Team Developer (McGourty) • Communications • 3-D Visualization • Etc. • Leadership

  12. PD’s Response – Goals on Affective Changes • Goals on affective changes • Improve students’ attitude about • Profession • Curriculum • Department • Improve students’ confidence • Improve students’ intellectual development Connie Della-Piana, Russ Pimmel, Bev Watford “Project Evaluation”, Workshop for Faculty from Minority Serving Institutions, Feb. 8 –10, 2006.

  13. Affective Measures • Pittsburgh Freshman Engineering Survey (Besterfield-Sacre) • Attitudes Toward Statistics (Wise) • Computer Science Attitude Survey (Moskal) • Structured Interviews

  14. Consider a Graphic

  15. PD’s Response – Goals on Achievement Rate Changes • Goals on achievement rate changes • Improve • Recruitment rates • Retention or persistence rates • Graduation rates Connie Della-Piana, Russ Pimmel, Bev Watford “Project Evaluation”, Workshop for Faculty from Minority Serving Institutions, Feb. 8 –10, 2006.

  16. Know the Motivation or Background

  17. URMs 30% of population, few in labor force • Women 50% of population, 10% in labor force Chubin and Babco (2003), Walking the Talk in Retention to Graduation

  18. Engineering Disciplines Chubin and Babco (2003), Walking the Talk in Retention to Graduation National Science Foundation. Women, Minorities, and Person with Disabilities in Science and Engineering: 2000. Arlington, VA, 2000 (NSF 00-327)

  19. Authentic Teaching Alliance Assessment Cycle

  20. Group Questions • What are the known instruments/methods in each of the three areas? (Cognitive, Affective, and Rate Change) • Where have these been used successfully/unsuccessfully? • Where are the gaps in each area?

  21. Process • One note taker • One reporter • Everyone discusses • We will report out with 15 minutes left

  22. There is no failure. Only feedback. -Anonymous Happy grant writing! trhoads@purdue.edu https://engineering.purdue.edu/SCI/Workshop

  23. Affective • National academy of engineering website with book of surveys

  24. Rate Change • Longitudinal measurements, courses, rate changes of minorities, retention, enrollment, GPA for performance measures • Use Associate Dean’s offices as resources for stats, changes, etc.

  25. Wish • Critical Thinking – one that is free • Definition of engineering changes for students as they go through the curriculum • Digital Systems within computer engineering • Teaming attitude by individual • Measuring how well the student can deal with an out of box situation. • Clearinghouse that explains what already exists, how long is it, how it was used in the past, cliff notes version

  26. Wish • ABET could sponsor (or someone) or post tools that are being used • More CI https://engineering.purdue.edu/SCI/workshop/tools.html • Tools for writing and communication • Life-long learning tools (continuous learning) • Procedural knowledge on engineering design • FREE Critical Thinking

  27. Wish • Meta-cognition • Societal context of knowledge, global competencies, service learning, research skills, discourse and collaborative dialogue, oral communication, problem solving, leadership (some instruments from Business schools), ability to integrate knowledge, longitudinal data, qualitative data analysis • Evaluation of case studies

  28. Cognitive • Math placement test • English Placement test • Concept Inventories https://engineering.purdue.edu/SCI/workshop/tools.html • FE, GRE – standardized tests • Critical thinking • Criticalthinking.org – has tools, and rubric developed by Gary Brown at Washington State, Watson Glazier (also not free), U of South Carolina EFFECTS (web-based) • http://www.ce.sc.edu/effects

  29. California Critical Thinking • Collegiate Learning Assessment • CAAP – from ACT • SALG – Student Assessment of Learning Gains • IDEA – teaching assessments • MSLQ – Motivated Strategies for Learning Questionnaire • NSF User Friendly Guide to Assessment

  30. Rogers and Sando, Rose-Hulman • Learning Styles Instruments (Kolb, Felder) • Career Instruments (Holland) • FMRI, Caps measuring brain activity • Experience sampling method – student wears a bracelet and when it goes off the student writes down what they are doing (engagement measures) • Calibrated Peer review • Teamwork effectiveness (Imbrie, Smith, Layton) • National Center for Case Studies (Buffalo)

More Related