This work was supported primarily by the Engineering

1. Improving Education in Bioengineering Thomas R. Harris Vanderbilt University Nashville, TN USA This work was supported primarily by the Engineering Research Centers Program of the National Science Foundation under Award Number EEC-9876363

2. Outline • Crisis in Engineering Education • VaNTH Vision and Structure • Achievements of VaNTH Project in Bioengineering Education • Conclusions

3. What is expected of engineers in the future? • Strong analytical skills • Practical ingenuity • Creativity • Communications • Business and management skills • Leadership • High ethical standards • Professionalism • Dynamism, agility, resilience, and flexibility • Lifelong learners US National Academy of Engineering, May 2004

4. Problems • Students not receiving enough training in innovation • Reforms identified since 1990 can improve instruction but haven’t been implemented (integrate design, active learning, problem-based learning, leveraging technology) • New professors not trained to teach • No room for the broadening concepts that reformers are identifying • Too few students engaged by their classes • Homework system is burdensome and may be of marginal value for formative assessment in its current form • Technology not utilized enough • Teaching system inefficient

5. Newton The Scientific Vista

6. VaNTH Vision • VaNTH is an ERC that will unite educators and engineers, in academia and industry, to define and develop bioengineering education for the future. • VaNTH will transform bioengineering education by developing, implementing and assessing educational processes, materials and technologies that are aimed at producing adaptive experts . • VaNTH seeks to affect the system of bioengineering education by becoming a working model of how engineering educators can approach development and testing of curricular materials.

7. Biomechanics Biomechanics Equipment Equipment Lab Lab Movement Movement design design Techniques Techniques biomech biomech Sports Sports Orthopedic Orthopedic biomech biomech 13 Taxonomies currently posted on www.vanth.org. biomech biomech Anthropometry Anthropometry Anthropometry Statics Statics Statics Energetics Energetics Energetics Kinematics Kinematics Kinematics Dynamics Dynamics Dynamics Free Free Free - - - body body body Static Static Static Force Force Force Moment Moment Moment Diagram Diagram Diagram Equilibrium Equilibrium Equilibrium Specimen curricula and core competencies posted on www.vanth.org Curriculum To identify the facts, theories, methods, skills and integrative reasoning that should constitute the field of bioengineering Benchmarks: • Create and make available taxonomies of knowledge in bioengineering domains • Make core competencies and candidate curricula in BioE available • Develop instructional materials based in the taxonomies

8. Taxonomy Based Taxonomy Based Challenge Based Challenge Based Concept 7 Concept 6 Challenge 7 Challenge 7 Concept 5 Concept 4 Concept 3 Concept 2 Challenge 2 Challenge 2 Concept 1 Challenge 1 Challenge 1 HPL framework a basis for instructional design Challenge based courseware available on VaNTH portal Instructional Design informed by Learning Science To identify and/or develop the concepts from learning science that can have the greatest impact on producing an adaptive, effective and diverse work-force of bioengineers Benchmarks: • Identify key learning theories for improving bioengineering (HPL Framework, papers, white papers, proceedings, workshops) • Develop approaches to educate bioengineers to become adaptive experts (papers, white papers, proceedings, workshops) • Integrate appropriate LS theories into bioengineering instruction and evaluation of effectiveness (papers, white papers, proceedings, workshops, modules, courses)

9. VaNTH Research

10. Summative assessment Formative assessment A problem statement designed to awake student interest in the engineering content presentations to come. An excellent place to introduce broader implications of engineering including ethics. Goal is to create a “time for telling”. An opportunity for students to use their existing knowledge base to look at a new problem. A mini-exercise in problem-based learning, but also an excellent way to build on previous work. Meat of subject presentation including lectures, simulations, out of class courseware, group work. Similar to traditional course teaching but with more feedback and technology in order to get more across in shorter period. Presentation of expert views (good way to use videos, interviews, news articles, historical references and live presenters). Elements of the Legacy Cycle Applied to Bioengineering

11. Gen Problem Solving HPL Engineering Developing Adaptive Expertise Adaptive Expert Innovation Time Novice Efficiency

12. Indie S ASK FBD … CAPE, INDIE and SASK modules developed and under evaluation Learning Technologies To identify, develop or discover learning technologies that can have the high impact in the envisioned new system of bioengineering education Benchmarks: • Identify or create technologies that provide the following: • Formative assessments of student learning • Aid in module design • Assessment and evaluation of effectiveness of instruction • Enrichment of module presentations • Integration with other systems

13. VOS, Knowledge-Based and Survey measures have been applied to over 40 VaNTH modules and granules Assessment To evaluate the effectiveness of new educational approaches and technologies in a variety of bioengineering settings and with a diverse group of learners Benchmarks: • Identify test beds that have a diverse group of learners • Devise an integrated set of evaluation methods that measure the effectiveness of instruction • Apply these methods to individual modules and courses and to the project as a whole

14. Effect Size ES = (MT - MC)/ SDpooled

15. Meta-Analytic Findings Distribution of Effect Sizes 9 8 Ave ES = 0.64 7 6 5 Number of Studies 4 3 2 1 0 -0.5 -0.25 0 0.25 0.5 0.75 1 1.25 1.5 2 3 More

16. Effects Depend on What is Measured

17. Conclusions • The HPL framework provides a method for designing instruction that increases student innovation in bioengineering. • Learning technology can enhance the effectiveness and efficiency of HPL challenge-based learning

19. Universities Schools Industries Learning Science Domain Knowledge Learning Technology Assessment and Evaluation Courses Mosaics Modules Granules

20. Meta-analysis of VaNTH Studies Meaningful change ES=(Mean Experimental-Mean Control)/(Pooled Standard Deviation)

21. Adaptive Expertise Innovation The Trumpet Continues to Sound “…We must ensure for future generations that America continues to be the innovation leader of the world. … We must choose whether to innovate or abdicate…The competitive and economic future of America is at stake…” Letter from Congressman Frank Wolf to President Bush, May 3, 2005 “…the scientific and technical building blocks of our economic leadership are eroding…” Rising Above the Gathering Storm, NAS, NAE, IOM report 2005. Protecting America’s Competitive Edge (PACE) Act: Introduced by Senator Lamar Alexander (TN) and other colleagues to Senate, Jan 2006 (Aimed at “Gathering Storm” issues).

22. VaNTH IP

23. Presentations at ASEE and BMES in Biomedical Engineering Education, 1998-2005

24. Effect Sizes of Experimental Group 1 0.8 0.6 0.4 Effect Size 0.2 0 1 2 3 4 5 6 7 8 -0.2 -0.4 -0.6 Study Number Effect Sizes Large Medium Small Large Medium Small

25. Self Controlled Studies Large Medium Small

26. Adaptive Adaptive Adaptive Adaptive Expert Expert Expert Expert I I I I n n n n n n n n o o o o v v v v a a a a Time Time Time Time t t t t I I I I o o o o n n n n Efficiency Efficiency Efficiency Efficiency Novice Novice Novice Novice Pathways toward adaptive expertise Pathways toward adaptive expertise Improvements in Teaching Methods Lead to Production of Adaptive Experts • HPL Framework • STAR.Legacy Cycle • Challenge-Based Instruction • CAPE technology

27. Rosters Metadata Sequencing Models Courseware Assignments Instructors Delivery Records Learning Objectives Assessments Experiential Data Courseware Model-Based Delivery Engine Create/Integrate Repository Upload Packages Authors Interfaces DHTML+ Services Security Versioning Flash Session Mgmt Learning Materials Learners XML-RPC Interoperability CAPE Authoring Environment eLMS Delivery Platform Adaptive Courseware: Authoring and Delivery

28. Assessment and Evaluation at the Project, Center and Systems Levels • Systems Level • Macrostatistics • Center Level • Surveys (students, faculty), Meta-analysis • Project Level • Classroom observation (VOS), control/experimental studies (Effect sizes), Multi-method case studies, concept maps

29. Modules/Mosaics Approach: Taxonomy/Topics Review Taxonomy Define Learning Objectives Design Modules and Challenges

30. Deliverables Web Portal Broad Dissemination Workshops, ASEE, AIMBE BMES, EMBS IPP IAB, Workshops, Projects, CE, Internships Collaborations Graduates Academic Programs at VU, NU, UTA U/G Courses at HST Precollege RET, SLC, Associated Projects Workshops Academic Partners UW, Olin, Fisk, UT PanAm, Memphis, Pitt Continuing Ed Committees Curr., Courses, Modules, Techs, A&E Evaluation • Sim. BioE Domains Courses • Critiquing • Instructional • Designs • Systems Physiology • Authoring Modules • Biotechnology • Repository Software • Bio-Optics • Standards • Biomechanics Taxonomies • Formative • assessment • Classroom • techs • Imaging • Assess. • Instruments • Exp. Designs • Analysis Curricula • Bioinstrumentation • Assessment • techs • Biotransport • Skills • Precollege Modules Learning Science Learning Tech Assess. & Eval. Questions and Hypotheses: Development and Design of LT Systems Development and design of Project, Center and System assessments: • What is the nature of • learning in BioE Ed? • Courseware • Authoring systems • HPL improves BioE ed surveys, VOS, PRS, knowledge-based rubrics, tech-based, • BioE ed should be • developing adaptive • experts productivity data, meta-analysis, of project measures, dissemination data • Databases • LT Architecture • HPL BioE can improve • precollege science ed • Web site Systems Enabling Technologies and Testbeds Concepts Papers Research