How to Improve Teaching Learning: Selecting, Implementing and Evaluating Digital Resources

1. How to Improve Teaching Learning: Selecting, Implementing and Evaluating Digital Resources Joe Tront, Virginia Tech Flora McMartin, Broad-base Knowledge

2. Agenda 8:00 am Welcome and Introductions 8:10 am Background on the Workshop and Courseware Example 8:20 am Sources for Finding Courseware and Learning Materials 8:30 am Explore Sources on Your Own 8:45 am Overview of Framework for Selecting Materials 9:00 am Practice Applying Framework 9:15am Report Back, Discussion and Wrap-up 9:30am Adjourn 20011 FIE - Rapid City, SD

3. An Example of What We Mean by ‘Courseware’ 20011 FIE - Rapid City, SD

4. Framework for Selecting Learning Technologies …begins with an understanding of the environment in which it will be used Establish Course Goals TGI* Identify Student Learning Outcomes Student Learning Outcomes 7 principles Design Learning Environment Questions to Consider Design Learning Activities (e.g., computer or other non-computer) Design Learning Process (e.g., individual or collaborative) Assess Student Learning * See references 20011 FIE - Rapid City, SD

5. Teaching Goals & Student Learning Outcomes • Higher - Order Thinking Skills • Basic Academic & Communication Skills • Discipline – Specific Knowledge & Skills • Liberal Arts & Academic Values • Work & Career Preparation • Personal Development A PDF version of Angelo & Cross’s Teaching Goals Inventory and self score-able worksheet is available at: apps.carleton.edu/campus/call/assets/Teaching_Goals_Inventory.pdf 20011 FIE - Rapid City, SD

6. 7 Principles of Good Practice in Higher Education Good practice • Encourages student – instructor contact • Encourages cooperation among students • Encourages active learning • Gives prompt feedback • Emphasizes time on task • Communicates high expectations • Respects diverse talents and ways of learning “Seven Principles” originally appeared in the March 1987 AAHE Bulletin. Chickering & Ehrmann. (1996). Implementing the Seven Principles: Technology as Lever http://www.tltgroup.org/programs/seven.html 20011 FIE - Rapid City, SD

7. Places to Find Courseware & Learning Materials • Engineering Pathways – www.engineeringpathway.com/ • NSDL – www.nsdl.org • MERLOT – www.merlot.org • Open Courseware Consortium - www.ocwconsortium.org • I-Tunes University 20011 FIE - Rapid City, SD

8. Designing Computer-Based Learning Activities Establish Course Goals Computer Based Learning Activity Identify Student Learning Outcomes Search for Resources Design Learning Environment Design Learning Activities (e.g., computer or other non-computer) Design Learning Process (e.g., individual or collaborative) Review Resources for Applicability Select Resource & Continue Activity Design Assess Student Learning 20011 FIE - Rapid City, SD

9. Premier Award Criteria: Instructional Design • Learning goals and outcomes • Learning outcomes and goals are clearly stated; supported by the software and learning experiences. • Interactivity • The learner is actively involved in the learning process—the interaction enhances learning • Cognition/Conceptual change • Learning appears to be significant and long lasting, and strong and useful cognitive models can be built • Content • The content is well chosen and structured • Multimedia use • Multimedia is used effectively and promotes the learning objectives and goals • Instructional use/Adaptability • The software can be used in a variety of settings 20011 FIE - Rapid City, SD

10. Premier Award Criteria: Software Design • Engagement • The software holds the interest of a diversity of learners • Learner Interface and Navigation • The software is easy to use • Technical Reliability • The software is free from technical problems 20011 FIE - Rapid City, SD

11. Premier Award Criteria: Content • Content is Accurate • The content is accurate • Organization of Content • The content is consistent with typical engineering instruction • Consistent with Learning Objectives • The content matches the stated learning objectives and goals 20011 FIE - Rapid City, SD

12. Questions to Consider (7 Principles) • Does the courseware encourage desirable behavior? • student-faculty contact • cooperation among students • active learning • Does this courseware provide prompt feedback? • From instructors or peers • automated feedback • feedback tailored to student • Does this courseware emphasize time on task? • Does this material communicate high expectations? • Does this courseware address diverse learning styles? • Treat student needs individually; active vs. passive 20011 FIE - Rapid City, SD

13. Questions to Consider (Student Learning Outcomes) • Does this courseware support my teaching goals • higher order thinking skills • basic academic and communication skills • discipline-specific knowledge and skills • liberal arts and academic values • work and career preparation • personal development 20011 FIE - Rapid City, SD

14. Questions to Consider (Practical) • Students easily grasp how to use this courseware? • Students have access to the necessary support? • Will the courseware work reliably? • How much technical support needed? • Do I have access to the tech. necessary support? • How much time will it take for me to learn how to use this courseware? • Do I have the time to do so? • What will it cost me? • Is this the best tool/process to help my students learn? meet the • Does it match my teaching style? • Does it solve a teaching or student learning problem for me? 20011 FIE - Rapid City, SD

15. Judging the Quality of Courseware: Some Resources • Engineering Pathway Premier Award Criteria • http://www.engineeringpathway.com/ep/premier/2011/criteria.jhtml;jsessionid=EIMQB5LC5320FABAVRSSFEQ • MERLOT Peer Review Criteria • http://taste.merlot.org/evaluationcriteria.html • ACHIVE’s Rubrics for Evaluating Open Education Resource (OER) Objects • http://www.achieve.org/files/AchieveOERRubrics.pdf • IKNEER – Interactive Knowledge Networks for Engineering Education • http://ci4ene04.ecn.purdue.edu/ikneer/index.php 20011 FIE - Rapid City, SD

16. How to Improve Teaching Learning: Selecting, Implementing and Evaluating Digital Resources Joe Tront – Virginia Tech - jgtront@vt.org Flora McMartin – Broad-base Knowledge – flora.mcmartin@gmail.com