1 / 31

David A. Starrett, PhD Director, Center for Scholarship in Teaching and Learning

ED-MEDIA 2002 – Denver. Supporting the Claims of Campus Transformation Through Assessment of Southeast Missouri State University’s "Technology Serving Learning Institutes". David A. Starrett, PhD Director, Center for Scholarship in Teaching and Learning.

eulalie
Download Presentation

David A. Starrett, PhD Director, Center for Scholarship in Teaching and Learning

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. ED-MEDIA 2002– Denver Supporting the Claims of Campus Transformation Through Assessment of Southeast Missouri State University’s "Technology Serving Learning Institutes" David A. Starrett, PhDDirector, Center for Scholarship in Teaching and Learning Michael L. Rodgers, PhDProfessor of Chemistry

  2. Southeast Missouri State University • Regional, comprehensive, Masters granting • 9,000 Students • 380 Full and Term Faculty • Strong commitment to Teaching/learning Use of Instructional Technology in teaching Faculty development • Centralized teaching/learning faculty development center (CSTL) incorporating an Office of Instructional Technology (OIT)

  3. The Internet Revolution (mid-1990’s) • Halfhearted tech investment before 1995-168 of 380 faculty had no PC at work-only 16 dialup lines for remote access to University’s network-only 1900 e-mail accounts for a faculty/staff/student population >10,000 • Low faculty e-learning development skills- no online courses- few Web-augmented courses- no coordinated skills development

  4. Technology Serving Learning Institutes IT Workshops for Faculty Summer session, Winter break Taught by faculty with Student Tech Consultants Diverse participant expertise levels Participants received PD$, software Customized, modular course management software developed by OIT Hardware and software instruction Model evolved:Short course “a la Carte” $70,000 annual budget

  5. Assessment Item #1 Evolution of the Institute • Changes in length, time, organization reflect new clientele • Dynamic faculty interests: new software, teaching techniques, etc. • Computing Services interested in offering workshops within Institute • Respond to faculty requests: Chairs working around TSL schedules • Campus-wide electronic grade reporting workshop using Institute software

  6. Assessment Item #2 TSL Institute attendance numbers

  7. Assessment Item #3 Declining costs for the TSL Institutes

  8. Assessment Item #4 Institute Evaluation instrument results… 9-point scale (9=“Excellent”; 5=“Average; 1=“Poor”) • 8.0 • 8.28.4 • 8.5 “What was your overall rating of this Institute?” “The Institute was practical and useful.” “The facilitators responded effectively to questions.” “The facilitators knew the subject.” 146/149 rated Institute “Effective” or “Somewhat Effective”

  9. Assessment Item #5 Institute Facilitator pool

  10. Assessment Item #6 Number of on-line courses offered

  11. Assessment Item #7 Enrollment in on-line courses Current enrollment

  12. Assessment Item #8 Number of faculty IT server accounts • 275/380 faculty have active IT accounts • New accounts added ~weekly • All new faculty receive and use accounts during orientation

  13. Assessment Item #9 Number of course sections supported by Websites • Instructional servers house >500 course Websites • Servers house >750 OIS-managed course sites • Dozens of new course Websites, OIS-managed sites each semester

  14. Assessment Item #10 Support for locally-authored course management software (OIS) • OIS – modular course management tool for Web-based & Web-assisted courses – 1st taught Winter 2001 • Online Manager, Testing,Gradebook, Calendar, Forum • Under development: chat, portal, student folders, etc. • Faculty serve as advisors, β-testers • Close collaboration between faculty and programmers • Institute participants provide feedback

  15. Assessment Item #11 Quality, sophistication of course Websites • Increased quality, complexity of course Websites for Web-assisted and Web-delivered courses since 1997 • Due to TSL Institutes, increasing faculty experience, other faculty PD

  16. Assessment Item #12 Changes in strategic plans around the University • The 1996-2000 University Strategic Plan included technology as one of six priorities • The current plan assumes technology as base for ALL plan priorities • College and Department plans increasingly reflect technology integration

  17. Assessment Item #13 Increases in faculty attendance and presentations at IT-related conferences • Increasing faculty attendance at tech-related conferences or tech-related sessions at professional society conferences since 1997 • An increasing number of faculty presentations at these conferences

  18. Assessment Item #14 Increased faculty participation in IT committees and discussions on campus • Increased number of campus IT committees since 1997 • Institute veterans make up an increasing percentage of faculty involved in those committees • TLT Roundtables and other IT-related discussions have occurred, with increased faculty involvement

  19. Assessment Item #15 Increased IT-related purchases & infrastructure development • University Information Technology Committee makes budget decisions, allocates funds • Increasing IT funding, including smart classrooms, computer labs, software, specialized hardware, personnel

  20. Assessment Item #16 Student Technology Learning Impact Survey II • March 18 - April 8, 2002 • 2131 student email addresses from online courses taught F99 - S02 • Survey URL sent to all on March 18 • 272 invalid addresses • 6 opted out • URL again sent April 1 to remainder • 408 valid responses (19%) • Graphic Representation: % students choosing given responses.

  21. Helpful Feedback from Instructor?

  22. Intellectual Effort

  23. Does the Instructor Care?

  24. Logical Organization

  25. Did the Students Learn?

  26. Take an Online Course Again?

  27. Assessment Item #17 IDEA results • IDEA (Individual Development Educational Assessment) student ratings of instruction instrument used to obtain nationally normalized data • Results: online courses rated as well as traditional F2F courses; overall indicators show no statistically significant differences

  28. Assessment Item #18 Faculty visits, phone calls, e-mails to CSTL

  29. Assessment Item #19 Interest in the value of IT-related work in Promotion and Tenure decisions • Information Technology Faculty Roles and Rewards advisory document – role of IT in teaching, research, service • Inclusion in college and departmental rank & tenure documentation • Leadership by administrators

  30. Assessment Item #20 Promulgation of standards for instructional Web pages on campus • Online course quality focus • Numerous approaches to ensuring quality online instruction • Technology Associates tasked with creating Instructional Web Page standards • Based on AAHE “Seven Principles” implemented with technology

  31. Thank you for your attention! for further information … • Mike Rodgers: mrodgers@semo.edu • David Starrett: starrett@cstl.semo.edu • Website:http://cstl-cst.semo.edu/rodgers/EDMEDIA2002/ • CSTL: http://cstl.semo.edu

More Related