The University of Kentucky ’ s QEP is MCXC! What!?!?

1. The University of Kentucky’s QEP is MCXC!What!?!? The Quality Enhancement Plan (QEP) SLT Update June 6, 2012 Drs. Deanna Sellnow and Diane Snow, Co-Chairs

2. What is a QEP? • Quality Enhancement Plan • A core requirement for SACS Reaffirmation of Accreditation • Focus: Enhancing student learning

4. Presentation U: “YOU are the ultimate presentation” Multimodal Communication Across the Curriculum

6. External Consultants:North Carolina State University Feb. 13-14, 2012 Deanna P. Dannels, PhD Dr. Deanna P. Dannels, Professor of Communication, Director of Graduate Teaching Assistant Development, and Associate Director of the Campus Writing and Speaking Program; current research explores theoretical and curricular protocols for designing, implementing, and assessing oral communication within the disciplines. Chris M. Anson, PhD Professor of English; language and literacy, rhetoric and composition, writing across the curriculum, writing program administration

7. Recommendations Strengths: Process well planned, thorough, collaborative, democratic, plentiful input across constituencies, based on sound research, high potential for sustainability, forward-looking and cutting-edge approaches, staff support a novel component, focus on competencies (not just “skills”) Challenges: Narrow the scope Focus on faculty buy-in and Faculty Fellows program Specific aspects of Assessment Impact

8. External Consultant:Connie Ray, PhDMarch-April 2012 • STRENGTHS: excellent description of process; thorough literature review; relationship to UK Core well documented; QEP nicely linked to Strategic Plan • CHALLENGES: More detail about how information was mined to develop QEP topic; more detail about assessment of QEP; add pilot project; assessment, assessment, assessment…

9. Edited in collaboration with: Karen Badger – Social Work Janet Eldred – English/Engineering Brandi Frisby - CIS Kathi Kern – History/CELT Tara Rose – Univ Assessment Jami Warren - CIS

10. Changes/Additions/Improvements: 1. Narrowed scope to Juniors and Seniors (vertical integration) • Much more detail about Faculty Fellows program and benefits to faculty • Added more detail regarding overall Impact • Discussed Sustainability measures • Many additions to theme development process; 2-day retreat and data mining • Pilot project added to inform QEP assessment process • Greatly improved assessment overall

11. Faculty Development Student Tutoring

12. Fall 2013 Spring 2014 Administrative faculty/staff hired Faculty Fellow (FF) Cohort #1 selected (Attend workshops, collect baseline data, do curriculum revision) Presentation Center Opens Student Tutors hired and trained Fall 2014 FF Cohort #1 Implements MC & collects assessment data FF Cohort #2 selected (Attend workshops, consulting, baseline data, curriculum revision) Lab tutoring Continues Additional Lab funding if warranted Spring 2015 FF Cohort #1 Conducts assessment and makes revisions FF Cohort #2 Implements MC & collects assessment data FF Cohort #3 selected (Attend workshops, consulting, baseline data, curriculum revision) Additional Lab funding if warranted 2015-2018 FF Cohort #2 Examines assessment data and makes revisions FF Cohort #3 Implements MC & collects assessment datat Workshops, Labs, &Tutoring Continues Faculty Fellows: 7 cohorts = 175 trained over 5 years Cohort #3 Collects & Examines Assessment Data Cohorts #4-7complete 3-semester cycles Workshops, Labs, & Tutoring Continues Prepare Impact Report for SACS

13. QEP Impact Exhibit 6.2: Impact Potential Over Five-Years Cohort # of Terms @25/Term=N @50/Term=N 1(F 2013)=25 *8 625=5000 1250=10,000 2(S 2014)=25 7 625=4375 1250=8750 3(F 2014)=25 6 625=3750 1250=7500 4(S 2015)=25 5 625=3125 1250=6250 5(F 2015)=25 4 625=2500 1250=5000 6(S 2016)=25 3 625=1875 1250=3750 7(F 2016)=25 2 625=1250 1250=2500 Students (potentially) Served: 21,875 43,750 *Course implementation: Spring 2014, Fall 2014, Spring 2015, Fall 2015, Spring 2016, Fall 2016, Spring 2017, Fall 2017 (Impact Report due to SACS) END Exhibit 6.2

14. QEP Sustainability • 1. Assessment data will be used to improve and sustain the program as part of the fabric of the UK culture. • 2. Effectiveness of Presentation Center, and Faculty Fellows • 3. University support and campus acceptance (PR efforts)

15. Topic Development 1. Background information regarding institutional assessment of student learning and learning outcomes by Dr. Roger Sugarman, Director of Institutional Research (Appendix A-1), and by Dr. Marsha Watson, Director of University Assessment (Appendix A-2). These efforts helped the team to understand the current status of student learning at UK.

16. Topic Development • 2. Inform the campus and solicit “Big Ideas”. Goal was to: • educate the campus about the QEP, • generate excitement, and • request input via the QEP website (Big Ideas)

17. Topic Development • Data Collectors and Assessors gathered input from students, faculty, staff, parents, alumni, community members, and summarized data from sources across campus. • Sources: Sugarman and Watson reports; “Big Ideas” submitted, unit reports, program reviews, news media, student testimonials, SACS reports

18. Topic Development Step 4) Data Mining at the Retreat. During a two-day retreat (June 10-11, 2010), members of the TST examined all six sources of evidence described above. TST members formed small groups and each group examined one set of the aforementioned documents to discover emergent themes. The group capitalized on the expertise of one group member (Dr. Jane Jensen, Education) who held a training session with team members on how to conduct a qualitative thematic analysis to identify emergent themes. From her tutorial session, the group learned a systematic way to analyze qualitative data through the use of a rubric that identifies themes based on redundancy (quantity of occurrences) and intensity (passion/power in occurrences). Thus, the TST sub-committees used this rubric to identify themes. Then, each sub-committee reported their findings to the larger group….. (then used a “concept-mapping approach”).

19. Topic Development 5. Post-hoc Validation. At a later date, the Topic Development Team (TDT) revisited how each theme was supported by university-level assessment data, i.e. each theme was re-examined measuring it against existing assessments such as the Graduating Student Survey, Alumni Survey, Wabash National Study, Campus Climate Survey, NSSE, CLA, CAAP, Unit Reports, and Retention Data Reports.

20. B&E Pilot Project The course, CIS 300 (Strategic Business and Professional Communication), focuses on developing MCXC skills in upper division students majoring in accounting, analytics, economics, finance, marketing, or management. Assessment of CIS300 will inform the implementation of Presentation U. Qualtrics pre and post test; self report; measure of student confidence Random grading of selected written works; early versus late projects Assessment of student produced oral communication projects Assessment of student produced visual communication projects

21. B&E Pilot Project

23. QEP-IT (Implementation Team) Deanna Sellnow (Communication) Diane Snow (Medicine) Brandi Frisby (Communication) Karen Badger (Social Work) Janet Eldred (English/A&S and Engr) Scott Kelley (B&E) Ben Withers (Fine Arts/Honors) Mark O’Bryan (Design) Kathi Kern (CELT and Hist/A&S) Karin Lewis (The Study) Judy Pratts (The Writing Center) Roxanne Mountford (WRD) Kathryn Cunningham (Education) Morris Grubs (Graduate School)

24. Questions? Comments? Concerns? deanna.sellnow @uky.edu dsnow@uky.edu www.uky.edu/SACS