270 likes | 358 Views
Enhancing the First Year Student Experience at MMU: Clearing a path & interpreting digital footprints. Professor Mark Stubbs Head of Learning & Research Technologies http ://twitter.com/thestubbs http://slideshare.net/markstubbs. Nottingham | Jun 2014 #EFYE2014.
E N D
Enhancing the First Year Student Experience at MMU:Clearing a path & interpreting digital footprints Professor Mark Stubbs Head of Learning & Research Technologieshttp://twitter.com/thestubbs http://slideshare.net/markstubbs Nottingham | Jun 2014#EFYE2014
Context | An interesting place to work! • Large, popular, multi-campus university • 36,000+ students | 1,000+ courses | consolidating from 7 sites • Pursuing an ambitious transformation initiative • New Buildings, New Curriculum, New Admin Processes & Systems, New Learning & Mobile Tech, New Quality Processes… • 80%+ of 8,125 11/12 UG intake young from state schools / colleges
Context | Strategic improvement imperative A League tablerankings Marketing & RecruitmentProcesses Reputation C B Learning, Teaching, Assessment & Personal DevelopmentProcesses, Facilities & Resources Student RetentionSuccess & Satisfaction Student Intake (Aspirations, Attitude& Abilities) Resource allocation • 2010 NSS Where to intervene? All Year Numbers A C B Inform decision-makers Recruit to target Improve satisfaction, retention & success
CSI | Student Experience Careful diagnosis of (diverse) learning experiences • Recurrent messages • NSS analysis: course organisation determines Q22 • Mobile surveys: deadlines, timetables… (m-admin) • Focus groups: consistent, easy to find info • Great (and not-so great) expectations • “engaging, well-organised courses” • “inspirational tutors who know me” • Stimulating pedagogies • ‘Hygiene factors’
CSI | Student Retention & Success Improve satisfaction, retention & success B LiteratureJourneysWed 9, N31 Assumptions1styears have requisite motivation, academic ability, adaptive capacity and resilience to a) Sort / £ / // / so they can focus b) Adapt study methods to new academic requirements c) Perform to required standard d) Establish supportive social / working relationships InterventionsR&A / pre-entry, personalised info, early formative feedback Review literature… + Multi-dimensional + Belonging + Habitus + Polishing + … Reflect on… + Assumptions + Interventions Examine data…+ Focus Groups+ Surveys+ Journey journals + Observations+ National data
Coordinating our response Improve satisfaction, retention & success B Simplify UnwieldyCurriculum GreatOnline Experience(Seamless, personalised) GreatLearning Spaces GreatTeaching EQAL £350M
EQAL In the current climate • New Curriculum • designing new units, … • A coordinated strike for step-change improvement but • New Admin Systems & Processes • personal timetabling, … Diminishing unit of resource • Programme Board chaired by DVC Student Experience but but • New Virtual Learning Environment • Moodle & myMMU web/mobile, Talis Aspire… Everything depends on everything else • New QA & QE Processes • facilitating curriculum transformation but but We are large and risk averse
MISSION: 2010 Q1: Plan Programme & Projects 2010 Q2: Approve UG curriculum rules 2010 Q3: Develop smart curriculum capture forms 2010 Q4: Enter 800+ new L3 + L4 module 2011 Q1: Approve new modules 2011 Q2: Set up SRS, TT & VLE2011 Q3: L4 curriculum & systems go live2011 Q4: Enter new L5 modules… 2012 Q3: L5 goes live2013 Q3: Entire new UG curriculum live
Smart forms 868L3+L4modules Minimise ‘big ask’ Jul 2010
Core+ VLE blueprint m enrolments deadlines, marks sso links resource lists timetable past exams, digitizations Feb 2011
This work is licensed under a Attribution-NonCommercial-ShareAlike 2.0 licence Wrapping the institution around the learner Student ID Timetable • Sync to personal device
Pre-entry access to timetables • Less early access than expected
This work is licensed under a Attribution-NonCommercial-ShareAlike 2.0 licence Wrapping the institution around the learner Student ID (+ Unit code) Deadlines / extensions / feedback return dates / provisional marks Personalised submission sheet
This work is licensed under a Attribution-NonCommercial-ShareAlike 2.0 licence Wrapping the institution around the learner Unit code Resource list Relevant resource
This work is licensed under a Attribution-NonCommercial-ShareAlike 2.0 licence Wrapping the institution around the learner Unit code • 11,000+ past exams uploaded Past exam papers Past exam paper
MyMMU App m-admin
Summary| we cleared a path to the information our learners needed…
Are we in a better place now? • EQAL wins inaugural Guardian Student Experience Award! • 10,000+ students post 40,000+ comments in our biannual student surveys • Submission tracking, Personal timetables, … • Quartile improvements in course org & learning resources in 2012 NSS • 30,000 regular users, 52m+ hits on Moodle, 26,000+ App registrations!
Using the data Refining understanding of a problem space
Understanding student satisfaction Satisfaction predictors ↗ Confidence ↘ Organisation →Teaching Student demographics Entry profiles Internal survey responses Refining understanding of student satisfaction Sum entry points & qual type Random Forests analysis Handle missing values, collapse categories… Join on student ID
Understanding student success Predictors YNG NSSEC4-7Entry TariffNSS HESA PI League Tables Refining understanding of student continuation Add UKPRN Random Forests Regression Tree Handle missing values, collapse categories… Join on UK PRN
Conditional Inference Trees Party Library
Limitations • Confirmation bias • Meaningful comparison • Quantitative V Qualitative • Data quality • Correlation ≠ causation • “Everything that can be counted does not necessarily count; everything that counts cannot necessarily be counted”Einstein Reality of our current data warehouse build: careful thought about error handling + painstaking checking of joins!
C Continuous monitoring & improvement MDL SRS TT Data Warehouse Analysis Cubes • CMI dashboard for all programme leaders for Sep 2014
Change management lessons • Understand important dynamics • Be clear what needs to be done • Set high-level goals • Understand where change is required • Be bold and plan holistically • Ensure you’ve got the right team to drive • Make ‘big asks’ as small as possible • Make it stick with reinforcing change • Find out more! Curriculum Design http://tinyurl.com/jiscmmusrc Assessment & Feedback http://tinyurl.com/jiscmmutraffic