Achieving Quality and Scale in Online Education through Transformative Assessment

1. University of Massachusetts Lowell Continuing Studies and Corporate Education Achieving Quality and Scale in Online Education through Transformative Assessment Jacquie Moloney, Dean CSCE UMass Lowell Steven F. Tello Assoc. Director of Distance Learning CSCE UMass Lowell

2. University of Massachusetts Lowell Continuing Studies and Corporate Education Introduction: • Purpose of the Case Study • Literature and Conceptual Framework • Evolution of Transformative Assessment at UML • Summary

3. University of Massachusetts Lowell Continuing Studies and Corporate Education Purpose of the Case Study • Illustrate the transformative assessment process for online education • Demonstrate how that process can help programs or institutions to achieve quality & scale • Identify opportunities for transforming mainstream education through assessment of online education • Outline future challenges & opportunities with transformative assessment and online education

4. University of Massachusetts Lowell Continuing Studies and Corporate Education Literature & Conceptual Framework • AAHE Assessment Forum and Others • Reflects institutional mission • Assessment is planned and iterative • Engages multiple constituents • Applications of assessment lead to improved learning • Assessment leads to institutional transformation • North Central Assoc. of Schools and Colleges • Transformative Assessment Project • Sloan Pillars

5. University of Massachusetts Lowell Continuing Studies and Corporate Education

6. University of Massachusetts Lowell Continuing Studies and Corporate Education BACKGROUND: UML ONLINE PROGRAM • Launched in 1996 as a pilot • Part of Plan to Expand Continuing Studies • Potential Innovation and Revenue • Largest Online in New England • 6,400 enrollments annually • Award winning programs

7. University of Massachusetts Lowell Continuing Studies and Corporate Education ADMINSTRATIVE STAGE ASSESSMENT • Purpose: Establish Feasibility • Data Collection and Data Process • Rudimentary • Application of Findings • Access • Technology • Programs • Learning Effectiveness • NSD • Need for faculty involvement • Cost Effectiveness

8. University of Massachusetts Lowell Continuing Studies and Corporate Education

9. University of Massachusetts Lowell Continuing Studies and Corporate Education PROGRESSIVE STAGE • Purpose: Quality and Scalability • Data Collection and Process • More inclusive ->New Questions • Automated • Feedback to Faculty & Program • Findings • Access • Degrees & Student Service • Learning Effectiveness • High Expectations & Interaction • Cost Effectiveness (ROI)

10. University of Massachusetts Lowell Continuing Studies and Corporate Education Student Learning and Satisfaction at Course and Program Level

11. University of Massachusetts Lowell Continuing Studies and Corporate Education BUDGET-BASED ACADEMIC PLANNING

12. University of Massachusetts Lowell Continuing Studies and Corporate Education TRANSFORMATIVE STAGE • Purpose: Institutional transformation through continuous improvement • Collection and Process • Public, widespread involvement, more integrated • Findings • Access • Carryover to face to face • Graduate, Accelerated • Learning Effectiveness • Outcomes based programs • Syllabus Redesign • Online Teaching Institute • Cost Effectiveness • Convert large lectures

13. University of Massachusetts Lowell Continuing Studies and Corporate Education SUMMARY • Online Education Meets Rigorous Assessment • Framework provides useful Rubric • Wealth of data, ideas and studies • Focusing on student learning at course, program and institutional level