Implementing Outcome-Based Education – Where are We? Where are We Going?

1. Implementing Outcome-Based EducationWhere are We? Where are We Going?Angela HO, EDC21 November 2007

2. Implementing Outcome-Based Education –Where are We? Where are We Going? By the end of the session, you will be able to • Review the developments in OBE in PolyU and in your department / programme / subject with reference to a 4-stage model (an advanced preparation for the QAC Audit) • Identify gaps for further efforts in OBE in your department / programme / subject (could lead to proposals for OBA projects) NOTE: • This session is NOT intended to address ‘How to do it?’

3. OBA Funding 2007-08 • $10m for 2007-08 to be distributed by the “Working Group on Outcome-Based Education” • Call for Proposals in November 2007 • Deadline for application 31 January 2008 • Priorities of this round of funding • developing generic learning outcomes • Assessing programme outcomes • Aligning teaching & assessment with intended learning outcomes • Curriculum mapping • EDC will provide assistance in preparation of proposals

4. Essentials of outcome-based approach to student learning In your groups: • suggest words, phrases which are important for outcome-based approach to student learning

5. Outcome-Based Approach to student learning–Functions and Focuses Two main functions • (QE) Quality Enhancement • (QA) Quality Assurance Diversity of focuses • USA – Institution accreditation (Assessment) • Australia – Graduate Attributes • Bologna Process in Europe – Qualification Framework • Professional bodies, e.g. ABET – Programme Accreditation • PolyU – improvement of learning

6. Outcome-based approach to student learning:a 4-stage model Define intended learning outcomes Design curriculum, teaching, learning & assessment to support attainment of outcomes Mapping & Alignment Collect data on student attainment of outcomes Outcomes Assessment Use data to inform improvement of programmes

7. Implementing Outcome-Based Education Where are we?Where are we going?

8. How shall we proceed? • Use the 4-stage model as framework • Review milestones in implementing OBE in PolyU on • Accomplishments and setbacks/challenges • Engagement of staff • Small group: • Share experience from your department/ programme/subject • Brainstorm areas where further work needs to do done

9. Implementing OBE in PolyU - Milestones

10. Outcome-based approach to student learning:Stage 1 Define intended learning outcomes

11. Programme outcomes • Mostly well written, including • knowledge & professional competences • Attributes for all-roundedness • Aligned with PolyU role statement: ‘Developing all-round students with professional competence’

12. Common misalignments between subject outcomes and programme outcomes

13. Outcome-based approach to student learning:Stage 2: Define intended learning outcomes Design curriculum, teaching, learning & assessment to support attainment of outcomes Mapping & Alignment

14. Documentation in curriculum revision exercise • Description of major teaching & learning methods with justification that they are conducive to the attainment of intended subject outcomes • Description of major assessment methods with justification that they are suitable for assessing the intended subject outcomes

15. Implementation in the subjects –Aligning teaching & assessment with intended outcomes • Generic competence • Big challenge to integrating development of generic competence into academic subjects • Professional competence • Plenty of rooms for improvement • Big variations • Many good examples • Many ‘practice as usual’

16. Curriculum mapping Key: I = Introduced; R = Reinforced; A = Assessed • Programme leader’s effort ? OR • Programme team’s effort?

17. Outcome-based approach to student learning:4 essential elements Define intended learning outcomes Design curriculum, teaching, learning & assessment to support attainment of outcomes Alignment Collect data on student attainment of outcomes Outcomes Assessment

18. Outcomes assessment “Outcome assessment is not about examination” (M. Stone, General Secretary, UGC, speech presented in the PolyU OBE Symposium, 15 Dec 2005) “…the process of assembling broader evidence of programmeor institutional effectiveness that goes beyond the performance of individual students.” (Ewell, UGC Consultant on Student Learning Outcomes, 2006)

19. Programme outcome assessment methods • Capstone project / experience • Workplace assessment • Student portfolio assessment • Embedded assessment of programme outcomes within subject assessments • …

20. Programme outcome assessment • Quite a number of programmes have final year project (authentic, holistic assessment of overall outcomes for the programme) • Other than this – generally little development • Low level of ‘know-how’ across the University

21. Outcome-based approach to student learning:4 essential elements (PolyU’s model) Define intended learning outcomes Design curriculum, teaching, learning & assessment to support attainment of outcomes Mapping & Alignment Collect data on student attainment of outcomes (Outcomes Assessment) Use data to inform improvement of programmes

22. An outcome-based approach to QA • Articulation of intended learning outcomes and alignment as a major criterion for programme planning and validation • Student learning outcomes data as performance indicator in the QA report • DAA and DA explicitly review outcomes and alignment • ……

23. QAC audit methodology Adopts an outcome-based approach • What is the institution’s purpose? [Clear articulation of mission, objectives, intended student learning outcomes] • What does the institution do, and how, to achieve its purpose? [Alignment of plans, policies, procedures, programmes and activities with mission and objectives] • How does the institution measure achievements of its purpose and what evidence is there that the objectives are being met? [Appropriateness and adequacy of outcomes assessment methods, standard, evidence, external benchmarking] • What processes are in place for improvement? [Effectiveness in analysing and using the SLO data to effect improvement] Adopted from slide by Dr. KP Kwan

24. Proposal formulation support can be provided upon request Call us later!

25. Outcome-Based Education In-Kind Support Team

26. Functioning knowledge(Biggs) Functioning Knowledge Able to judge what knowledge / skills to apply Able to apply such knowledge / skills effectively Conditional Knowledge Academic Knowledge Procedural Knowledge

27. From knowledge to competence

28. Levels of Understanding“What do you mean by understanding in your subject?”