Quality Reviews and eLearning Roles and dialogue in assessments

1. Quality Reviews and eLearning Roles and dialogue in assessments Dr Carl Holmberg Secretary General International Council for Open and Distance Education (ICDE)

3. Stockholm, Sweden

5. Stockholm, Sweden

6. International Council for Open and Distance Education ICDE www.icde.org

7. International Council for Open and Distance Education (ICDE ) • Established in 1938, 72 years long history in the field of distance education • In formal consultative status with UNESCO • Cooperates with Southeast Asian Ministers of Education Organization (SEAMEO) Organization of American States (OAS) Regional and national associations (ABED, AAOU, EADTU, .. )

8. ) ICDE is the only global organisation in the field of open and distance education. Membership organisation for educational institutions that deliver distance education, web-based education and flexible learning.  Member supported organisation members pay fees member institutions furnish ICDE business bodies with high level personnel at their own cost projects and taskforces in cooperation with members  Supported by our host country - Norwegian Government contributes to the funding

9. 24th World Conference 2 – 5 Oct 2011 Nusa Dua Bali, Indonesia Hosted by UniversitasTerbuka

10. Key objectives for ICDE 2009-2012 • To be the global arena for the discussion of distance education policies • To promote quality in distance, flexible and ICT-based education • To contribute to the development of new methodologies and technologies • To foster co-operation between members

11. The quality concept • Ouality • is something we create • varies over time • is always present (ubiquitous) • is public

12. The quality concept Hand grenade Nut and screw Medical treatment Today’s pasta Lecture Course Art piece

13. The quality concept Hand grenade Not OK/OK Nut and screw Not OK/OK Medical treatment “More or less OK and it feels good” Today’s pasta Bad taste – OK – Extremely good Lecture meeting the goals? content rich? pleasant? .... e-Learning programme ........ Art piece .......

15. Subjective Normal Extraordinary Objective

16. Subjective Normal Extraordinary Quality is something measurable and precise. List of necessary features (indicators) can describe quality Objective

17. Subjective Quality is unique (transcendent): Universally recognizable. something which is hard to define precisely but you can feel it when it is present, you can learn to identify it via experience Normal Extraordinary Quality is something measurable and precise: List (indicators) of necessary features can describe quality Objective

18. Improvement Three approaches to quality enhancement (Lemaitre, RIACES) Innovation

19. New Learning Culture

20. New Learning Culture

21. SELF DIRECTED LEARNERS Formal arena Informal arena Non-formal arena ILS Individual Learning Space

22. Learning centres support all forms of learning! Learning Centre Formal arena Informal arena Non-formal arena

23. Learningcentresembeddinglearning/elearning … Individual studyplans Validation Guidance Teachers Tutoring Technology support Active Leadership Work mates Study guides Stimulating learning environments Study mates

24. Learningcentresembeddinglearning/elearning … Academic support Social organisation support Individual studyplans Validation Guidance Teachers Tutoring Technology support Active Leadership Work mates Study guides Stimulating learning environments Study mates Emotional support

25. Quality reviews in the new scenario Quality Reviews Learning Centre Formal arena Informal arena Quality Reviews Non-formal arena

26. Perspectives on Quality • Based on objectives • Based on user opinions Quality from the user’s perspective. • Based on effects – expectations from society • Based on standards - Quality is conformance with certain specifications • Q lies in the processes/organisation • Value based Q in relation to reasonable cost. Does it provide performance to an acceptable price.

27. Perspectives on Quality • Objectives [Exogene and endogene, the interpretation] • User opinions[Who is the user, User opinions vary over time, Users are disagreeing, Users not having societal concerns] • Effects –[Timeperspective, expectations from society] • Based on standards - Quality is conformance with certain specifications • Processes/organisation [Internal, External] • Value based[Q in relation to reasonable cost. Does it provide performance to an acceptable price]

28. Assessing the systems • with • Judges • and/or • Peers

29. Roles

30. Roles • Most common mixed roles judges and peers. • It could be questioned if that is possible?

31. Case peers (ICDE example)

32. R O L E S

33. The CONTEXT matters a lot. Assessments of quality must relate to the framework of students and institutions (ICDE reviews in China, Indonesia, Australia, France; Under what circumstances are a programme/course studied, received, how is it embedded)

34. Quality reviews in the new scenario Quality Reviews Learning Centre Formal arena Informal arena Quality Reviews Non-formal arena Context

35. Thanks for listning International Council for Open and Distance Education (ICDE) Dr Carl Holmberg Secretary General www.icde.org holmberg@icde.org