Access to skills – Interim Report 30/05/2012

1. Access to skills – Interim Report 30/05/2012 ASC Training & Development

2. Collaborative e-Assessment • Project Manager: Tony Stone (ASC Training & Development) • Project Team: Tony Stone • Melanie Worrall (Efficacy Consulting) • Peter Oborn (ASC Training & Development) • Meredith Dufty (Pharmacy Guild SA) ASC Training & Development

3. overview • This project explores the role of peer assessment in determining a candidate’s competency in the context of nationally recognised training. • Unit of study: • BSBWOR402A Promote team effectiveness ASC Training & Development

4. Background • The use of peer evaluation in VET meets road blocks when applied to summative (final) assessment decisions… due in part to: • ASQA requirement in relation to assessor qualifications • Potential reluctance of course participants to make negative judgements on peers • The need for rigorous processes that ensure integrity of the assessment decision – makes it too hard? • Evidence guide requirements ASC Training & Development

5. Project Methodology • A target group of 11 Pharmacists were recruited with the assistance of the Pharmacy Guild (SA) to undertake the learning program ASC Training & Development

6. Project Methodology • A blended learning approach combining: • 1 full day F2F workshop • Online activities including • Discussion Forums (with uploading of documents) • Team Survey • Assessment tasks, one involving Peer Assessment using Moodle Workshop ASC Training & Development

7. Peer Assessment Activity • Team Improvement Project • Participants complete a Team Climate Survey online (Self and work team) • Identify area for improvement and develop Action Plan • Upload Action Plan in Moodle Workshop 1 • Peers in Learner Group review and post comment, based on agreed criteria ASC Training & Development

8. Peer Assessment Activity Team Improvement Project (Continued) • Projects implemented in workplaces • Project outcomes report posted (Moodle Workshop 2) • Final peer assessment against agreed criteria • Personal learnings posted in Forum • Assessor panel validation ASC Training & Development

9. Project Outcomes to Date • Design and trial of an online assessment methodology that enables peer assessment to contribute to a valid summative assessment decision • Enhanced employability of participants in leadership roles • Development of skills in participants and RTO personnel in online learning and assessment methodologies • Improved work environment/team effectiveness in host pharmacies ASC Training & Development

10. Timeline of events to date • Pharmacy Guild advertised opportunity to participate in pilot to members in December 2011 • ASC T&D held an information session for interested persons in early February 2012 • The next 9 slides are an edited version of this information session... ASC Training & Development

11. Welcome to A Unique Learning Opportunity... • You have been invited by the Pharmacy Guild SA to participate in a unique project funded through the national VET E-Learning Strategy , an initiative of the Commonwealth Government. Pharmacy Information Session – 7 February 2012 ASC Training & Development

12. Our Project: Collaborative E-Assessment • The project involves 3 levels of learning: 1. Team Development Skills 3. Peer Assessment 2. Using Online Technology Pharmacy Information Session – 7 February 2012 ASC Training & Development

13. 1. Team development Skills • The project will explore ways to work effectively with a work team in the retail pharmacy environment • The content is based on a unit of competency from the Business Services Training Package: BSBWOR402A Promote team effectiveness • This is a unit from the qualification Certificate IV in Frontline Management Pharmacy Information Session – 7 February 2012

14. 2. Using Online Technology We use an online platform called Moodle. Moodle is used by many schools and universities in Australia and globally. Pharmacy Information Session – 7 February 2012 ASC Training & Development

15. ASC Training & Development

16. Online tools Once logged into our Moodle site, you can participate in: • Discussion forums • Online activities relating to building effective teams • Moodle Workshop (a module to review each others work) • Document upload (reports, reflections, evaluations) We will guide you through all these activities Pharmacy Information Session – 7 February 2012 ASC Training & Development

17. 3. Peer Assessment • In formal education learning is assessed through tests, projects, assignments, etc. • The teacher or lecturer marks the work, making the final decision • Assessment of work by fellow classmates or participants is rarely used to make the ‘final decision’. Pharmacy Information Session – 7 February 2012 ASC Training & Development

18. Peer Assessment • This project will guide you through the steps to make judgements on the work of your colleagues • Your judgements combined with a review by a panel of assessors from the Project Team and the Pharmacy Guild will form the final assessment decision • All participants assessed as competent will receive a nationally recognised Statement of Attainment Pharmacy Information Session – 7 February 2012 ASC Training & Development

19. Timeline of events to date (Continued) • Enrolments closed early March; 11 participants signed up • First online contact made to provide Moodle log in so participants could explore the site • Participants directed to Team Climate Survey (Google Docs) link and asked to complete themselves and have team members complete as well ASC Training & Development

21. Timeline of events to date (Continued) • Second online contact made to introduce learners to Discussion Forum • Hi everyone. For this first forum topic, we would like you to write down 3 aspects of leading a team that you find challenging. keep answers brief; you can just list as dot points. • 20 March 2012 ASC Training & Development

22. Timeline of events to date (Continued) ASC Training & Development

23. Timeline of events to date (Continued) • Face-Face workshop held 23 March • Teleconference for 2 participants based in Gawler and Normanville • Participants encouraged to continue responding to new discussion topics as they are posted, and to create their own discussion forums ASC Training & Development

24. Timeline of events to date (Continued) • Participants select Team Improvement Project based on survey results and develop Action Plan • Action Plans uploaded to Moodle Workshop 1 • Learner Groups set up for peer comment on Action Plans (3 per Learner Group) ASC Training & Development

28. Timeline of events to date (Continued) • Implementation of Team Improvement Projects in each participant’s pharmacy • Participants write Final Report and upload in Moodle Workshop 2 • Peers in Learner Group assess Reports using assessment criteria provided by ASC T&D • Peer assessment results reviewed by ASC assessors and Pharmacy Guild assessor. As at 30/05 ASC Training & Development

29. Challenges to Date • Attracting participants and keeping them motivated and on task • The group has reduced from 11 to 7 owing to: • 2 withdrew citing work pressure • 2 have moved pharmacy • Wide range of computer literacy amongst learners ASC Training & Development

30. Challenges to Date • Technology glitches – e.g. Issues with iPad • Moodle Workshop ‘switching’ from one phase to the next, e.g. From Submission to Assessment Phase • All participants must complete previous phase • Facilitators need to keep encouraging laggers to upload work. ASC Training & Development

31. Benefits to Date • Discussion Forums a big hit with participants – evidence of sharing of documents; some participants initiated discussion forums • Learners having a sense of connection with each other despite no other F2F after March 23 workshop • Formative assessment (comments on peer’s Action Plans) helped learners understand their own Action Plan strengths/deficits • Clarification of assessment criteria by virtue of being an ‘assessor’ ASC Training & Development

32. Benefits to Date • Participants report noticeable results of team projects • Improved team morale • Increased productivity • Sales increase • Confidence as leaders • Praise from managers ASC Training & Development