Employment Ontario Literacy and Basic Skills

1. Employment OntarioLiteracy and Basic Skills Performance Management Reports Training For Service Providers

2. Evaluations 2 Complete the first two pages and put them in the back of your participant guide. You will work with them at the end of each unit and at the end of the day.

3. Introductions 3 • Name • Position • Organization

4. Key Message 4 Today’s training supports the LBS third-party network to build capacity by way of report analysis and by improving the quality of the reports (data integrity).

5. Target Audience 5 Service Provider staff Especially those who collect data, or input data into CaMS, or perform report analysis and continuous improvement.

6. MTCU Expectations for 2014-15 and Beyond 6 • Achieve contracted commitments • Integrate continuous improvement • Collect quality site level data

7. Purpose of the Training 7 • Importance of data integrity • Business Intelligence • How data is used to evaluate site performance and make decisions • Importance of performing service delivery analysis

8. Unit 1 8 Performance Management System

9. Unit 1 Objectives 9 • Who is at the centre of LBS System • ‘Above and below the waterline’ • Performance Management System • What Business Intelligence Entails

10. Above and Below the Waterline 10

11. Components of a PMS 11

12. Continuous Improvement 12

13. Unit 1 Objectives Review 13 • Customer is at the centre of LBS System • Solid business foundation supports service delivery • PMS components and components of components • Business Intelligence: technology; business processes; people

14. Unit 2 14 LBS Program Services And Client Path

15. Unit 2 Objectives 15 • LBS Client Path • Service Quality Standard • Importance of data integrity • Where report data is input into CaMS

16. Client Path Diagram (top portion) 16

17. Service Quality Standard (SQS) 17

18. Core Measures Table 18 2

19. Service Quality Standard (SQS) Calculation 19 Perform Unit 2 - Exercise 2 ‘YTD All Participants - Actual’ X ‘Service Quality Weight’ X 10 (to the maximum SQS value allowed)

20. Exercise 2 Answers 20 Service Quality ‘Actual’ column value for: Customer Satisfaction:100% X 15% X 10 = 1.50 Service Coordination: 83% X 25% X 10 = 2.08 Suitability:26% X 20% X 10 = 0.52 Learner Progress:100% X 30% X 10 = 3.00 Learners Served:175% X 10% X 10 = 1.75 MAX 1.00 Overall SQS value = 8.10

21. Unit 2 Objectives Review 21 • Clients, linear flow through program • SQS supported by core measures • SQS calculation • Data integrity affects report data • Connect input to reports: • Table matched inputs to reports • Report user guides • Data Dictionary

22. Unit 3 22 Data Integrity

23. Unit 3 Objectives 23 • Definition of ‘data integrity’ • Business owners of the data • Importance of timely data collection • Management support of staff • Value of orderliness

24. What is Data Integrity? 24 • Includes: • collection of data • entry into EOIS-CaMS • paper documentation • Regarding each of the above: - complete, consistent, timely, and accurate

25. Business Owners of the Data 25 • Service providers as owners: • verification and integrity • value of data is only as good as the input • link cause and effect

26. Two Groups use the Data of the PMS 26 • MTCU • Service providers

27. Data Collection 27 • Service providers: • collect and report data (EOIS-CaMS) • maintain quality assurance systems • support data with documentation • MTCU and service providers: • analyse data

28. Orderliness 28 Consistent and clear processes = Resources used efficiently

29. Unit 3, Exercise 1‘Four Unusual Numbers’ 29

30. Unit 3 Objectives Review 30 • Data Integrity: complete, consistent, timely, accurate data collection and entry into CaMS • Service providers are business owners of site data (collect quality data) • Timely data collection supports evidence-based decision-making • Staff: collect and enter data (CaMS) • Management: stress data integrity • Orderliness increases efficiency & quality

31. Unit 4 31 Report Analysis

32. Unit 4 Objectives 32 • Reports available • Analyse LBS data • What drives continuous improvement • Support of staff: report analysis and continuous improvement

33. Learners Served – Pro-Rated Denominator 33 ‘YTD All Participants – Actual’ for Learners Served Performance Commitment Annual Target = 105 YTD All Participants – Numerator = 65 Months in the report dated December 31 = 9 months Annual Target - Pro-Rated: 105 X (9/12) = 7965 / 79 = 82%

34. Learners Served – Pro-Rated Denominator (1) 34

35. Learners Served – Pro-Rated Denominator (2) 35

36. Continuous Improvement (2) 36

37. Client Path Diagram (re-visited) 37

38. Report 61 SORTED by: 1. Program Status; 2. Program Duration 38

39. Report 61 SORTED by:Program Status 39

40. Report 61 SORTED by:1. Program Status; 2. Referred In 40

41. Report 61 SORTED by:1. Program Status; 2. Goal Path 41

42. YTD All Participants Actuals 42 Report 64 DSQR Calc 1 - Excluding ‘3. Suitability’ and ‘5. Learners Served’:  YTD All Participants Num / YTD All Participants Den Calc 2 - ‘3. Suitability’: YTD All Participants Num / YTD All Participants Den / 10 Calc 3 - ‘5. Learners Served’: YTD All Participants Num / Perf Com Ann. Target (pro-rated YTD)

43. ‘% YTD of Target’ Calculation 43 Report 64 DSQR YTD All Participants Actual / Performance Commitment Annual Target

44. Continuous Improvement (3) 44

45. Unit 4 Objectives Review 45 • ‘Reports Available’ section • Report analysis: • Calculations; Report 61; exercises • Continuous improvement: • Accurate reports • Understand results • Support of staff: • Participant Guide; user guides, Data Dictionary

46. Summary 46 Training Summary Evaluation Exercise

47. End 47