The Provider Gateway Self-teach tutorial for the Learner Achievement Tracker

1. The Provider GatewaySelf-teach tutorial for theLearner Achievement Tracker November 2006 Version 3.0 Approved The LSC in association with Ofsted and ALI welcome you to the self-teach tutorial for the Learner Achievement Tracker (LAT) service on the Provider Gateway. Click any key to proceed. If you have any queries, please email: Provider.Gateway@lsc.gov.uk

2. HOME – Will always take you to ‘Tutorial Contents’ Navigation How to Use the Buttons You can navigate your way through this tutorial by using the forward and backward buttons below or by clicking the mouse. Buttons which are coloured grey are inactive on the current slide, like the SECTION BACK button below. BACK TO START OF SECTION – Will take you to the ‘Section Contents’ of the current section BACK – Will take you back one screen FORWARD – Will take you forward one screen FORWARD TO START OF NEXT SECTION – Will take you to the ‘Section Contents’ of the next section

3. Aims and Objectives The aims of this tutorial are: • To introduce you to the LAT service on the Provider Gateway, including: • Who uses it and for what purpose. • What reports it generates. • How LAT guarantees the security of your information. • To teach you how to generate reports, including Summary Charts, National Comparison Graphs and National Chances Charts. • To teach you how to use the Prior Attainment Calculator. • To teach you how to download data.

4. Section 1 Overview of LAT 1 Tutorial Contents The tutorial is divided into nine sections. You can click on a section title on the list opposite to go directly to the start of the section. Each section starts with a Section Contents slide, from which you can link to specific topics. Section 2 Summary Charts 2 Section 3 National Comparison Graphs 3 Section 4 Ad Hoc Reports 4 Section 5 National Chances Charts 5 Section 6 Export, Refresh or Print a Report 6 Section 7 Prior Attainment Calculator 7 Section 8 Download reports & data 8 Section 9 How to get help 9

5. Section 1Overview of LAT • This section explains: • The purpose and benefits of the LAT to partners, providers and key stakeholders. • The VA/DT reports available through the LAT. • Who can use LAT to generate reports. • The Quality Improvement Pack. • How the security of information is ensured. You can work through the section sequentially, or use the links in the panel to the left to go to specific topics. Links to topics • The VA/DT reports • The LAT service on the Provider Gateway • Who can use the LAT? • Implementing measures of success handbook • Security of Information in LAT

6. Overview of LAT 1 The VA/DT reports The LSC provides Value Added (VA) and Distance Travelled (DT) data to show how much progress in qualifications individual learners have made, based upon their prior attainment compared to national results. VA/DT data are available as a suite of reports, including: • Summary Charts. • National Comparison Graphs. • National Chances Charts.

7. Overview of LAT 1 The LAT service on the Provider Gateway The LAT is a service on the Provider Gateway that provides access to VA/DT reports and VA/DT data. Release of the LAT service on the Gateway replaces the use of the OLDC portal for disseminating the reports. A national pilot of the LAT service began in March 2006. Providers can use the VA/DT reports generated by the LAT to make judgements about institutional performance.

8. Overview of LAT 1 Who can use the LAT? The LAT service can be used by: • Work-based learning (WBL) providers • Further education (FE) providers. • Schools with Sixth Forms. • Local Authorities. • National Office LSC. • Local LSCs. • Inspectorates (ALI and Ofsted).

9. Overview of LAT 1 Implementing measures of success handbook The LSC provides an Implementing measures of success handbook (to be published in December 2006) which includes: • Detailed information about Value Added (VA) and Distance Travelled (DT). • Qualification Success Rates. • Recognising and Recording Progress and Achievement (RARPA). • Information about how to interpret and apply the VA/DT reports for quality improvement. • Case studies. • Provider Gateway information. • Information about the Framework for Excellence.

10. Overview of LAT 1 Security of Information in the LAT • All information relating to a provider is held in strict confidence in the LAT. A provider cannot view a report relating to another provider. • Authorised staff, including (home-based) inspectors at Ofsted and the ALI, can search on all providers on the Gateway and generate reports pertaining to any provider. • Within the LSC, authorised staff can generate reports pertaining to any provider. • The LSC shall not be liable for any indirect or consequential loss, damage, injury or cost whatsoever.

11. Overview of LAT 1 End of Section 1 Overview of LAT

12. Section 2Summary Charts This section explains how to select and generate Summary Charts. You can work through the section sequentially, or use the links in the panel to the left to go to specific topics. Links to topics • How to select a Summary Chart • VA Reports • DT Reports

13. How to select a Summary Chart Summary Charts 2 • How to Create a Summary Chart • Summary Charts are created by selecting the Summary Charts Option from the Menu on the Left Hand Side of the screen. • The Menu is available on either the LAT Home screen (as shown) or from the same menu as offered on any of the other listed features. • To select Summary Charts: • Click on Summary Reports on the menu

14. How to select a Summary Chart (continued) Summary Charts 2 How to create a Summary report (continued) Use the Measure and Qualification drop down lists to select the values that you wish to include in your report. The values available for selection in the drop down lists vary from one provider to another depending on the courses offered by that particular provider.

15. How to select a Summary Chart (continued) Summary Charts 2 How to Create a VA Summary Report (continued) For a VA Summary report, select VA from the Measure drop down list In this example, the Measure Value has been set at VA and the Qualifications at All Qualifications. Click on the View Report Button to generate the report

16. How to select a Summary Chart (continued) Summary Charts 2 • The VA Report • The VA Report includes: • A Chart showing: • The header information for this report • The VA scores for each Qualification Type based against the national average scores • The number of Learners in each qualification • The upper and Lower Confidence Intervals for each qualification • Also ….

17. How to select a Summary Chart (continued) Summary Charts 2 • The VA Report (continued) • The VA Report also includes below the chart: • A Key for the Chart • A Data Table, showing each qualification and the values from which the Chart has been prepared.

18. How to select a Summary Chart (continued) Summary Charts 2 How to create a DT Summary Chart The DT- FE Report is prepared in the same way as for the VA Report, except that the Measure selection is DT- FE. Use the Measure and Qualification drop down lists to select the values for your report. As with the VA Report, the available options will vary from one provider to another depending on the courses offered by that particular provider

19. How to select a Summary Chart (continued) Summary Charts 2 The DT- FE Report (continued) In this example, the Measure Value is set at DT- FE and the Qualifications selected as All Qualifications. To generate the report click on the View Report Button

20. How to select a Summary Chart (continued) Summary Charts 2 • The DT- FE Report (continued) • The DT-FE Report includes: • A Chart showing: • The header information for this report • The DT scores for each Qualification Type based against the national average scores • The number of Learners in each qualification • The upper and Lower Confidence Intervals for each qualification • Also…

21. How to select a Summary Chart (continued) Summary Charts 2 • The DT- FE Report (continued) • The DT- FE Report also includes below the Chart: • A Key for the Chart and • A Data Table, showing the values from which the Chart has been prepared.

22. How to select a Summary Chart (continued) Summary Charts 2 The DT- WBL Report The DT- WBL Report is ordered in the same way as for the VA and DT-FE Reports, except that the Measure selection will be DT-WBL. Use the Measure and Qualification drop down lists to select the values for your report. Once again, The list of Measures and Qualifications presented for selection will vary from one provider to another depending on the courses offered by that particular provider.

23. How to select a Summary Chart (continued) Summary Charts 2 The DT- WBL Report (continued) With the Measure Value set at DT- WBL and the Qualifications selected as All Qualifications: To generate the report click on the View Report button

24. How to select a Summary Chart (continued) Summary Charts 2 • The DT- WBL Report (continued) • The DT- WBL Report includes: • A Chart showing: • The header information for this report • The DT scores for each Qualification Type based against the national average scores • The number of Learners in each qualification • The upper and Lower Confidence Intervals for each qualification • Also ….

25. How to select a Summary Chart (continued) Summary Charts 2 • The DT- WBL Report (continued) • The DT- WBL Report also includes below the Chart: • A Key for the Chart and • A Data Table, showing the values from which the Chart has been prepared.

26. Summary Charts 2 End of Section 2 Summary Charts

27. Section 3National Comparison Graphs This section explains how to select and generate National Comparison Graphs. You can work through the section sequentially, or use the links in the panel to the left to go to specific topics. Links to topics • How to generate a National Comparison Graph

28. How to generate a National Comparison Graph National Comparison Graphs 3 How to generate a National Comparison Graph When you log in to LAT, the LAT Home screen is displayed. • On the menu: • Click on “National Comparison Graph”

29. How to generate a National Comparison Graph (continued) National Comparison Graphs 3 How to generate a National Comparison Graph (continued) • Two options are offered for Graph generation: • Data based on a qualification offered by your organisation or • Data based on a qualification not offered by your organisation. • If the option for Data based on qualifications not offered by your organisation is chosen, then the Measure drop down list will be greyed out and not offered for selection, as shown in this example.

30. How to generate a National Comparison Graph (continued) National Comparison Graphs 3 How to generate a National Comparison Graph (continued) • If the option for Data based on Subjects offered by your organisation is chosen, then the Measures drop down list is available. • The Measure options available are: • DT – FE (Distance Travelled Further Education • DT- WBL (Distance Travelled Work Based Learning • VA (Value Added)

31. How to generate a National Comparison Graph (continued) National Comparison Graphs 3 How to generate a National Comparison Graph (continued) Use the available drop down lists to select your report criteria. In this first example, the Report Builder is set to “Subjects my organisation does not offer”. Qualification is set to AVCE (12 unit) and the Subject is set to Engineering (VQ) Click on the View Report button to produce your report.

32. How to generate a National Comparison Graph (continued) National Comparison Graphs 3 How to run a National Comparison Graph (continued) In this example, because the provider does not offer this subject in their curriculum, the graph will only display the National results. The top half of the screen (as displayed) provides the description of the data, the sample size and the source of the relative information for the graph. The graph is displayed, together with a key in the lower half of the screen… (continued)

33. How to generate a National Comparison Graph (continued) National Comparison Graphs 3 How to run a National Comparison Graph (continued) The graph displays only the National results as this provider does not offer the course selected. Where the subject is offered by the provider, the graph will display results showing the Provider results, Individual Male Learner results, Individual Female Learner results and the confidence intervals around the provider line.

34. How to generate a National Comparison Graph (continued) National Comparison Graphs 3 How to generate a National Comparison Graph (continued) In this example, Subjects offered by this organisation will be graphed. Click on the Radio Button to the left of “Subjects my organisation offers”

35. How to generate a National Comparison Graph (continued) Summary Charts 2 How to generate a National Comparison Graph (continued) In this example, subjects offered by this organisation will be graphed. Click on the radio button to the left of “Subjects my organisation offers” Measure of VA, Qualification of BTEC National Award and a Subject of Business Studies have been selected. Click on the View Report Button to run the report

36. How to generate a National Comparison Graph (continued) National Comparison Graphs 3 How to run a National Comparison Graph (continued) In this example, because the provider offers this subject in their curriculum, the graph will display a comparison between the results attained by the college against National results. The top half of the screen (as displayed) provides the Header Information for the chart.

37. How to generate a National Comparison Graph (continued) National Comparison Graphs 3 How to run a National Comparison Graph (continued) The chart is displayed showing results inside and outside the confidence intervals (shaded grey area) together with a Key to the chart. The diamonds and triangles display the results of individual learners. In this example, the providers average results are exactly matching those at National level, therefore the two lines appear as one . (Continued)…

38. How to generate a National Comparison Graph (continued) National Comparison Graphs 3 How to run a National Comparison Graph (continued) Below the chart is listed the results of each individual learner together with their prior attainment scores and VA score. As this example is taken from live data actual names have been distorted for privacy and security reasons Note that a provider user who runs a National Comparison Graph will see only the names of the individual learners taking the selected subject at their institution. Other users will not see the names of these individuals.

39. National Comparison Graphs 3 End of Section 3 National Comparison Graphs

40. Section 4Ad Hoc Reports This section explains how to select and generate ad hoc reports based on National Comparison Graphs. You can work through the section sequentially, or use the links in the panel to the left to go to specific topics. Links to topics • How to create Ad Hoc Reports • How to view Ad Hoc Reports

41. How to create Ad Hoc Reports Ad Hoc Reports 4 Creating Ad Hoc Reports Ad Hoc Reports are generated from within the National Comparison Graph facility. From either the LAT Home screen (As shown to the left) or from the menu offered in any of the other features: • Click on National Comparison Graphs

42. How to create Ad Hoc Reports (continued) Ad Hoc Reports 4 How to generate a Ad Hoc Report (continued) The example shown on the left hand side of the screen shows the selections for creating a National Comparison Graph. • ONLY when the Build Report From option is set to “Subjects my organisation offer” is the Ad Hoc Report Wizard is made available. • To activate the wizard: • Click on the next >>> button

43. How to create Ad Hoc Reports (continued) Ad Hoc Reports 4 How to generate a Ad Hoc Report (continued) An Ad Hoc Report is one made up from data based on selected learners. A List of all the learners from this college are included in the make up of this National Summary Report is provided with prior attainment scores and VA Scores. To select the learners for this Ad Hoc Report, Click in the Selection Box to the Left of the individuals name. (or use the Select All Box) Click on the Next >>> button to continue.

44. How to create Ad Hoc Reports (continued) Ad Hoc Reports 4 How to generate a Ad Hoc Report (continued) • Click in the Report Title Window and Enter a meaningful name for your report. • Click on the Next >>> button

45. How to create Ad Hoc Reports (continued) Ad Hoc Reports 4 How to generate a Ad Hoc Report (continued) To generate the Report, click on the Generate Report Button.

46. How to create Ad Hoc Reports (continued) Ad Hoc Reports 4 How to generate a Ad Hoc Report (continued) When the report is generated, a report success message is displayed.

47. How to View Ad Hoc Reports Ad Hoc Reports 4 How to View Ad Hoc Reports • To View the Report: • Click on Ad Hoc Reports from the menu on the left hand side of the screen.

48. How to View Ad Hoc Reports (continued) Ad Hoc Reports 4 How to View Ad Hoc Reports (continued) A list of completed reports is displayed. Click on the View Report button on any line to view a specific report in more detail. Use the > and >> icons in the bottom right hand corner of the list to scroll forward through the list. Single arrows (> or <) will scroll one screen, double arrows (>> or <<) will scroll to the first or last screen respectively.

49. How to View Ad Hoc Reports (continued) Ad Hoc Reports 4 How to View Hoc Reports (continued) When you have selected a report, the top half of the screen (as displayed) shows the header information for the chart. In this example, the header shows the number of learners selected for comparison with the national average, together with the numbers of learners included in the national results.

50. How to View Ad Hoc Reports (continued) Ad Hoc Reports 4 How to View Ad Hoc Reports (Continued) This chart shows ONLY results for the learners who were selected for comparison from within the learner list offered earlier in the process. The chart is displayed showing results inside and outside the confidence Intervals (shaded grey area) together with a key to the chart. The diamonds and triangles display the results of individual learners. In this example, the provider’s average results exactly match those at national level, therefore the two lines overlay each other and appear as one .