UKCAT Future Developments (Research)

1. UKCAT Future Developments (Research) Research Panel Jon Dowell, John Mclachlan, Paul Dennis, Rachel Greatrix

2. Objectives • Inform about basis of access • Wet appetite with UKCAT WP related data • Produce discussion about potential WP research • Inform UKCAT re likely data requirements • Generate interest to propose studies. UKCAT Research Panel

3. Task • Introductions - who and why here? • In groups of about 4 – discuss what WP related research you’d like to be able to do (Post its) UKCAT Research Panel

4. History Key objective since outset which stumbled over • Concerns regarding the need for consent • Technical issues with data formats • Possibly also ‘academic undercurrents’ Outcome was that few schools agreed to provide progress data and not clear what could legitimately be done with it. UKCAT Research Panel

5. Core Principles Can proceed without individual consent provided • Data / identities adequately protected • Work in ‘legitimate interests’ of UKCAT Requires ‘buy in’ from universities Access open to contributing universities Eager to support worthwhile work whatever the outcome UKCAT Research Panel

6. Research Strategy Establish • Progress data collection • More structured data management Four core themes • Predictive validity • Widening participation • Non-cognitive attributes • Open call (including bespoke additional data) UKCAT Research Panel

7. Progress • Process redesigned with legal guidance • University agreements coming in re progress data(12/26) • Data collection details being clarified and discussed on individual basis • Data exchanges with Pearson VUE and UCAS now OK • Data ‘management’ via Paul Dennis, Oxford • Data collected from the first four cohorts who took the test in the 2006 – 2009 application rounds. • 2006-2008 will have ‘full’ UCAS data available • Research ‘contract’ drafted • Timetable for ‘calls’ • WP – mid 2010 • Predictive validity Late 2010 • Support – up to 10K/study UKCAT Research Panel

8. Basic UCAS matching UKCAT Research Panel

9. WP Data overview

10. Distribution (%) by NS-SEC (Both parents declared) UKCAT Research Panel

11. Single-parent families UKCAT Research Panel

12. Combined data (%) UKCAT Research Panel

13. 6 year courses (WP?) UKCAT Research Panel

14. Broader data overview Current • NS-SES (74%), UCAS SES (65%), Postcode, school code • UCAS - Uni choices, A level, degree, Highers • UKCAT cognitive data (subscales/Total) Anticipated • Confirmed entry (from 2007) • Progress and performance data each year UKCAT Research Panel

15. UKCAT WP Research • What studies would be worth doing with this resource? • Now? (Post its) • Future? (Post its) UKCAT Research Panel

16. UKCAT WP Research • Choose one study • What data would you require to do it? (Post its) UKCAT Research Panel

17. The ‘rules’ • All research must be performed ‘on behalf of UKCAT’ (a DPA requirement) • Under ‘contract’ to and in ‘legitimate interests’ of UKCAT • Individual identity protected by data provider, analyst and Board • Schools identity ‘respected’ • Data security ensured • All with access to data required to sign ‘contract’ to this effect. • Funding could cover incidental research costs, materials, data transfer, security and analysis (including any statistical consultancy required) and travel and subsistence. • UKCAT is a charity and is not able to fund ‘full economic costing’ or provide university overheads. UKCAT Research Panel

18. Conclusion UKCAT research strategy has been delayed but is back on track – live in July is target for first call, re WP. The quality of whole resource depends on widespread participation, which requires careful management. There is potential for a wide range of studies. (But ensure your university is going to provide performance data) We anticipate being able to fund reasonable costs for work we are commissioning. UKCAT Research Panel