The Good, the Bad and the Ugly : Descriptors, SED and OfSTED Review of Grades

1. The Good, the Bad and the Ugly: Descriptors, SED and OfSTED Review of Grades Andy Connell & Kevin Mattinson, Keele University

2. Aims of Discussion • To share with colleagues the impact of in-house grade descriptors and exemplification materials • To explore how the documents support self-evaluation and inspection • To discuss the challenges of a data-driven SED process • To discuss how descriptors and associated materials might develop and support C Standards, CPD, MTL

3. Impact of Grade Descriptors and Exemplification Materials (12 months on) • Background • Analysis of impact • Conclusions

4. Background • New Q standards • Existing descriptors not ‘fully fit for purpose’ • The vision of excellence • Training and development need • No TDA guidance at the time of development • Subject Professional Support Activity (ITTE)

5. Impact • ½ way through year • Research identified that the documentation was impacting positively on practice, but that further development of stakeholders was required to improve consistency of engagement. • It also noted some differences in practice between Professional (Senior) Tutors in schools and Subject Mentors.

6. Key findings (April 2008) • Trainees found descriptors helpful formatively • Trainees used descriptors and exemplification documents to arrive at judgements about evidence and achievement and to determine actions • The level descriptors were valuable in informing and framing the dialogue between the trainees and mentors in school; • Trainees more readily used Keele University exemplification material than that provided by the TDA. • .

7. Key findings (April 2008) • The majority of subject mentors used the exemplification material in their work with the trainees, to help set targets, to arrive at judgement at summative review points and to inform decisions about the appropriateness of evidence against the standards; • There was some variability across mentors in practice, with a minority not fully engaging with the descriptors or exemplification materials;

8. End of year (Summer 2008) • The evidence was that the majority of Professional Tutors used the descriptors successfully in a number of ways and for a number of purposes, including: • to inform dialogue with an Associate Teacher, providing a language for review and target setting; • to support the moderation of practice across all Subject Mentors, validating the work of the mentors; • to challenge trainees to review their own progress; • to review progress at summative points; • to inform the process of completing the Career Entry Development Profile (CEDP); • to support the completion of the end of placement report.

9. End of year (Summer 2008) • Descriptors used more than each of the sets of exemplification materials • Keele exemplification material used more extensively than TDA materials

10. End of year (Summer 2008) • Subject Mentors indicated that that they found the Level Descriptors particularly valuable: • in setting points for discussions in weekly review meetings; • in providing a language for commentary on a lesson observation; • in support the feedback process after a lesson observation; • to highlight areas where action is required; • in supporting trainees in self-review; • in moderating judgement across subject staff involved in observation; • in informing professional dialogue with other teachers involved in training, to establish a common framework of understanding and expectations.

11. Conclusions • The new documentation that has been developed at the University did promote the improvements in practice we set out to achieve. • The challenge to the institution was to continue to evaluate practice and impact more extensively and to revisit the training and development of school based mentors to bring about higher and more consistent levels of use. • To this end, a detailed survey of all trainee teachers was undertaken and the outcomes of this survey have formed the basis of ongoing research • Ongoing improvement in engagement with descriptors • Growing effectiveness in self evaluation by trainees • Some variability in practice in respect of the use of support materials to justify and exemplify levelled performance • Continued improvement in target setting using the support materials

12. Developments 2008/9 • A particular focus for development has been the use of the documents and training materials for formative assessment of trainee progress and the setting of development targets. • As we aligned our practice to ensure that we met the demands of the new Ofsted Inspection framework and the TDA’s SED (Self-Evaluation Document) process, this had a major influence in a decision to revise the descriptors.

13. SEFs and SEDs and the Review of Grades • How does Keele documentation support the SEF and SED processes? • SEF and SED and Review are very data driven • Tracking of trainee performance against targets is seen as a key part of these processes (trends) • The effectiveness of the descriptors gives us confidence that our data on trainee performance is accurate in terms of attainment and achievement

14. Keeping SEFs • Review of Grades • Identification of grade profiles over a 3 year cycle • Changes in levels with the move from QTT to Q • No ‘grading’ – best fit model • The challenge of matching with OfSTED • Confidence and justification • The use of Ofsted descriptors within inspection framework by subjects (English)

15. Review of Grades – Grade profiles (English)

16. Review of Grades – Grade profiles (English)

17. Supporting changes in the future • Planned changes to Descriptors • Use to support CEDP process

18. DISCUSSION • To consider the challenges of a data-driven SED process • To consider how descriptors and associated materials might develop and support C Standards, CPD/PPD, MTL • Standards/Competences and the European Dimension

19. Andy Connell PGCE Director Keele University Chancellor’s Building Keele Staffordshire ST5 5BG Email: a.j.connell@ educ.keele.ac.uk Tel: 01782 733358 Kevin Mattinson Pro Vice-Chancellor and Head of Teacher Education Keele University Keele Staffordshire ST5 5BG Email: k.g.mattinson@vco.keele.ac.uk Tel: 01782 734354