Impact after REF: Issues and Opportunities

1. Impact after REF: Issues and Opportunities Chris Hewson School of Environment, Education and Development / School of Social Sciences University of Manchester

2. Overview • Models & Definitions (REF, ESRC, etc.) • Lessons from REF • Embedding Impact • Supporting Impact • Questions

3. Impact Model: Payback The logic model of the Payback Framework Hanney et al (2004)

4. Impact Model: SIAMPI Social Impact Assessment Methods through Productive Interactions (EU-FP7 2010)

5. Impact Model: RCUK Pathways to Impact: RCUK (2009-)

6. Impact Definition: ESRC • Academic impact is the demonstrable contribution that excellent social and economic research makes to scientific advances, across and within disciplines, including significant advances in understanding, method, theory and application. • Economic and societal impact is the demonstrable contribution that excellent social and economic research makes to society and the economy, of benefit to individuals, organisations and nations.

7. Impact Definition: ESRC • Instrumental: influencing the development of policy, practice or service provision, shaping legislation, altering behaviour • Conceptual: contributing to the understanding of policy issues, reframing debates • Capacity building: through technical and personal skill development.

8. Impact Model: REF Why the REF Impact Case Studies are so difficult to write (especially in the social sciences and humanities) Dunleavy (2012)

9. Impact Model: REF Dunleavy (2012)

10. Impact Definition: REF (Panel C) • “The main panel acknowledges that impact within its remit may take many formsand occur in a wide range of spheres. These may include (but are not restricted to): creativity, culture and society; the economy, commerce or organisations; the environment; health and welfare; practitioners and professional services; public policy, law and services.” • “The categories used to define spheres of impact… inevitably overlap and should not be taken as restrictive. Case studies may describe impacts which have affected more than one sphere.”

11. Impact Definition: REF (Panel D)

12. Rules: REF • Counterfactual? • “‘Underpinned by’ means that the research made a distinct and material contributionto the impact taking place, such that the impact would not have occurred or would have been significantly reduced without the contribution of that research.” • Disinterment? • “Each case study must explain how (through what means) the research led to or contributed to the impact, and include appropriate sources of information external to the HEI to corroborate these claims.”

13. Evidence: REF (Panels C & D)

14. 56 Indicators? Holbrook, Barr & Brown (2013)

15. REF: 6 Lessons • Dissemination/pathways alone are not impact • Difficult to tie impact to specific research • Some impacts are direct, others mediated • Impact is flexible – based on reach and significance, alongside a clear evidence trail • New models of social engagement and measurement may be required • Corroboration is the glue, not the icing

16. Embedding Impact • Mapping relationships with stakeholders • Reviewing traditional models of dissemination • Charting subsidiary impacts through ongoing dialogue • Balancing reach and significance • Critiquing the relationship between research quality and impact • Assessing support requirements • Discipline specificity • Assistance with bids • Capturing data

17. Supporting Impact • DALevel • School Level • Faculty Level • University Level

18. Contact Chris Hewson chris.hewson@manchester.ac.uk Twitter: c_d_hewson