90 likes | 164 Views
Evaluating the impact of researcher development – alumni case studies. Katharine D’Souza, University Graduate School 3rd July 2014. PGR Development Evaluation. UoB PGR Development Evaluation Strategy Skills development evaluation using Impact Framework:
E N D
Evaluating the impact of researcher development – alumni case studies Katharine D’Souza, University Graduate School 3rd July 2014
PGR Development Evaluation • UoB PGR Development Evaluation Strategy • Skills development evaluation using Impact Framework: • Levels 0 to 2 – records and feedback forms • Level 3 – follow up surveys, focus groups • Level 4 – how to prove?
PGR Leavers Case Study Project • Project specification to meet needs of UGS and others including Alumni, Careers, Admissions, Schools • Awareness of previous survey issues eg low response rate, inspired trial of new approach in terms of language used, etc
Identification of potential subjects • Review of attendees on skills development courses vs successful PGR leavers and other demographics • Cross match with alumni records to find current contact details • Development of new approach to pilot
First survey 27 emails sent August 2013 33% response rate – 9 surveys completed 5 agreed to be contacted for more information – 56% of survey respondents 78% of respondents said: ‘I developed transferable skills which have been of use beyond my research’ = Level 4 Outcome
Second survey • An email was subsequently sent to 802 PGR alumni with a link to survey included • 1% response rate – 11 surveys completed • 6 agreed to be contacted for more information – 54% of survey respondents • 86% of respondents who engaged with skills development said ‘I developed transferable skills which have been of use beyond my research’
Alumni case studies • Those who gave their contact details were interviewed • From this we developed case studies from 6 PGR alumni which included quotes such as: • “...don't assume that transferable skills are something that is just a bit lofty and out there and that you don't really need to pay attention to. In actual fact the information in these sessions has been something that I have used constantly in my working life.”
Outcomes • 81% of survey respondents who had taken part in transferable skills training stated: ‘I developed transferable skills which have been of use beyond my research’ • Goes beyond feedback immediately after activities which generally finds satisfaction with the activity (Level 1: Reaction) & likelihood of behavioural change (Level 2: Learning).
The results of this project demonstrate the wider value of our work on and investment in skills development both for the quality of the PGR experience at the University of Birmingham and the influence this has on the careers of our alumni. For more information please contact Katharine D’Souza k.a.dsouza@bham.ac.uk