160 likes | 300 Views
Formative Evaluation of the JISC SWaNI Programme Interim Report. Veronica Adamson Jane Plenderleith Glenaffric Ltd. Main Purpose.
E N D
Formative Evaluation of the JISC SWaNI ProgrammeInterim Report Veronica Adamson Jane Plenderleith Glenaffric Ltd
Main Purpose To contribute to the overall achievement of the programme which will maximise the long-term benefits to the sector and provide synergy with the MLE for Lifelong Learning Programme (01-01)
Objectives • To identify the project management activities and systems that are most effective in achieving project objectives • To explore factors influencing effective relationships with vendors and how these relationships may be sustained • To explore the models of consortium working used in the projects and evaluate their effectiveness • To identify and explore the organisational factors that are influential in determining the impact of project deliverables • To identify the aspects of programme management that most contribute to project activities • To investigate the overall impact and potential benefits of the SWaNI programme • To explore the extent to which cultural differences influence the achievements of the SWaNI programme • To establish the lessons that can be learned from the SWaNI programme with relevance to the MLEs for Lifelong Learning Programme and for future interoperability initiatives • To suggest themes, indicators and methods that may inform the summative evaluation of the SWaNI programme
The Process • Consultation with Project Managers (telephone interviews) • Attend SWaNI meetings • Identify initial issues of interest • History of the future exercise • Engage with MLE Evaluation Team (01-01) • Audioconference • Belfast Meeting • Documentary analysis • Interview/visit summary transcripts • Project reports etc • Related programme reports and studies • Visit projects • Other interviews - vendors, agencies etc
Key Respondents A SWaNI programme manager, project leaders, project partners and other project workers B Lead institution senior manager ideally with a strategic role in the provision of information systems, support and management within their institution C Administrative staff who may be involved with the newly interoperable systems within their institution D Academic staff who may be involved with the newly interoperable systems within their institution E Vendors of the interoperability system technologies F Agencies with an over-arching role (CETIS, RSCs)
Project Management • Hit the ground running • Scope/Capacity/Naivety • Project management toolkit • Buy-in versus nurture
Vendor Relationships • Cardiff Meeting • Drivers • Right People
Consortium Working • Models • Subgroup of larger consortium • Chums • Formal agreements
Organisational Factors • The big ideas and plans versus reality • Academic staff and VLEs • Reasonable expectations
Programme Management • Support • Waiting to be told • Reassurance - getting it right • Communication • Dissemination
Impact and Benefits • Sector • Institutional • Individual • Project staff • College staff • Learners
Cultural Differences • FE/HE • Timing and national differences • Scotland ahead? • Northern Ireland SIS • Wales LLWR
Cardiff Exercise • History of the Future • What was done • Why it was important • Own role • Feedback • Think about other perspectives • Self-evaluation • Relief at consistency, surprise at differences
Formative Evaluation • Stop, think and reflect • Feedback • Bringing people on board • Other perspectives • Sharing experience • Losing Fred
Summative Evaluation Themes • The extent to which SWaNI has built on the English interoperability pilots • The bidding and selection process, programme timing and timescales • Process or product • Organisational drivers, strategies and change management • Programme management • Effectiveness and interactions of support agencies • Value for money and long term benefits • The formative evaluation process
Valuing projects • Valuation - putting a value on something • We have done this and it is worth … • Evaluation - bringing the value out of something • We have done this in this wayand we learned …and when we do it again …