150 likes | 275 Views
10 questions on/from the impact paper. Gino Verleye. 0. Background. Previous meeting : agreement on broad definition of what IMPACT is supposed to mean: EVERY CHANGE. 0. Background. Need to make a distinction from all kinds of evaluation studies eg
E N D
10 questions on/from the impact paper Gino Verleye
0. Background Previous meeting : agreement on broad definition of what IMPACT is supposed to mean: EVERY CHANGE.
0. Background Need to make a distinction from all kinds of evaluation studies eg user satisfaction studies like Verdegem, P. & Verleye, G. (2009). User-centered e-government: a comprehensive model for measuring user satisfaction. Government Information Quarterly Verdegem, P. & Verleye, G. (2009). User-centered e-government: a comprehensive model for measuring user satisfaction. Government Information Quarterly
0. Background Impact is higher level effect studies : democracy, efficiency, effectiveness (cfr eGGEP)
0. Background Current status: Working group with : Mikael Snaprud, Evika Karamagioli, Stephen Jenner, Richard Heeks, Christine Mahieu, Emilio Lorenzo, Pieter Verdegem, Gino Verleye. No problem to find information and write text but I personally have some questions which I would like to share, blog on eGovMonet is observed but no feedback, so I need it from you now. Draft version January 2010. AIM: not only a new compilation of existing ‘impact’ stuff but guidelines and rating system ? Note: Belgian AGORA FEDICT study on eGov indicators: empty fields for impact
1. Is it realistic to focus on the left eGEB side? • High level • Sparse information • Own research: put less focus on democracy area’s
2. Focus on methodology for ideal impact study or feet on the ground? Of course not: Handbook & guidelines for a mission impossible study. Maybe 2nd level do’s and don’ts
3. It’s all about measurement, so include a chapter on measurement models?
4. Statistical analysis and interpretation? Fact: there is something called statistical anxiety But statistical models Gain insights Give a more objective series of facts based on numbers So include some info on statistics?
5. Benchmarking? This can mean anything… But is important. Would like to mention the pitfalls and added values of comparison.
6. Who is the end user? What are the needs? What is the aim of this paper in terms of end user: Researchers/scientists Federal people Local level Municipalities
7. What about qualitative research? Not everything can be captured in numbers. So include advise and guidelines for Set up Coding Analysis Reporting Of qualitative research? (Interviews, focus groups, delphi methods)
8. Mention information sharing and distribution platforms? Egov action/projects is one thing Evaluation of them an other But We have the capabilities and tools to share information on input, …, impact Talk about this?
9. Scoring system? The steering group struggles with the position of a scoring system for impact studies: Should we create an ideal system for an ideal impact project or Look at what is being done and infer evaluations from these
10. Feed back system for submission of projects? Ideally the paper should make people think about how the measure when they set up a project. Should eGovMonet become an advisory group to people with new projects of is this too much out of scope?