Christina M. Steiner, Eva Hillemann , Alexander Nussbaumer, and Dietrich Albert

1. Christina M. Steiner, Eva Hillemann, Alexander Nussbaumer, and Dietrich Albert Cognitive Science Section, Knowledge Management Institute,Graz University of Technology 13th International Conference on Knowledge Management and Knowledge Technologies (i-KNOW)4-6 September 2013, Graz, AustriaEU Dissemination and Exploitation Day

2. Overview • A HR-related Trend and Challenge • The CULTURA Project • Project Overview • Evaluation in CULTURA • Applying CULTURA Evaluation Approaches to HR Management • Summary CULTURA – Cultivating Understanding and Research through Adaptivity

3. A HR-related Trend and Challenge • Employee surveys as key instrument in HR development and management • Collecting employees’ opinions, expectations, needs, suggestions • Basis for change processes • Goal: ‘learning organisation’, employee satisfaction, performance improvement CULTURA – Cultivating Understanding and Research through Adaptivity

4. A HR-related Trend and Challenge • Target topics of employee surveys • Employment • Workplace design • Salaries and employee benefits • Communication/information • Collaboration • Personal self-fulfillment • Training and developmentpotentialities • Behaviour of and relation to boss • Organisation CULTURA – Cultivating Understanding and Research through Adaptivity

5. A HR-related Trend and Challenge • Employee surveys and technology evaluation • Introducing technology or software applications for job-related tasks • Evaluating the impact of change processes • Addressing quality of the technological solutions • User-centrered evaluation onrelevant quality aspect • Usability, user acceptance etc. CULTURA – Cultivating Understanding and Research through Adaptivity

6. A HR-related Trend and Challenge • Methodology • Questionnaires • Interviews • Need for systematic approach! • Conceptual design and execution • Clearly defined goal • Appropriate instruments/questions • Sound data analysis  Often a challenge CULTURA – Cultivating Understanding and Research through Adaptivity

7. The CULTURA Project CULTivating Understanding and Research through Adaptivity • http://www.cultura-strep.eu/ • Project type: Small or medium-scale focused research project (STREP) • Funding body: European Commission, ICT, Framework 7 • Funding scheme: Collaborative project • Start date: 01 February 2011 • Duration: 36 months • Total value: € 3,912,222 • EU funding: € 2,869,525 CULTURA – Cultivating Understanding and Research through Adaptivity

8. The CULTURA Project • Consortium • Trinity College Dublin • Knowledge and Data Engineering Group (KDEG) - Coordinator • Department of History • IBM Haifa • Sofia University • Commetric • University of Padua • Pintail • Graz University of Technology CULTURA – Cultivating Understanding and Research through Adaptivity

9. The CULTURA Project • CULTURA will provide an interactive user environment and innovative services and which support and dynamically tailor the investigation, comprehension and enrichment of digital humanities artefacts • CULTURA testbeds • two contrasting digital humanities artefact collections involving textual artefacts and image-based artefact collections • 1641 Depositions, IPSA Collection CULTURA – Cultivating Understanding and Research through Adaptivity

10. The CULTURA Project • CULTURA Methodologies • Normalisation • Entity and relationship identification • Social and influencer networks analysis • Personalisation • End user groups CULTURA – Cultivating Understanding and Research through Adaptivity

11. The CULTURA Project • Corpus agnostic research environment for digital cultural heritage collections • Integrating a suite of intelligent services • Personalised and adaptive access to cultural artefacts for a wide spectrum of users CULTURA – Cultivating Understanding and Research through Adaptivity

12. The CULTURA Project CULTURA – Cultivating Understanding and Research through Adaptivity

13. Evaluation in CULTURA • Overall Goal • Defining and carrying out sound evaluations of the project outcomes and the project itself • Tasks • Specification of evaluationmethodologyasbasis for empiricalevaluations • Evaluation service • Internalprojectevaluation CULTURA – Cultivating Understanding and Research through Adaptivity

14. Evaluation in CULTURA • Evaluation model for the CULTURA Environment • Components of user system interaction in CULTURA • Evaluation qualities on the axes between them • Theoretical basis for empirical evaluation CULTURA – Cultivating Understanding and Research through Adaptivity

15. Evaluation in CULTURA • Evaluation service Equalia • Supporting systematic and sound evaluation • Modelling evaluation goals • Collecting evaluation data • Analysing and consolidating data • Specification of evaluation model • Quality model and survey model • Formal definition of WHAT and HOW of evaluation CULTURA – Cultivating Understanding and Research through Adaptivity

16. Evaluation in CULTURA • Different modes for data collection  mapped to evaluation qualities • Questionnaires • Judgets • Sensors CULTURA – Cultivating Understanding and Research through Adaptivity

17. Evaluation in CULTURA • Evaluation reports with Equalia • Automatically created • Based on underlying evaluation model • Mean values and aggregations of raw data • Generation of diagrams and data export • Triangulation of different data sources CULTURA – Cultivating Understanding and Research through Adaptivity

18. Evaluation in CULTURA • (Re-) Use of Equalia • Developed to support evaluation of CULTURA Environment • Reusability and interoperability • Reusing evaluation models • Loose coupling with evaluated system • Exploitation in different evaluation contexts CULTURA – Cultivating Understanding and Research through Adaptivity

19. Evaluation in CULTURA • Internalevaluation • Monitoring of the project work and progress CULTURA – Cultivating Understanding and Research through Adaptivity

20. Applying CULTURA Evaluation Approaches to HR Management • Inspiring and supportingemployeesurveys by CULTURA • Specification of what and how of employeesurvey • Adopting/adaptinginternalevaluationapproach CULTURA – Cultivating Understanding and Research through Adaptivity

21. Applying CULTURA Evaluation Approaches to HR Management CULTURA – Cultivating Understanding and Research through Adaptivity

22. Applying CULTURA Evaluation Approaches to HR Management • Using Equalia for designing, conducting, and analysingemployeesurveys • Makingemployeesurveyswell-organised and more efficient • Questionnaires for allkinds of employeesurveys • Judgets and sensors for continuousevaluation data collectionwhentechnologyisused CULTURA – Cultivating Understanding and Research through Adaptivity

23. Summary • Employeesurveysneed to be systematic and professional • CULTURA evaluationapproachesmaysupportdesigning and carrying out employeesurveys • Systematicanalysis of aspects (qualities) to be addressed • Internalevaluation model as a startingpoint for definition of relevanttopics • Equaliaaspowerfultool to model, design and analyseemployeesurveys CULTURA – Cultivating Understanding and Research through Adaptivity

24. Christina Steiner -- christina.steiner@tugraz.at • Project website -- http://www.cultura-strep.eu/ Thank youfor your attention! CULTURA – Cultivating Understanding and Research through Adaptivity