410 likes | 580 Views
T h e Q uality of E duca t ion- R elated Portals in G e rmany: Results of a Mul t i- M ethod Evaluation of the German Education Server. Dr. Elke Brenstein Dept. Of Computer Uses in Education Humboldt University Berlin. An Old Problem.
E N D
The Quality of Education-Related Portals in Germany: Results of a Multi-Method Evaluation of the German Education Server Dr. Elke Brenstein Dept. Of Computer Uses in EducationHumboldt University Berlin
An Old Problem... How can we provide more people with more information, fast and in different forms? Researchers have worked on the problem for a hundred years. The good news is that they have solved it – bravo! Now the problem is: People don‘t know what to do with all that information .... Neil Postman, 1996 SINN03, Oldenburg
Der Deutsche Bildungsserver SINN03, Oldenburg
Entwicklung 1997-2002 SINN03, Oldenburg
Research Questions • Who are the users? Demographic characteristics, user groups • Which type of information are they looking for? • How do they rate what is offered? Content, Layout & Design, Usability, Functionality • How is the portal used? • Frequency of use • Domains & Organisations • Browsers & Operating Systems • Referrer • Most popular pages SINN03, Oldenburg
Evaluation concept Users Archival data Surveys Studies Logfile Analyses Online Panel Gen. Online Survey Usability Testing Primary / Sec. Education Vocational Education Higher Education & Research Institutions Email-Requests Navigational studies Other Feedback Adult Education Expert Interviews Market analysis Fokusgroup-Interviews Non-Users SINN03, Oldenburg
Nutzer Anonymisierte Befragungen Einzeluntersuchunen Archivdaten Bereich Hochschule: Bereich Schule: Bereich Schule Deutscher Bildungsserver Usability Test Schulweb Repräsentative Online Befragung in 5 Ländern Repräsentative Postalische Befragung in 5 Ländern Logfile Analysen Allg. Online Befragung Allg. Online Befragung Bereich Hochschule Usability Test DBS Allg. Bildungsinfo Bereich Weiterbildung Marktanalyse Usability Test DBS + 2. Portal Bereich Schule Marktanalyse Modul 2 Experteninterviews Bereich Hochschule Bereich Weiterbildung: Fokusgruppen-Interviews Marktanalyse Allg. Online Befragung Bereich EB/WB Nicht-Nutzer Marktanalyse SINN03, Oldenburg
Usage: Universities & Research Institutions SINN03, Oldenburg
How are the users of the DBS?Distribution of user groups OB SINN03, Oldenburg
Rating Overall impression • Mostly positive • no sig. differences between first-time and repeat users OB SINN03, Oldenburg
How important are the following aspects of a Website? OB SINN03, Oldenburg
How do you rate the DBS? OB SINN03, Oldenburg
What do you like/don‘t like? • Positive Comments: • Rich content • Content is up-to-date and of high quality • Site structure • Criticism: • Usability e.g., aspects of the search • Design/Layout UB SINN03, Oldenburg
Logfile Analyses • Tools • Analog http://www.analog.cx • Report Magic • Data basis: • Webserver Logs from Okt. 01 bis June 03 • Sample: • All users • Users from universities and research institutions SINN03, Oldenburg
Weekly Usage Univ. & R. Institutes All users SINN03, Oldenburg
Browsers - IE Explorer: MSIE 5: 75 % MSIE 6: 25 % - Netscape: Netscape 4.x: 90% LF SINN03, Oldenburg
Operating Systems LF SINN03, Oldenburg
OrganizationsAll Users SINN03, Oldenburg
Searchwords leading to the Eduserver (Top 30) SINN03, Oldenburg
ReferrerEduserver Total SINN03, Oldenburg
ReferrerUniversities & Research I. SINN03, Oldenburg
General Media Usage by Students SINN03, Oldenburg
General Media Usage by Teachers SINN03, Oldenburg
General Media Usage by Parents SINN03, Oldenburg
Attitudes Towards Internet and Computers SINN03, Oldenburg
Computer Usage Where?: Students SINN03, Oldenburg
Computer Usage Where?: Teachers SINN03, Oldenburg
Communication With? Students SINN03, Oldenburg
Using? Students SINN03, Oldenburg
Communication With? Teachers SINN03, Oldenburg
Using? Teachers SINN03, Oldenburg
Offline Usage: Students SINN03, Oldenburg
Offline Usage: Teachers: SINN03, Oldenburg
Online Usage: Students SINN03, Oldenburg
Online Usage: Students SINN03, Oldenburg
Online Usage Teachers SINN03, Oldenburg
Online Usage Teachers SINN03, Oldenburg
Navigational Analyses Which Navigational patterns kann be identified? Paths, latencies Suchen <-> Browsen, typical paths in content areas SINN03, Oldenburg
Beispiel 2 SINN03, Oldenburg
zurück SINN03, Oldenburg
Thank you! Contact: Homepage: www.educat.hu-berlin.de E-mail: brenstein@educat.hu-berlin.de SINN03, Oldenburg