250 likes | 338 Views
Evaluation Results of OP4L Learning Environment and Services in Slovenia. Maribor, May 2012. Ines Kožuh, prof. dr. Matjaž Debevc. Bar, Montenegro, 25 th – 26 th June. Research detailes. Company LOGO.
E N D
Evaluation Results of OP4L Learning Environment and Services in Slovenia Maribor, May 2012 Ines Kožuh, prof. dr. Matjaž Debevc Bar, Montenegro, 25th – 26th June
Research detailes Company LOGO • The aim of our study: test OP4L learning environment and its services, assess students‘ relationship with collaborative learning • evaluation: • before testing OP4L learning environment • after testing OP4L learning environment
Participants Company LOGO • Computer Science students -1st year (Faculty of Electrical Engineering and Computer Science), • volunteers signed consent form, • 62 participants • all male, • age in years (Mdn = 20, Mean = 20.73, Min = 19, Max = 25), • experience in programming.
Participants Company LOGO • experience in programming (5 levels)
Procedure Company LOGO • Three weeks in May 2012 • Two classroom meetings: • 1st meeting: before testing, instructions were given, questionnaires were filled in, • 2nd meeting: after testing, questionnaires were filled in, • The task: • brainstorming, • submission of proposed idea, • programming, • submission of the program, • assessment of the program.
Measures Company LOGO • Quantitative research metod (questionnaires), • Evaluation before testing OP4L: • A questionnaire on the habits of using Facebook, Facebook chat and Web resources, • Evaluation after testing OP4L: • A questionnaire on the habits of using Facebook, Facebook chat and Web resources (the same as before testing), • A questionnaire on the experience in OP4L learning environment, • A questionnaire on collaborative learning and using Facebook in favor of collaborative learning, • A questionnaire on the usability of OP4L learning environment (SUS), • Motivated strategies on learning questionnaire (MSLQ).
Measures Company LOGO • Likert-type questions and open-ended questions • questionnaires were put online.
Statistical analysis Company LOGO • Descriptive statistics, • definition of statistically significant relationships (Spearman‘sRho coefficient), • Kruskal-Wallis Test (differences among independent samples), • SPSS 20.0.
ResultsHabitsof using Facebook,chat and Web resources Company LOGO • Comparison of the results before and after the study
ResultsHabitsof using Facebook,chat and Web resources Company LOGO 52 8 2
ResultsHabits of using Facebook,chat and Web resources Company LOGO 32 18 10 2
ResultsExperience in OP4L learning environment • Assessment of OP4L services: • Recommended peers (idea vs. usage) • Recommended readings (idea vs. usage) • idea – from pedagogical and functional point of view • usage – from pedagogical and functional point of view, technical operation
Results Experience in OP4L learning environment Company LOGO 3.8347 3.7806 3.3742 3.2231
Results Usability of OP4L learning environment (SUS) Company LOGO • SUS score = 67.38 Source: A. Bangor, P. Kortum, J.A. Miller, The System Usability Scale (SUS): An Empirical Evaluation, International Journal of Human-Computer Interaction, 24, (2008), 6, pp. 574‒594.
ResultsOpinions on usability of OP4L learning environment Company LOGO • Bad responsiveness of the system. • Too many clicks were needed to be able to come to the task. • Problems with submitting and assessing the tasks. • Communication with others was too complicated.
Results Correlations between usability and OP4L services Company LOGO **. Correlation is significant at the 0.01 level (2-tailed).
ResultsCollaborative learning and using FB in learning Company LOGO • assessment of collaborative learning, • assessment of using Facebook in learning,
Results Correlations among three variables Company LOGO **. Correlation is significant at the 0.01 level (2-tailed).
Results Dispersion of data for two variables Company LOGO
ResultsDifferencesamonggroups in knowledgeofprogramming Company LOGO
ResultsMSLQ – Motivational strategies Company LOGO N = 58 students
ResultsMSLQ – Motivational strategies Company LOGO N = 58 students
ResultsMSLQ – Learning strategies Company LOGO N = 58 students
ResultsMSLQ – Learning strategies Company LOGO N = 58 students
Contact Company LOGO University of Maribor, Faculty of Electrical Engineering and Computer Science, Smetanova 17, 2000 Maribor www.feri.uni-mb.si Ines Kožuh e-mail: ines.kozuh@uni-mb.si prof. dr. Matjaž Debevc e-mail: matjaz.debevc@uni-mb.si