280 likes | 389 Views
Architectures and experiences with design and monitorization. Architectures and experiences with design and monitorization. María Jesús Rodríguez- Triana ( chus@gsic.uva.es ) GSIC/EMIC research group Universidad de Valladolid May, 2013. What is this presentation about?. EEE GO3:
E N D
Architectures and experiences with design and monitorization Architectures and experiences with design and monitorization MaríaJesús Rodríguez-Triana ( chus@gsic.uva.es ) GSIC/EMIC research group Universidad de Valladolid May, 2013
What is this presentation about? • EEE GO3: • To define methods and technologiestosupporttheevaluation of ubiquitouslearning, takingintoaccountthestudents’ actions in differentspaces.
Index • Introduction • Proposal • Use in real settings • Adding new spaces • Work in Progress & Future work
Introduction (1/3) • Orchestration framework for TEL scenarios 5 + 3 aspects [Prieto et al. 2011]
Introduction (2/3) • Orchestration framework for TEL scenarios • Awareness for regulation, management and assessment 5 + 3 aspects [Prieto et al. 2011] EEE GO3 UVA SO3 EEE Global Objective 3 UVA Specific Objective 3
Introduction (3/3) • Synergies may appear when the analysis is aligned with the design [Carter, 2008] [Locyer& Dawson, 2011] [Looney & Siemens, 2011] [Martínez-Monés et al., 2011] … however, theintegrationisnotstraightforward: design & technologicalproblemsmayappear[Martínez-Monés et al., 2011] Monitoring Scripting
Proposal (1/7) • Provideteacherswithdesign and enactmentsupportcapable of linkingpedagogicalintentionswithmonitoringneedsfororchestratingblendedCSCLscenarios in distributedlearningenvironments Support teachers to identify and include the monitoring issues of pedagogical significance throughout the design process of CSCL scenarios. Provide teachers with coarse-grained information about the evolution of the CSCL scenario, based on the constraints obtained from the learning design. Automatize the data gathering and integration tasks in technologically distributed and heterogeneous CSCL environments. Monitoring-aware designprocess of CSCL scripts Monitoring-aware designmodel of CSCL scripts Script-awaremonitoringprocess of CSCL scenarios Architecture for data gathering & integration in DLEs
Proposal (2/7) Monitoring-aware design of CSCL scripts Pattern-based design process for CSCL scripts [Villasclaras-Fernández et al., 2009] Pattern-based design process for CSCL scripts [Villasclaras-Fernández et al., 2009] [Rodríguez-Triana et al., 2012a] [Rodríguez-Triana et al., 2013a]
Proposal (3/7) Script-aware monitoring of CSCL scenarios [Soller et al., 2005] Main steps for the management of collaboration
Proposal (4/7) Script-aware monitoring of CSCL scenarios [Soller et al., 2005] Main steps for the management of collaboration Scripting Monitoring [Rodríguez-Triana et al., 2011a] [Rodríguez-Triana et al., 2013b]
Proposal (5/7) Architecture for data gathering and integration in DLEs GLUE! – Architecture for implementing DLEs [Alario-Hoyos, et al. 2013]
Proposal (6/7) Architecture for data gathering and integration in DLEs GLUE! – Architecture for implementing DLEs [Alario-Hoyos, et al. 2013] GLUE!-CAS (GLUE! - CollaborationAnalysisSupport) [Rodríguez-Triana et al., 2011b] [Rodríguez-Triana et al., 2011c]
Proposal (7/7) Architecture for data gathering and integration in DLEs
Use in real settings (1/10) Blended CSCL scenarios supported by VLE’s & Web tools MASUP 32 (14 students) MASUP 2013 (15 students) MASUP 23 (14 students) OyT (60 students) FPAD (170 students)
Use in real settings (2/10) ENACTMENT DESIGN INSTANTIATION Monitoring configuration EVALUATION
Use in real settings Monitoring-aware design process: Monitoring configuration of the activities
Use in real settings Monitoring-aware design process: Monitoring enhancement
Use in real settings (8/10) ENACTMENT DESIGN INSTANTIATION Monitoring configuration Deploy EVALUATION
Use in real settings (8/10) ENACTMENT DESIGN INSTANTIATION Monitoring configuration Deploy EVALUATION
Use in real settings (8/10) ENACTMENT DESIGN INSTANTIATION Monitoring configuration Deploy Logs Teacher observations Students feedback EVALUATION
Use in real settings (9/10) Script-aware monitoring process: Monitoring reports Monitoringconfiguration + Deploy
Use in real settings (10/10) “Identifying the dependences with other activities is not trivial “ “Focusing the analysis around the activity and the pattern constraints is very useful for teachers, even in situations like these where there were not many eventualities, it allows you to check whether the original idea is being verified.” “… information from face-to-face activities was helpful for the evaluation purposes. An overview of the whole learning situation facilitates the review of the learning process.“
Adding new spaces • Thesameproblemsappearagain: [Martínez-Monés et al., 2011] • Design problems: • Which tools provide awareness information? There are not many choices • Technological problems: • Data gathering issues: • Some tools do not register any kind of data about the user activity • Does not exist a standard format to store information from user’s interaction • Tools do not provide documentation explaining how the information can be obtained • Data interpretation issues: • Some applications do not provide ready to use data • Many applications do not store data for analysis purposes but for others such as debugging. • Need of taking into account the monitoring requirements when designing and developing ICT tools [Carter, 2008]. • Data integration issues: • Data synchronization • User identities • It’s necessary to identify teacher’s awareness needs in each space: • http://www.encuestafacil.com/RespWeb/Qn.aspx?EID=1520807
Work in progress & Future work • [WIP] Adapt GLUE!, GLUE!-PS, GLUEPS-AR to better provide awareness information • [WIP] Integration of AR data sources • [WIP] Analysis of teacher’s awareness needs ------------------------------------------------------------------------------- • [FW] Integrate the monitoring-aware design process with authoring tools • [FW] Provide an integrated view of the different data sources • [FW] Student’s awareness needs
GSIC-EMIC research group Universidad de Valladolid, Spain THANK YOU!For further information, please contact chus@gsic.uva.es