280 likes | 377 Views
Design, Implementation and Evaluation of Brokerage Systems of Learning Resources. Lampros K. Stergioulas Department of Information Systems & Computing Brunel University, UK. Overview of presentation. Universal Brokerage Platform Value chain and user benefits Platform Architecture
E N D
Design, Implementation and Evaluation of Brokerage Systems of Learning Resources Lampros K. Stergioulas Department of Information Systems & Computing Brunel University, UK
Overview of presentation • Universal Brokerage Platform • Value chain and user benefits • Platform Architecture • Service and LR Evaluation The need for Brokerage: • eLearning business: far from lean • Replication & Waste • Re-Use is spectacularly absent
The Universal Brokerage Platformis a distributed, multi-lingual system supporting the exchange of learning resources • Challenges: • Neutral business model • To interface with heterogeneous content delivery systems such as • Web servers, • Streaming media servers, • Videoconference systems, and • Learning Management Systems Universal Brokerage Platform
The UNIVERSAL Project:Universal Exchange for Pan-European Higher Education • Focus on Higher Education Institutes (HEIs) • Brokerage Service: Not just a catalogue • Aims to Serve: • HEIs • Corporate Training • Individual learners • Consortium: • 17 members from the EU • Higher Education Institutions with engineering and business studies • Technology supplier/integrator & Network service operators • external collaborators in Canada and Iceland
Scope of work • Key innovation: Flexible and open inter-organisational information system; tight integration of various content and live delivery systems, such as learning management systems, web server, media streaming server and video conferencing tools. • Learning Resource (Def.): a form (material or activity) of highly specialised academic content. A learning resource can be a short video or a complete course.
Service: Brokerage of Learning ResourcesApproach:- Open exchange of LRs- Interface between brokerage platform and different delivery systems- Compatibility with various business models- Collaboration catalyst between Higher Education Institutions and companies- Standardised descriptions of pedagogical, administrative, and technical characteristics of LRs Platform Features: • Enquiries • LR Provision • LR Booking • LR Delivery
Contributions of Universal • The Technology for building knowledge exchanges and educational brokers is known as the Universal Brokerage Platform (UBP). • The Service for sharing learning resources among faculty members in higher education is known as EducaNext.
Benefits toLearners • Higher degree of specialisation and variety of approach • Wider choice of LRs • Lower cost and higher quality of teaching
Benefits toHEIs/Corporate Training Providers Faculties & organisations can easily re-use each other’s LRs • enrich courses with external material, lowering the cost and raising the quality • Foster national and international academic alliances and exchanges • Enable/reinforce partnerships between institutions of higher education and industry • Improve their teaching materials through feedback from users • Maximise use of their LRs, minimise “waste” • Gain reputation in a constantly growing community • Access new academic distribution channels • Open Universities to extend range and depth
EU user-centred value objectives - topics - country of origin - up-to-date - existing curricula Openness of UBP (technical) Scope of delivery sys. supported Scope of geogr./ling. distribution Richness of LRs (pedagogical) Diversity of Users (marketing)
Open System Architecture for Material Content Delivery system (e.g. Web server, StreamingServer, Video Conferencing Tool) Provider PC Metadata Learning resource Provider system System interface Broker Content Delivery system (e.g. web server, Learning Management System)
Open System Architecture for Live Activities 1. Announce- ment UNIVERSAL BrokeragePlatform 2. Provision 3. Booking 4. Consumption 4. Consumption Delivery system forlive educational activities(e.g. ISABEL) 4. Consumption
User Interface Engine Main Functions • To provide a user friendly dialogue capability between users and the platform • To exchange information with other system components (engines), as required. • Multilingual: English, French, German, and Slovenian • Quick edit mode allows instantaneous adaptations for web page editors
Administration Engine Acts as a records repository. Thus its main operational objectives are to • keep records of users and transactions (detailed access and transaction statistics) • provide data to other engines • Initiate, organise, and sustain actions in the platform • Advanced user management • E-mail notification management tools Contract & Booking Engine CE: Enables formal transactions between users and platform and invokes contract formulation, acceptance and billing mechanisms • Tracks Learning Resource Usage (Research, Teaching, Course Preparation, Preview) • Personalized List of Booked Learning Resources • Triggers Delivery (and Assessment) • Notifies Learning Resource Provider
User Profile Engine is responsible for creating and maintaining users’ profiles and user authentication files LR Profile Engine This engine keeps LR information. Its main operational objectives are to • store LR data • search LR data and provide information in response to user requests.
Evaluation Engine The Evaluation engine supports quality evaluation of learning resources and platform activities. In doing so, it is focused on the following operational objectives: • to collect evaluation data and • provide search and analysis capability on evaluation and other user-related data
Delivery Engine The brokerage platform does not store LR contents; instead it offers an interface layer which provides communication functionality between the platform and various delivery systems. This is the responsibility of the delivery engine, which provides authentication and authorization services, delivery negotiation and delivery supervision. Presently, the platform provides support to the following set of delivery systems: • Standard web server • Hyperwave’s E-learning Suite • RealNetworks Real server • Isabel Teleconferencing Suite
Platform Data Management • User Database • Learning Resource Database • Evaluation Database • System Log Database • Booking Database LR Quality evaluation LR evaluation Data Questionnaires UPB Quality UBP evaluation evaluation Data Questionnaires Evaluation Data
Evaluation Services This activity is focused on: • Evaluation of LR quality and collection of feedback that can be used to: • improve LRs • encourage acceptability (and even accreditation) of LRs by professional institutions and educational organisations (HEI’s). • Evaluation of the effectiveness and completeness of the brokerage service, which will provide a measured understanding of the quality of brokerage service and leads to future evolutionary/improved versions of the system.
LR Evaluation Service • In LR Evaluation Service, the platform collects from users LR evaluation data which is then stored in the LR evaluation database. This data is analyzed by the evaluation engine and is transformed into meaningful LR evaluation information, which adds effectively a unique “LR quality” dimension to the UNIVERSAL brokerage operation. • Fast feedback support via spot light reviews and meta reviews, “How useful was this review?” • Option to create customised evaluation questions and integrate them into a powerful evaluation tool
LR evaluation: Data Collection LR evaluation data is collected from the following users: • Learners (students – consumers) • HEI administrators and academic staff (faculty consumers) • LR providers The evaluation data collection process is initiated by the administration engine. The administration engine logs all platform usage activity, including LR delivery, and is in a position therefore to activate the LR evaluation data collection process on-line.
Platform/Service evaluation • Technical evaluation • Functionality evaluation • User Satisfaction via • Automatic logging activities • User feedback/comments/complaints • Automatic alert system • User Driven • System Activated
Current Status • Service available on-line since April 2002 • LR Usage and LR quantity growing exponentially • Continuous Evaluation and Refinement • Peer Reviews MISSIONSTATEMENT: UNIVERSAL is a world-class brokerage service linking educators for exchanging/distributing learning resources.
Brokerage Service for Learning Resourcesavailable athttp://www.educanext.org/ Further information can be found @ http://www.ist-universal.org/