1 / 29

Electronic Assessment Management: Using the Right Tools

Explore the benefits and opportunities of electronic assessment management. Learn about the process considerations, experiences, and options available for data management and curation.

rodriques
Download Presentation

Electronic Assessment Management: Using the Right Tools

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Electronic Assessment Management - Using the right toolsAdrian Cain, Mark Wilcock & David Callaghan

  2. Programme of Session Introduction • Why use it? • Opportunities for online submission Our Experience • Process considerations • EHU Experiences of use Options • Turnitin • Blackboard Assignment Tool Data Management – In progress course considerations Data Curation – Post course considerations

  3. Definition Electronic Assessment Management: The use of information and communication technology to facilitate the creation, submission, marking, moderation and/or feedback of student work for assessment – usually summative, sometimes formative.

  4. Description • CreationAdministration, tutors, proforma/template • SubmissionOnline (various electronic formats) and offline submission • MarkingOn or off-line – even off screen, but eventually added online • ModerationOnline, email (zip), offline • FeedbackOnline – Text and/or audio • ReleaseOnline

  5. 2011-12 Annual Edge Hill University Student eLearning Survey Insight into our students’ experience and expectations of TEL 84% it is important to submit/collect assignments online. 42.7% that Online self-tests & quizzes are important “I find having access to lecture notes/slides enables me to reinforce any learning I have partaken in, and the quizzes/mocks are a useful way of checking learning is up to date.” The 5 Most Important Things My Lecturer Does Colin Gibson, SU President, Edge Hill University Students Union (2012) Blackboard ‘…..how important the basic things are to students….’ • Submit online “… a little thing we changed which made a big difference to our student’s lives.” • LE ‘…really, really powerful use it! • LE ‘…for all info, not just PowerPoints!

  6. Increase use of EAMs ..... results in the increased use of the grade centre Positives • Less travel • More parking spaces! • Less paper • Anytime and anywhere Negatives • System/s down – Plan B • Internet access and device • More time on computer • More difficult to spread mark/review Student demands • NSS and local demand +

  7. Opportunities for online submission Blackboard • Assignments • Tests • Surveys • Discussions • Journals • Blogs • Wikis Learning Edge • Turnitin • Campus Pack (Wikis, Blogs, Journals etc.) • Pebble Pad Offline • Performance • Viva • Artwork …and go to? • Grade Centre (Staff) • My Grades (Students)

  8. Our Experience of Typical Process (if there is such a thing!)

  9. Start to finish considerations Set-up (start) Consistency - Follow Faculty/Department/Programme processes/guides (if nothing exists, start it) Testing - Add your ‘Test Student’ account to check operation Instructional text – Make sure there are adequate student instructions (one file, cover sheet, lates, Plan B etc) Student Experience Competent – Become familiar with your submission process to support your students Differences – There is no EHU/HE fixed submission process and all tools offer different functionality Formative/Survey – Some tools can offer students formative or survey processes Submission (due date) Attempts – Single or Multiple attempts Timing – Open for exam period or module duration Marking Auto/manual – Instance tests with predefined answers or delayed manual marking Online/Offline – Some tools offer either or both, central co-ordination advised Multiple markers – Central co-ordination is advised when you divide your marking Wait and hide - Don’t start marking until due date has passed and hide relevant columns Moderation What to send out – File/paper, including plagiarism detection etc Feedback and returns (post date) Data Management and Data Curation

  10. User Experiences FoHSC • Turnitin – Faculty wide adoption • Training and process consultancy • Consistency • Support • Evolution of central control and management • Assignment Handler – Portfoilio/Level wide adoption • Training and process consultancy • Mixed portfolio confusion (CPD and Pre-Reg) • Student/staff confusion (Which system and process) • CPD – Moved to Turnitin • Exams (A and P, Mat Pack, Manual Handling) • Set-up – Changing course teams • Data curation FoE • Pebble Pad, • Campus Pack

  11. Preview your course with ‘Add Test Student’ Go to the course: • Control Panel • Course Tools • Add Test Student • The panel opposite appears: Your student account name is: • YourLoginName_S (i.e. caina_s) You can add this student to any course you are an instructor on. Learning Edge: Add Test Student http://www.eshare.edgehill.ac.uk/1050/

  12. Options

  13. Blackboard AssignmentFeatures • Submitting work electronically (eSubmission) increased flexibility • Marking offlineDownload in batch • Marking work online (eMarking) – Issues with Crocodocsreduced marking time • Comments and Feedback(eMarking) improved feedback consistency • Student Expectationsmeeting student expectations of online assignment submission

  14. Blackboard Assignment -Interface

  15. Blackboard Assignment Advice • Plan B (have one, but don’t advertise it)eMail? • Test studentUse a different browser • Submit as a single fileUse a template – Cover sheet, Los, Feedback etc (one doc) • Single / multiple attemptsIf single you may have to reset • DatesHand in on Thu, at 12pm? • Hide columns during marking period… because if you don’t students see their draft results!?

  16. TurnitinFeatures • Submitting work electronically (eSubmission) increased flexibility • Detecting plagiarism (Similarity indexing)academic integrity • Teaching referencing skills formative and summative learning tool • Marking work online (eMarking)reduced marking time • Comments and Feedback(eMarking) improved feedback consistency • Student Expectationsmeeting student expectations of online assignment submission

  17. TurnitinInterface Originality/GradeMark/PeerMark

  18. TurnitinAdvice • Files <20MB, <400 pagesWord better than PowerPoint, PDFs (5-20% fail), any file type • Consistency – Programme, Portfolio, Faculty same settings between modules • Students responsible for own work don’t change policy - 6 weeks storage with paper copies • Not as flexible as a box ……. but more availablea second late is a second late! • Understand the students' perspectiverole play a student with ‘add student • Know your process ……. if not ask!lates, re-sits, EMCs, new drop-boxes, new areas …… …. and always, always, always back -up

  19. Data Management

  20. Data Management – Tutor practiceShort Term – For the length of the module/Academic year Why • Short-term data storage (for all the same reasons you may have kept an individuals assignment) • Second and external marking/moderation • Privacy – Other students’ marks may be seen every time you have to view someone's work, particularly important in student tutorial/class events. • Need to present/look at some assignments/work, where there is no access to the internet. How • Check data curation procedures (admin) • Analysis future needs, by what you have done in the past • Export data and store it with in departments/faculties

  21. Data Curation

  22. Data Curation – Admin practiceLong Term Archiving Why • Blackboard upgrades (changes to existing VLE (5yr Licence)) • Data storage/archive - how long courses will remain available for • Details transferred to SID ASAP (BB is not an alternative to SID) How • Don’t change policy (or get lazy) just because its online (but digital stuff lasts forever … doesn’t it?) • Analysis future needs, by what you have done in the past • Export data and archive it with in departments/faculties • Create reports at Grade Centre level and download/copy individuals work at tool level (i.e. Turnitin)

  23. Trouble Shooting and Support

  24. Trouble Shooting and Support • Learning Services Helpdesk • ltdsupport email • LTD Operations Co-ordinator • LTDOs • Faculty Senior Solstice Fellows • Faculty Administrators • DDE Blackboard area – Enrol Exemptions include; Content and tool development/management/set-up, bespoke process issues, enrolment issues, etc. We will help consult on all aspects of TEL including those identified exemptions Level’s of support 1 – Help desks 2 – LTDOs 3 – Escalated to providers

  25. Bespoke needs We offer bespoke training, awareness and implementation of technologies and processes. • Team approach/members • Needs assessments • Present process • Proposed process • Critical processes • Block out time for group session

  26. Questions and Links

  27. Specific Links Please note: These guides may be/become slightly out of date as many of our systems have regular routine upgrades, plus they may also have been developed for a particular audience which doesn’t match your requirements. Therefore, when you use these guides please have this in mind. Contact your faculty Learning Technologists if you need any further assistance 01695 650757 (x7754) Turnitin • Turnitin - Setting up a Paper Assignment (PB - Mar 13) http://www.eshare.edgehill.ac.uk/3087/ • Getting Started with the Turnitin for iPad App (MJ - Aug 13) http://www.eshare.edgehill.ac.uk/3727/ • Turnitin for formative assessment (DC- Oct 13) http://www.eshare.edgehill.ac.uk/4060/ (presentation with set-up) • Turnitin – Submitting Work (CC – Mar 13) http://www.eshare.edgehill.ac.uk/3224/ • Students FAQ (KR – Sep 11) http://www.eshare.edgehill.ac.uk/883/ (Slightly out of date, but a good reference point) Blackboard Assignment • Blackboard Assignment - Creating a Blackboard Assignment Drop-box http://www.eshare.edgehill.ac.uk/2528/ • LTD7013: Blackboard Assignment Resetting the Assignment Dropbox http://www.eshare.edgehill.ac.uk/3070/

  28. Associated Links Please note: These guides may be/become slightly out of date as many of our systems have regular routine upgrades, plus they may also have been developed for a particular audience which doesn’t match your requirements. Therefore, when you use these guides please have this in mind. Contact your faculty Learning Technologists if you need any further assistance 01695 650757 (x7754) Grade Centre • LTD7014: Create additional columns (in Grade Centre) (for ‘offline’ submission) http://www.eshare.edgehill.ac.uk/3069/ • LTD3036 Hiding a Column from Student View http://www.eshare.edgehill.ac.uk/3068/ • LTD3033.pdf Creating a 'My Grades' menu button http://www.eshare.edgehill.ac.uk/2678/ Mobile • Blackboard Mobile Learn: Best Practices for Making Online Courses Mobile-Friendly http://www.eshare.edgehill.ac.uk/1372/

More Related