National Mission on Education through ICT IIT Bombay

1. National Mission on Education through ICTIIT Bombay PROGRESS REPORT 2009

2. Project OSCAR Process overview

3. MODELS ADOPTED TO GENERATE CONCEPTS & IDDS • Online through Project OSCAR website: http://oscar.iitb.ac.in/oscarHome.do • Conducting workshops for students periodically in and around Mumbai • Contacting interested individual faculty in various departments of IIT Bombay • Domain Reviewer model

4. Google Analytics(OSCAR View Report)‏

5. Google Analytics

6. A. ONLINE MODEL : PROJECT OSCAR WEBSITE

7. Concept Proposal Stage On approval status, proposer expected to submit IDD within 15 days Fill up registration form as proposer/ developer/both Submit concept proposal form : NPTEL/ CDEEP/Others Reviewer reviews form The Reviewer checks whether: a) Animations similar to the suggested one are not lready available in open source. b) If they are, then suggested animation can be accepted if and only if significant improvements have been suggested over the existing animations.

8. IDD Creation Stage Approved concept developed into Instructional Design Document (IDD)‏ Contents of IDD a. Concept process explanation stepwise through Images/ diagram. b. User interactivity to be included in the animation. c. Small questionnaire to test the user’s comprehension Developed IDD reviewed by domain experts On approval, an honorarium of Rs.1000/- given to proposer

9. ONLINE data No. of proposers: 46 No. of developers: 37 No. of proposers & developers both: 40 No. of Concept proposals obtained online: 49 No. of Concept proposals approved: 32 No. of IDDs obtained online: 13 No. of IDDs approved online: 05 No. of IDDs rejected online: 02

10. B. WORKSHOP MODEL IDEA GENERATION WORKSHOPS CONDUCTED IN & AROUND MUMBAI

11. Sr. No. Workshop Name Venue Date 1 IDEA Generation Workshop, Mechanical Engg. Mechanical Engg. Department, IIT Bombay 20th August,2009 2 IDEA Generation Workshop , Chemistry Department of Computer Sc. & Engg. Conference Room 11th September ,2009 IDEA Generation Workshop, Entire IITB Faculty & Students CDEEP Seminar Hall, KReSIT 14th September,2009 3 4 IDEA Generation Workshop, D.J.Sanghvi College of Engg. D.J.Sanghvi College of Engg., Vile Parle 17th & 18th September, 2009 5 IDEA Generation Workshop, Walchand College of Engg. Walchand College of Engg., Sangli 19th & 20th September,2009

12. Sr. No. Workshop Name Venue Date 6 IDEA Generation Workshop, Environmental Sc. & Engg., IIT Bombay Environmental Science & Engineering Seminar Room 25th September,2009 7 IDEA Generation Workshop, Department of Physics, IIT Bombay Department of Physics, IIT Bombay 14th October,2009 8 IDEA Generation Workshop, Entire IITB Students Dept. of Computer Sc. & Engg., IIT Bombay 15thOctober,2009

13. No. Workshop name Target Audience Venue Tentative Date Purpose 1 Instructional Designing College teachers IIT Bombay 28th Nov.,2009 Generate good Instructional Design Documents on concepts to be animated 2 Instructional Designing IIT Bombay students IIT Bombay WORKSHOPS PLANNED FOR FUTURE

14. THE WORKSHOP PROCESS MODEL 1. Arranging Logistics 2. Presentation & forms 3. IDD Generation 4. IDD Review

15. 1. Arranging Logistics • Take advise on the venue and date of workshop from the Head of the department • Send out invitation mails to individual faculty and student groups in the department • Send reminder mails to faculty & students on the eve of the workshop • Create 2 types of forms for faculty and Students • Faculty form : i) Concept details, in brief ii) Email ID of the TA/RA/RS/PS of the concerned faculty who can later be contacted to fill up the IDD template. (b) Student form: i)Asked to explain the concept in some detail. ii) Asked to visualize the animation stepwise as far as possible while filling up the forms.

16. 2. Presentation & Forms • Explain through a presentation, what is expeced from faculty and students. • Show already made UG level animations to set a benchmark to aim at. • Distribute Instructional Design Document forms to students. • Distribute Concept Definition forms to faculty. • Show examples of both types of already filled forms on screen. • Provide tea & snacks to dispell an exam environment & create a cozy one, where students can discuss and come up with good ideas. • Wherever possible, arrange for textbooks from the departmental Library.

17. 3. IDD Generation • IDD forms where the concept has been relatively well explained through images are selected. • Web search is then done to check animations on these selected concepts, not already available in open source. • Finally, proposers of selected concepts are mailed the Instructional Design Document [IDD] template for filling up. • An example of a filled template is also sent. • For faculty given concepts, their referred students are mailed the concept with the details (given to us by the faculty) and the IDD template. • A timeline of a week is given for submissions. • Until the IDD is obtained, reminder mails are sent periodically.

18. 4. IDD Review • The course instructor for the particular topic is contacted for IDD review. • A review form has been designed for the purpose, which is mailed to faculty alongwith the IDD. • In case of confusion, reviewer is personally explained his expected role. • Review reports are mailed back to the proposers. • Once approved, the IDD is uploaded at Project OSCAR website. • The concept proposer is awarded an honorarium of Rs.1000/- .

19. Workshop Attendance

20. C. CONTACTING INDIVIDUAL FACULTY FOR CONCEPTS

21. THE PROCESS 7. IDD review 1. Send Invitation Mails 2. Meet Interested Faculty individually 6. IDD generation 3. Introduce OSCAR 5. Mail IDD template to TA 4. Get Contact Information of TA

22. Graph of Faculty attended workshop vs. Faculty responded only after individual mails

23. D. Domain Reviewer Model

24. THE PROCESS • Review process proving to be time consuming • Hence, “Domain Reviewer” model proposed. • Herein, faculty takes care of the review stage of all IDDs submitted in his/her domain. • Work of getting the concepts & IDDs still done by us. • Faculty will be paid honorarium on a per-review basis. • This model already being tried out in Physics • Review process time length has considerably shortened.

25. What we did? Result How we changed? Effect 1. An individual faculty consulted for the venue and time in ME. Not getting the venue exclusively for our workshop Head of Department was consulted for venue and time of the workshop. Better turnout of faculty. 2. Feedback taken from students about the IDD form. Some questions were confusing for the student Questions creating confusions replaced in the second version. Better understanding of what is wanted from proposers How did workshop processevolve?

27. What we did? Result How we changed? Effect 3. Asked for written Instructions for animators Needed help to fill up IDD forms Improved understanding of IDD forms 4. Referred Instructional Designing as “Storyboard “Storyboard” term not understood Term changed to Instructional Designing Understood as instruction for animators 5. IDDs received text heavy with minimal images Not understood by animators IDD template design changed twice Proposers gave stepwise images of the process THE EVOLUTION CONTD… Showing examples of filled forms onscreen

28. CONCEPT PROPOSER FORM: Student Version 1 Questions that created confusion

29. CONCEPT PROPOSER FORM: Student Version 2

30. CONCEPT PROPOSER FORM: faculty

31. First Storyboard Template Problem statement: Stepwise description and illustrations (Add more slides if necessary)‏

32. INSTRUCTIONS SLIDE 1 Second Storyboard Template [Renamed IDD Template] Concept details: 2 • In this section, provide the stepwise detailed explanation of the concept. • Please fill in the steps of the explanation of the concepts in the table format available in the slides to follow (see the sample below). • Resize the table dimensions as per your requirements. 3 4 5

33. Stage 2 Reviewer Form: • Reviewers were unsure of what & how to judge. • Hence, reviewer form designed to the satisfaction of reviewers.

34. MODELS TO BE TRIED A. OUTSOURCING : TENDER MODEL • Inspite of good faculty response, IDD generation taking long time. • Process of the students filling up IDD had to be changed. • Outsourcing the IDD filling up process for a given concept was mooted. • Tendering process is underway for the generation of IDDs and the subsequent development of animations.

35. MODELS TO BE TRIED • B: DOMAIN OWNER MODEL • Generating sizeable number of IDDs from TA/RS of faculty taking 1 month on an average. • To meet our timeline, idea of Domain owner model suggested. • Herein, a faculty takes charge of generating at least 50 approved IDDs from his/her domain within a timeframe (i.e. IDD generation + review). • The financial incentive planned to be in terms of equipment, consummables & manpower salary.

36. MODELS TO BE TRIED C. INDIVIDUAL FACULTY PARTICIPATION MODEL • Getting the IDDs from TAs proving to be very time consuming. • To overcome the TA bottleneck,concept explanations from the faculty are being recorded verbally. • Aim to convert them to IDDs by employing someone from that domain to play the role envisaged for TAs. • IDDs are then expected to be generated within our timeline.

37. RESULTS

38. Concept proposal vs. IDD Conversion Chart : Workshop

39. Online Concept Proposal/IDD Conversion Status

40. Concept proposals/IDD received & IDD Approved through workshops

41. Expected to Actual IDD Conversion : Workshops

42. Concept Proposals (CP)‏ Approved CP IDDs Received IDDs to be modified IDDs under review IDDs approved IDDs rejected 55 35 20 3 1 14 2 Concept Proposals (CP)‏ Approved CP IDDs Received IDDs to be modified IDDs Under review IDDs approved IDDs rejected 217 174 40 19 4 13 4 OSCAR Online Statistics OSCAR Workshop Statistics

43. Online vs. Workshop IDD generation comparison