Pavasajjanant Natcha Yuji Akematsu and Masatsugu Tsuji

1. Evaluation of Course Design and Student Comprehension in the International Learning Environment:A Panel Data Analysis Pavasajjanant Natcha Yuji Akematsu and Masatsugu Tsuji Graduate School of Applied Informatics University of Hyogo

2. Outline Course design: three stages How the course was designed based on constructivism theory and Bloom’s taxonomy. Evaluation of the course Using panel data analysis on students replies How students acquired knowledge? How smoothly they perceive course contents, instructional methods and media usage? Analyze how three stages of the course design achieve original objectives

3. MX Flash software Learning content Distance Learning Project Computer-based system Learning Methods -Understand content well - Can use learning media

4. Connecting new and old information Interrelating the learning style and learning achievements. Learning basic knowledge Learning by experience and being advised Learning by experience at the more explicit level 1st Recognition to acquire Basic facts and information 2st Understanding to understand the basic use of the acquired knowledge 3st Application to apply this knowledge in other situations 4st Analysis to construct their own new knowledge based on knowledge and information obtained Traditional Lecture Self Learning Collaborative Learning Course Design Constructivism Bloom’s Taxonomy Our three stages

5. Course design: three stages of the learning process

6. HomepageSharing Learning materials&Web board

7. Sample of the WBT

8. Web board ：Thai Students

9. Web board ：Japanese Students

10. Evaluation: Panel Data Analysis

11. Learning Feedback and Evaluation ①Comprehension Q1. Do you understand today’s class? ② Cognitive load Q2. Do you feel difficult in learning today’s content and Flash MX? Q3. Is today’s class activity difficult? ③ Motivation Q4. Do you want to learn more about Flash MX? Q5. Do you want to search for related information from the Internet or any other on-line sources? Students are asked to reply four degree.

12. Estimation Method (Previous Study*) Multiple regression: how Comprehension was affected by Cognitive load & Motivation regard to teaching contents media and Information literacy Comprehension: Dependent variable Cognitive load & Motivation: Independent variables regard to teaching contents teaching methods For each stage Traditional Lecture Self Learning Collaborative Learning *Natcha, P., “Effectiveness of International Distance Learning on Computer Software in High Schools between Thailand and Japan,” Discussion Paper No. AIDP0903, Graduate School of Applied Informatics, University of Hyogo, 2009.

13. Estimation Results (Previous Study*) *Natcha, P., “Effectiveness of International Distance Learning on Computer Software in High Schools between Thailand and Japan,” Discussion Paper No. AIDP0903, Graduate School of Applied Informatics, University of Hyogo, 2009.

14. Estimation Method Panel data approach: how Comprehension was affected by Cognitive load & Motivation and Comprehension in the previous stage Comprehension: Dependent variable Cognitive load & Motivation: Comprehension in the previous stage(s): Independent variables Enhancement of comprehension of the previous stage = evaluation of course design Traditional Lecture Self Learning Collaborative Learning

15. Effect of the learning stylesAppropriateness of Course Design

16. Appropriateness of Course Design:Case of Thailand Traditional Lecture 3 Self Learning Collaborative Learning 1 2

17. Appropriateness of Course Design:Case of Japan Traditional Lecture 3 Self Learning Collaborative Learning 1 2

18. Conclusions From the analysis (1) Each learning stage Thai students : Cognitive load ( Difficulty) is important Japanese student: Motivation is important (2) Corse Design This course design is more fitted to Japanese students than Thai Reasons for Thai students Language barrier Unfamiliarity with teaching methods Less experience with ICT learning environment Readiness to distance learning Less sufficient self-organization They failed to perform assign role of communication They depended much on teachers and TA

19. Lesson learned from This Project -Combination of various instructional methods enhance effective learning in School Education The class should place a greater emphasis on two-way interactive communication and more real time. Suggestion: Using BBS >> more compulsory Interaction among teachers and students >> more real-time -role play, etc) Classroom discipline Class period is too short for self-learning and collaborative learning 50 minutes = moving to the computer classroom +actual learning time (10-15 min) (35-40 min) Suggestion: Shorter period of each class and longer term in the whole course

20. Thank you