Intelligent Math Software: Smoke and Mirrors

1. Intelligent Math Software: Smoke and Mirrors? Bill Ganza Dir., Professional Development Chuck Lombardo, Ph.D. Dir., Creative Learning Services

2. Welcome Goals Discussion Our experimental approach at FCCJ Intelligent Math software Our approach Demonstration Effective? Research base? Q & A

3. Discussion Tie into what we are going to do. Tie in Dept of Ed Strengthening Mathematical Skills at the Post Secondary Level (2005) This study describes strategies proposed by the National Research Council (2000): Learner centered environment (p. 34) � pay careful attention to learner�s knowledge, skills, attitudes and beliefs knowledge-centered environment � well organized structure of concepts; math problem solving, models involving real-world situations; mathematical reasoning skills, use technology, become metacognitive Assessment-centered environment � alignment of goals [including higher order skills and not just procedures and facts], assessment, [content] opportunities for formative/corrective feedback community centered environment � promoting dialogue and collaboration Vision Report (American Mathematical Association of Two Year Colleges 2002) (p35) supplement lectures with student centered models including computer simulations, collaborative learning activities, use of case studies & projects that require designing, modeling, researching, and presenting findings. Contextual learning in courses that incorporate material from specific fields; learn by doing Key components of strategies for developmental math programs that are ��promising but unproven..� but are ��frequently implemented.� Instructional and pedagogical: traditional instruction, multiple delivery options for students to choose from; CAI, Internet based, self-paced, labs, small group instruction, contextual learning, linkages to and from the workplace etc. See page 64 Tie into what we are going to do. Tie in Dept of Ed Strengthening Mathematical Skills at the Post Secondary Level (2005) This study describes strategies proposed by the National Research Council (2000): Learner centered environment (p. 34) � pay careful attention to learner�s knowledge, skills, attitudes and beliefs knowledge-centered environment � well organized structure of concepts; math problem solving, models involving real-world situations; mathematical reasoning skills, use technology, become metacognitive Assessment-centered environment � alignment of goals [including higher order skills and not just procedures and facts], assessment, [content] opportunities for formative/corrective feedback community centered environment � promoting dialogue and collaboration Vision Report (American Mathematical Association of Two Year Colleges 2002) (p35) supplement lectures with student centered models including computer simulations, collaborative learning activities, use of case studies & projects that require designing, modeling, researching, and presenting findings. Contextual learning in courses that incorporate material from specific fields; learn by doing Key components of strategies for developmental math programs that are ��promising but unproven..� but are ��frequently implemented.� Instructional and pedagogical: traditional instruction, multiple delivery options for students to choose from; CAI, Internet based, self-paced, labs, small group instruction, contextual learning, linkages to and from the workplace etc. See page 64

4. About FCCJ Developmental curriculum Student population Retention and performance

5. Our Partnership The SIRIUS Project Alliance with McGraw-Hill

6. One Experimental Approach SIRIUS FCCJ Math Supersite Common Feature is MathZone - ALEKS Allows us to try to address some of the strategies proposed by the National Research Council: offloading some of the drill and practice, memorization of procedures, etc and assessment to technology. Provide specific assessment data to faculty. Allows us to try to address some of the strategies proposed by the National Research Council: offloading some of the drill and practice, memorization of procedures, etc and assessment to technology. Provide specific assessment data to faculty.

7. The Project Course development initiative � 28 courses Goals professional development innovative courses to improve performance and retention Cut textbook costs by 50% FCCJ created/owned instructional materials Use McGraw-Hill learning assets

8. SIRIUS Math Courses

9. FCCJ Math Supersite

10. Demonstration - ALEKS Anyone remember Mastery Learning???? About ALEKS: built upon the theory of Knowledge Spaces� ALEKS provides a systematic approach to learning math topics based on mastery learning; students must demonstrate mastery on objectives before getting credit and moving on to other objectives. The system collects and analyzes data on which objectives the student has mastered and what should be reviewed, creates an individualized program. Requires open ended responses instead of multiple choice Anyone remember Mastery Learning???? About ALEKS: built upon the theory of Knowledge Spaces� ALEKS provides a systematic approach to learning math topics based on mastery learning; students must demonstrate mastery on objectives before getting credit and moving on to other objectives. The system collects and analyzes data on which objectives the student has mastered and what should be reviewed, creates an individualized program. Requires open ended responses instead of multiple choice

14. Demonstration - ALEKS

15. Demonstration - MathZone

16. Demonstration - MathZone

17. Demonstration - MathZone

18. Demonstration - MathZone

20. Our Results

21. FCCJ Student Survey Results Would you recommend MathZone to other students?

22. Would you recommend MathZone to other students? It is an excellent tool that is very helpful when a student cannot make it to the learning center. I believe it is the only reason i am passing my class. It is an excellent tool that is very helpful when a student cannot make it to the learning center. I believe it is the only reason i am passing my class. Emphatically, it is awesome in all ways even with the occasional wrong solutions on the exercises. I wish my current class used it. I use the self study option to help me with my current class. I already have to 4 students , I think it is one of the greatest ideas for learning math It helps you apply yourself more after class. Its just like a class out of class 

23. Successes U of Alabama Virginia Tech University of Illinois Black Hills State University Others Goals include a focus on technology use to redesign large-enrollment courses that improve learning and reduce cost Strategies used include replacing text assignments with Internet-based assignments and in some cases replacing the entire traditional class with technology-based coursework (Hagerty,2005). Black Hills State � n = 251 effectiveness of ALEKS, experimental design, random assignment, measured performance on pre and post tests and the CAAP Results at Black Hills: students in ALEKS outperformed students in the control sections; most students were satisfied with the ALEKS experience, retention rates were about the same, and instructors felt that ALEKS allowed them to focus more on reasoning skills and making connections between Math and other subject areas (contextualized learning) They are currently developing a textbook that can be used in conjunction with ALEKS Goals include a focus on technology use to redesign large-enrollment courses that improve learning and reduce cost Strategies used include replacing text assignments with Internet-based assignments and in some cases replacing the entire traditional class with technology-based coursework (Hagerty,2005). Black Hills State � n = 251 effectiveness of ALEKS, experimental design, random assignment, measured performance on pre and post tests and the CAAP Results at Black Hills: students in ALEKS outperformed students in the control sections; most students were satisfied with the ALEKS experience, retention rates were about the same, and instructors felt that ALEKS allowed them to focus more on reasoning skills and making connections between Math and other subject areas (contextualized learning) They are currently developing a textbook that can be used in conjunction with ALEKS

24. Other Research �Strengthening Mathematics Skills at the Postsecondary Level: A Literature review and Analysis� (2005) Disclaimer: �We were not able to identify any studies of developmental mathematics [on instructional methods] that were based on randomized controlled trial (RTC) experiments.� (p.27)

25. Studies Reviewed Cartnal (1999) CAI groups had higher retention, enrollment in higher math McClendon and McArdle (2002) Three delivery types; no significant differences Kinney (2001) CAI, increased confidence and attitude Cartnal see page 28 Cartnal see page 28

26. More Studies Reviewed Quinn (2003) CAI and self paced use of PLATO; significant increase on CPT scores Lancaster (2001) CAI, decrease in withdrawals, increase in satisfactory grades Conclusion: ..�the role of technology is that it appears to be most useful as a supplement to, rather than a replacement for, regular classroom instruction.� (p. 33) Cartnal see page 28 Cartnal see page 28

27. Implementation Cost Customization IT Coordination Technical Support Evaluation FACULTY SUPPORT Lack of correlation between textbook/classroom content with MathZone/ALEKS content Lack of correlation between textbook/classroom content with MathZone/ALEKS content

28. Questions

29. Contact Information Bill Ganza wgnaza@fccj.edu Chuck Lombardo chlombar@fccj.edu