140 likes | 298 Views
ITEAMS Innovative Technology-Enabled Astronomy for Middle Schools An ITEST Strategies Project Of the Science Education Department At the Harvard-Smithsonian Center for Astrophysics. Philip M. Sadler, Principal Investigator R. Bruce Ward, Project Director and Co-PI
E N D
ITEAMS Innovative Technology-Enabled Astronomy for Middle Schools An ITEST Strategies Project Of the Science Education Department At the Harvard-Smithsonian Center for Astrophysics Philip M. Sadler, Principal Investigator R. Bruce Ward, Project Director and Co-PI Jaimie Miller-Friedmann, Associate Director Frank Sienkiewicz, Project Engineer Paul Antonucci, Curriculum Specialist and Engineer Wendy Berland, Department Administrator
ITEAMS Assessment: Using DDMC Questions In an Online System • Diagnostic pretests • Gain analysis on pre-post tests • Longitudinal data for students and teachers • Identification and tracking of misconceptions
ITEAMS Assessment: Using DDMC Questions In an Online System • Online Testing System • Automated reporting to test-takers • Immediate gratification for PD Providers! • Decrease in human error
DDMC:The History • Misconceptions • Higher Discrimination than traditional MC tests • Ability to reach a wider audience (vs. interview) • The J-Curve, misconceptions strengthen first, before moving to the scientifically correct conception
Sample Item: How long does it take for the Moon to go around the Earth? One day. One week. One month. One year. It never happens.
Sample Item: How long does it take for the Moon to go around the Earth? One day. 27.3% One week. 6.8% One month. 46.2% One year. 15.2% It never happens. 3.0% Pretest
Sample Item: How long does it take for the Moon to go around the Earth? One day. 27.3% 16.2% One week. 6.8% 7.4% One month. 46.2% 57.4% One year. 15.2% 11.8% It never happens. 3.0% 5.9% Post-test Pretest
Sample Item: How long does it take for the Moon to go around the Earth? One day. 27.3% 16.2% 31.5% One week. 6.8% 7.4% 8.9% One month. 46.2% 57.4% 30.8% One year. 15.2% 11.8% 15.6% It never happens. 3.0% 5.9% 13.2% National Sample Pretest Post-test
Sample Item: How long does it take for the Moon to go around the Earth? One day. 27.3% 16.2% 31.5% 0.0% One week. 6.8% 7.4% 8.9% 22.2% One month. 46.2% 57.4% 30.8% 77.8% One year. 15.2% 11.8% 15.6% 0.0% It never happens. 3.0% 5.9% 13.2% 0.0% National Sample Pretest Post-test Teachers
Important factors in choosing a career • 30% of Variance Explained by Factor 1: • Having others working under my supervision • Working with people rather than objects • Developing new knowledge and skills • Having lots of family time • Having lots of time for myself/friends • Making my own decisions • Working in an area with lots of job opportunities
Affective Predictors for Content Knowledge Linear Regression Outcome Variable: Total Score Int Test Factors in Choosing a Career: (+) Working in an area with lots of job opportunities (+) Working with people rather than objects (-) Helping other people (-) Making my own decisions (-) Having an easy job
Affective Predictors for Content Knowledge Linear Regression Outcome Variable: Total Score Int Test Technology Use and Expertise: (+) Web browsing and information searches (-) Creating graphics, photos, graphs or tables on a computer STEM Interest: (+) I could see myself being a scientist or engineer. (-) I would like to work with people who make discoveries in science
The Big Idea… • ITEAMS modeled after protocols used for larger studies: • SPARCS • MOSART • PRiSE • Anyone can access SED designed DDMC tests • Answer Keys • Data http://www.cfa.harvard.edu/smgphp/mosart/index.html