Welcome & Re-Introduction Part I Results of Our First Year (15 months) Next Steps Part II

1. Welcome!National Science Foundation STEP Grant Operation STEM Advisory Board MeetingJuly 23rd, 2014Cleveland State University – Julka Hall 19110 a.m. – 12 noon

2. Agenda • Welcome & Re-Introduction Part I • Results of Our First Year (15 months) • Next Steps Part II • Carousel Brainstorm – Board Member Input

3. Operation STEM Advisory Board Members Deirdre Mageean, Provost and Honorary Advisory Board Chair

4. NSF STEP Grants & Operation STEM • NSF-STEP grants exist to increase the number of STEM graduates in U.S. colleges and universities. • The mission of NSF-STEP grant, Operation STEM, is to increase the number of students who successfully completethe calculus sequence (PreCalc I – Calc II) and graduate with a STEM degree.

5. Our Successes Since Last Board Meeting - January 31, 2014 • Precalculus II pass rate: 87% (previously 61%) +26% • Due to passing the OpSTEM Summer Calculus I course, 35 students continue in their STEM degree • 2 New PBL Projects Launched (Ringtone & Formula 1 Racing) • Partnership with Cleveland Indians established • Successful OpSTEM components to be replicated in another start up STEM program

6. Overall Results of Our First Year (15 Months) (Chronological Order from March 2013 to June 2014) • 2013 STEM Education Conferences (N=51) • OpSTEM Summer Institute (N=36) • Precalculus I pass rate: 81% (previously 57%) +24% • Precalculus II pass rate: 87% (previously 61%) +26% • Tuition-free, paid Calculus I – 35 students passed • 3 PBL Projects Launched (Bridge, Ringtone & Formula 1 Racing) • 2014STEM Education Conferences (N=50) • 2 Credit PHY 493 OpSTEM Research Methods for Spring ’15 • In Summer 2014 - Successful OpSTEM components will start to be replicated in LSAMP - Louis Stokes Alliance for Minority Participation

7. Results to Report Since January 31st Board Meeting • 2013 STEM Education Conferences (N=51) • 1 Summer Institute (N=36) • Precalculus I pass rate: 81% (previously 57%) +24% • Precalculus II pass rate: 87% (previously 61%) +26% • Summer Calculus I - 35 students passed • 3 PBL Projects Launched (Bridge, Ringtone & Formula 1 Racing) • 2014 STEM Education Conferences (N=50) • 2 Credit PHY 493 OpSTEM Research Methods for Spring ’15

8. MTH 168 Precalculus II Pass Rates by Fall/Spring Semester *Includes all official and unofficial withdrawals for MTH 168.

9. Significance of Spring 2014 MTH 168 Precalculus II Pass Rates • 28 fewer students who need to RETAKE Precalculus II • If 10 of these 28 do not drop out because of successful completion of course, tuition gain of $289,080 ($9636 annual tuition X 10 students X 3years) • Larger enrollment in MTH 168 Precalc II (135) in part because of success of MTH 167 Precalc I (57%  81% pass rate) • Fewer withdrawals (3%) {Spring semester avg. 15%)

10. MTH 168 Precalculus II Spring 2014 Pass Rate by Section Out of 127 students who completed the course, only 9 did not pass. *Enrollment of OpSTEM Scholars in PrecalcII section. **Includes official and unofficial students who withdrew from the course.

11. MTH 168 Precalculus II Spring 2014 Performance of OpSTEM Cohort

12. Factors Which MAY Have Contributed to MTH 168 – Precalculus II 87% Pass Rate • Maintained class size cap at 37 • All sections (4) taught with mandatory SPT Sessions • Provides 2 extra hours of STEM Peer Teacher instruction • 2 sections taught with Project Based Learning • More prepared students, experienced SPTs, cohort bonding

13. MTH 168 Spring Precalculus II to OpSTEM Summer (MTH 180/181)Calculus I NOTE: 1 OpSTEM Scholar took MTH 168 in Fall 2014 and later joined OpSTEM Summer Calculus I for a total enrollment of 42 students. * Changed major, difficult high school-freshman transition, life challenges, etc.

14. Criteria for OpSTEM Summer (MTH 180/181)Calculus I Scholarship Students (20) • Intended Major • Financial Aid • First Generation • Precalculus I Final Grade & PrecalculusII grade in February • Taking another Class During Summer I • Taking Calculus II in the Fall • 2 Letters of Recommendation • Candidate’s 250 Word Essay • Reviewed by Drs. Stephen Duffy, Debbie Jackson and Susan Carver

15. 2014 Tuition-Free OpSTEM Summer Calculus (MTH 180/181) • 6 weeks – May 19th thru June 28th – 5 days a week (28 classes) • Mandatory 1.5 hr. lecture & 1 hr. SPT session with 4 SPTs • 1 hr. daily optional open lab with 1 SPT, 2 Jr. SPTs and Professor Marquard’s assistance (avg. 20+ in attendance) • PBL 1x/week – Formula 1 Race Car Project • 42 registered students – 1 withdrawal • $1000 stipend to be paid to 22 OpSTEM Scholars who pass course • 20 OpSTEM Summer Calculus 1 Scholarship students • Began course with Ellen Burts-Cooper’s, Improve Consulting, Brain Game Competitions as an ice-breaker

16. Operation STEM Social Event Support Thank you Ellen Burts-Cooper, Senior Managing Partner, Improve! Consulting and Training Group for sponsoring her consultant, Jarvis Bills, who engaged the 42 Summer Calculus OpSTEM Scholars in Brain Game Competitionsas their ice breaker activity for the course.

17. MTH 180/181 Summer Calculus I 2014 Of the 35 students who passed MTH 180-OpSTEM Summer Calculus I 25 move on to MTH 182-Calculus II.

18. Possible Factors Which MAY Have Contributed to MTH 181 – Calculus I low success rate • Error in syllabus grading scale. Needed a 60% (should have been a 70%) to: 1) pass course, 2) go on to Calculus II, 3) receive $1000 stipend • Despite very low grades, did not drop course because of free tuition and/or $1000 stipend • Did not feel the pace of the intensive 6-week course • Large class size (N=42) • Complacent/Burned out • Underdeveloped critical thinking skills

19. Of the time spent outside of class, SPT session and the one-hour optional lab time, HOW MUCH TIME on average per day (HOURS & MINUTES) was designated to homework, other study techniques, i.e, Kahn Academy, paper and pencil practice problems. REPRESENTATION OF 42 STUDENTS’ ANSWERS Comments: 1. I tried to spend as much time as I could outside of class, when I wasn't working I spent as much time as I could on homework and practicing but I have to work quite a bit and that was just not possible every day. 2. I would have loved to spend more time trying to figure out the Calculus but I did not have that much time to give to it. If I was solely focusing on Calc I might have done better. 3. I studied with my grandfather for 3 hours before each exam.

20. Change in Criteria for 2015 OpSTEM Summer Calculus I • B- or higher in Precalculus I and II during 2014-2015 • Minimal work hours during 8-week course • Sliding grade scale to earn specific stipend, max. $500

21. Project-Based Learning Looking Back • Fall 2013 • Bridge project • Spring 2014 • Exploring Trigonometry Through Sound Project • Summer 2014 • Formula 1 Racing Strategy Project

22. Project-Based LearningMTH 168 – Exploring Trigonometry Through Sound Project • Ringtones were created using sine equations • Criteria of the project • Contain 3 pure tones • Contain 1 complex tone • Plays for 10 seconds • Multimedia Project • Maple – graphical representation of the waves • WolframAlpha – musical representation of the waves • PBL Symposium in April 2014 • Tones were played on iPads • Tones were displayed on poster board

23. Project-Based Learning MTH 180 – Formula 1 Racing Strategy Project • Model Time for a Formula 1 Racing Strategy • Recognition of given parameters. • Understand relation between each parameter • Knowledge used • Algebraic Methods • Integration • Race Day • Pairs worked together to come up with 1strategy • Computer simulation • Final Paper • Explaining the method used • All calculations used and how they were created • Explanation of their mathematical thinking during the project

24. Project-Based Learning: Looking Forward • Better align the content of the project to the course material • Scaffold the knowledge and skills required to complete projects throughout the three courses • Integrate the project into the course as much as possible • Meet collaboratively with the instructor(s), SPTs, and project coordinator to design and implement the projects

25. Where are the 36OpSTEM Scholars Who Began the Program with the 2013 Summer Institute? • 26– on the path to a STEM degree • 2 – no longer STEM Majors • 7 – left CSU • 1 – MC2STEM student ADD: • 11 – Qualified Summer Calculus Scholarship Recipients • 38– TOTAL now in 2013 OpSTEM

26. 2014 STEM Education Summer Conference When: June 24 & 25, 2014Who: Cleveland Indians and Progressive InsuranceWhere: Progressive Field and CSUContent: K-12 hands-on STEM curriculum, with a focus on grades 5-8 STEM lessons and activities for the Cleveland Indians STEM Education Day in May 2015

27. 2014 STEM Education Summer Conference Leads to Continued Partnership with Indians & Progressive Insurance • Cleveland Indians provided: 6 Dugout Suites and the Visitor’s Clubhouse (lovely locker room), ½ cost of breakfast & lunch • In-kind contribution: $10,000

28. 2014 STEM Education Summer Conference Leads to Continued Partnership with Indians & Progressive Insurance • Progressive Insurance, OpSTEM, & CSUTeach will provide: • hands-on middle school curriculum and 2014 Professional Development for educator implementation during 2014-2015 • creation & implementation of “STEM Education Day” at Progressive Field prior to Indians 1 p.m. game May 2015 • Financial contribution: $1600 • In-kind contribution: $1200 + volunteer hours TBD for future curriculum design, writing, and implementation • during 2014-2015 academic year

29. 2014 STEM Education Summer Conference Support • Thank you • Wanda Shippy, Social Responsibility Manager, Progressive Insurance for: • providing curriculum writer • 2014 conference presenters • ongoing event planning, project management, curriculum support, design and implementation for 2014 Professional Development & STEM • Education Day in May 2015

30. 2014 STEM Education Summer Conference Support Thank you Dr. Meredith Bond Dean, College of Sciences and Health Professions Dr. AnetteKarlsson Dean, Washkewicz College of Engineering Dr. Sajit Zachariah (Zac) Dean, College of Education & Human Services for providing the much appreciated funds for K-6 meals, materials, and educator and presenter stipends.

31. NEXT STEPS • Recruit, improve and implement 2014 Summer Institute • Utilize LSAMP Math Education Coordinator, Candice Quinn, • (newly created position) to enhance Precalc I - Calc II • Cover all future SPT sessions for PrecalcI & II both semesters • EnchancePrecalculus, Calculus & PBL content and delivery • Increase SPT training, support & mentoring • Create OpSTEM Scholar Profiles of Success • Execute 2014 STEM Ed. Professional Development and 2015 STEM Education Day with Cleveland Indians and Progressive

32. NSF 3rd Year Review Process • We have received funding for first 3 years • Final 2 years of funding contingent on successful • 3rd year review • NSF has a set of 16 questions we must answer • Submission due to NSF January 2015 • Interview in March 2015 with 2-3 NSF Program Officers • Several of the questions involve Advisory Board input

33. 10-minute BREAK Please enjoy more water/coffee/tea, breakfast, etc.

34. Carousel Brainstorm Questions • What has been the impact of Operation STEM? • What sources of evidence can be used to assess OpSTEM’sprogress? • What current and future challenges do you envision? • What improvements/changes could be made? • What are steps to ensure sustainability?

35. Thank you! Our NSF 3rd Year Review submission is due on January 30th. We need your input prior to that date. Next Operation STEM Advisory Board Meeting: Wednesday, January 14 or 21, 2015?