Jessica Sickler Senior Research Associate Institute for Learning Innovation Pittsburgh, PA

1. Jessica Sickler Senior Research Associate Institute for Learning Innovation Pittsburgh, PA • Evaluator for Worldviews Network • Background in museum education, evaluation, research, and K-6 classroom teaching • Recent research and projects: • Impact of immersion in full-dome planetarium shows • Public Engagement with Science • Motivations and engagement in Citizen Science

2. Worldviews Network Evaluation:What to Expect

3. Public Audience Outcomes

4. Formative Evaluation: Year One Events • Four Sites • Multiple Methods: qualitative and quantitative • Purpose: • Better understand learning outcomes from events • Targeted outcomes • Main messages • Post-event behavior • Feedback about creating effective, engaging events • Compelling aspects of events • Qualities that inspire further engagement

5. Formative Evaluation: Year One Events What should Partners expect?

6. Formative Evaluation: Year One Events What should Partners expect? • Post-show, self-administered questionnaire • ILI staff on-site for event • Partner support w/ distribution at show to all adults

7. Formative Evaluation: Year One Events What should Partners expect? • Post-show, self-administered questionnaire • ILI staff on-site for event • Partner support w/ distribution at show to all adults • Post-show focus group • In advance of event: Partners work with ILI to develop and implement recruitment strategy • Space, time, logistics for 45-minute focus group

8. Formative Evaluation: Year One Events What should Partners expect? • Post-show, self-administered questionnaire • ILI staff on-site for event • Partner support w/ distribution at show to all adults • Post-show focus group • In advance of event: Partners work with ILI to develop and implement recruitment strategy • Space, time, logistics for 45-minute focus group • Follow-up telephone interviews • ILI will contact participants

9. Formative Evaluation: Year One Events What should Partners expect? • Post-show, self-administered questionnaire • ILI staff on-site for event • Partner support w/ distribution at show to all adults • Post-show focus group • In advance of event: Partners work with ILI to develop and implement recruitment strategy • Space, time, logistics for 45-minute focus group • Follow-up telephone interviews • ILI will contact participants • ILI report of findings

10. Remedial and Summative Evaluation: Years Two and Three • 4-5 Sites each year • Quasi-Experimental: Pre / Post / Delayed-Post • Purpose: • Measure achievement of outcomes • Changes from pre- to post- to delayed-post • Feedback about success and support for further refinement • Lessons for the Field • Evidence of factors that may influence outcomes

11. Remedial and Summative Evaluation What should Partners expect?

12. Remedial and Summative Evaluation What should Partners expect? • Pre- and Post-show, self-administered questionnaires • Rachel on-site for events to lead collection • Partner support w/ distribution, collection at show to all adults

13. Remedial and Summative Evaluation What should Partners expect? • Pre- and Post-show, self-administered questionnaires • Rachel on-site for events to lead collection • Partner support w/ distribution, collection at show to all adults • Delayed-post online questionnaire • ILI will contact participants

14. Remedial and Summative Evaluation What should Partners expect? • Pre- and Post-show, self-administered questionnaires • Rachel on-site for events to lead collection • Partner support w/ distribution, collection at show to all adults • Delayed-post online questionnaire • ILI will contact participants • ILI report of findings