FUTURE SUCCESS: WHAT IS REQUIRED?

2. National Institute for Occupational Safety and Health N IOSH FUTURE SUCCESS: WHAT IS REQUIRED? A Case for Collaborative Multisite Evaluation

3. Presenters: Vicky Buchan, Ph.D. Sue Tungate, MSW

4. NIOSH Agricultural Centers By Regional Boundaries

5. MULTISITE EVALUATION TEAM Past and Present Vicky Buchan - HI-CAHS Barbara Brooner - Pacific Northwest Center Henry Cole - Southeast Center Carol Donnelly - Southeast Center Giulia Earle-Richardson - Northeast Center Tara Erb - Northeast Center Virginia Fischer – National Farm Medicine Center Karen Gilmore - Southwest Center Susan Hewitt - HI-CAHS Adrienne Hidy - Pacific Northwest Center Barbara Kennedy - Deep-South Center Rose Krebill-Prather - UC Davis Center Marian McDonald - Southeast Center Marian McDonald - Southeast Center Sharon Morris - Pacific Northwest Center Deb Multerer - National Farm Medicine Center Pat O’Connor-Marer - UC Davis Center Barbara Pies - Great Plains Center Risto Rautiainen - Great Plains Center Pete Rentos - Deep-South Center Mary Lynne Thames - Southwest Center David Tipton - Southeast Center Christine Townsend - Northeast Center Sue Tungate - HI-CAHS Katheryn Wilson – Southeast Center Nancy Young - National Farm Medicine Center A special thanks to HI-CAHS support staff and interns Angi Buchanan Helen-Holmquist Johnson Tammy Brannen-Smith Chris Bartholomew Marilyn Davis Mary Gardner

6. Where we came from • NIOSH focus on agriculture • 1989, Agriculture at Risk: A Report to the Nation • Based on 1988 Iowa conference to develop agricultural occupational and environmental health policy strategies for the future

7. NIOSH Agricultural Initiative • Original Extramural programs • Agricultural Safety & Health Centers • Farm Family Health and Hazard Surveillance • O. H. Nurses in Agricultural Communities • Agricultural Health Promotion Systems • Cancer Control Demonstration Projects

8. Kennedy ReportThe first recommendation addressed the need for evaluation. • NIOSH and the Centers need to work together to develop an evaluation scheme for: • The various component programs and projects [within site] and • The Centers overall [multi- or cross-site]

9. Issues Important to ACE • Congressional intent that Initiative have “a significant and measurable impact” • BSC recommendation for overall strategic planning process • BSC recommendation for better internal and external communication

10. The Beginnings of ACE

11. NIOSH Agricultural Center Initiative Objectives • Conduct research • Implement model education outreach • Evaluate control technologies • Implement model programs • Evaluate • Provide consultation and training • Develop linkages and communications • Dissemination

12. NORA CATEGORY PRIORITY RESEARCH AREAS Allergic and Irritant Dermatitis Asthma and Chronic Obstructive Pulmonary Disease Fertility and Pregnancy Abnormalities Hearing Loss Infectious Diseases Low Back Disorders Musculoskeletal Disorders of the Upper Extremities Traumatic Injuries Emerging Technologies Indoor Environment Mixed Exposures Organization of Work Special Populations at Risk Cancer Research Methods Control Technology and Personal Protective Equipment Exposure Assessment Methods Health Services Research Intervention Effectiveness Research Risk Assessment Methods Social & Economic Consequences of Workplace Illness & Injury Surveillance Research Methods DISEASE & INJURY WORK ENVIRONMENT & WORKFORCE RESEARCH TOOLS & APPROACHES

13. GOAL OF COLLABORATIVE MULTISITE EVALUATION To coordinate center evaluation efforts seeking standardization of methodology to enable continual monitoring of progress and impact of the whole INITIATIVE without losing individual uniqueness of each center

14. OBJECTIVES • Document Initiative progress • Facilitate Inter-Center/NIOSH collaboration • Increase Initiative effectiveness • Assist Initiative program planning

15. Short Term Measures Mid Term Measures Long Term Measures

16. MULTISITE EVALUATION NIOSH Agricultural Initiative Mission HEALTHSAFETYPREVENTION Initiative PR Report Annual Multisite Initiative Report Informationfor Center Reporting NIOSH Objectives -- NORA Initiative Multisite Database Indicators and Key Variables

17. Database Variables • Indicators • Collaboration • Dissemination • Leveraging • Regionalization • Replication • Research Need • Special Sector • NIOSH • NIOSH Objectives (number) • NORA – Priority Research Area (for Research) • Identifying Information • Center & PHR • Title & Description • Center or Project Objectives • PI or Contact Person • Status • Key Variables • Strategy (Research, Intervention, Education, Evaluation) • Topic or Key Word • Activities • Professional Education or Training • Products • Target Group Demographics & Number of Contacts

18. MULTISITE CHALLENGES • After-the-fact evaluation projects (or retrospective evaluations) • Variation in program implementation (even if similar objectives across sites) • Contextual differences between sites lead to further adaptation • Multiple theoretical perspectives • Differential “buy-in” to need for and purpose of evaluation

19. Communication Conference Calls E-mails Meetings Planning Travel Agenda Timelines Documentation Database Design and Documentation Orientation Data Aggregation Collate Team Output Organization Archiving Annual Reports The Process

20. RESEARCH QUESTIONS • 1. Target population contacts - By NIOSH Objective? By • strategy? • 2. Research projects - By NORA • 3. Special Sector activities • 4. Products achieved • 5. Target groups of Initiative • 6. Collaborative efforts – NIOSH & Centers or others • 7. Education & Training under Center Auspices • 8. Value of leveraged funds & services • 9. Regionalization – States where Center activity occurred

30. THE FUTURE