170 likes | 336 Views
Study Process Evolution – How a Study is Put Together. 2007 USDA/State Agency Conference- Nashville, TN Jay Hirschman & John Endahl Office of Research, Nutrition, & Analysis. Outline of Topics to be Discussed. Expectations of Breakout Session – Input from Audience Research Process
E N D
Study Process Evolution – How a Study is Put Together 2007 USDA/State Agency Conference- Nashville, TN Jay Hirschman & John Endahl Office of Research, Nutrition, & Analysis
Outline of Topics to be Discussed • Expectations of Breakout Session – Input from Audience • Research Process • Funding Resources • Research Agenda • Contract Award Process • Contract Milestones • Questions and Answers
What ORNA Does:ORNA Mission Statement To support the management of FNS programs by providing valid, timely, and unbiased information that informs Agency decisions on policy, legislative, budgetary, regulatory, and program management processes, and to serve as the lead point at FNS for strategic planning and nutrition policy and services.
What ORNA Does:Core Functions • Policy analysis • Research and evaluation • Nutrition policy • Planning/regulatory affairs
Research and Evaluation • Manage identification of Agency research needs • Ensure credible research designs • Interpret findings for policy use • Design and direct study and evaluation projects (over 40 ongoing in FY 2007) • Liaison with other research agencies
FUNDING FOR RESEARCH • FY 1997 (FY2007 Dollars) • $18.0 ($23.0) million available total • $4.2 ($5.4) million for CN studies • $3.0 ($3.8) million for WIC studies • $10.8 ($13.8) million for FS studies • FY 2007 • $6.2 million from administrative account • $1.7 million from program funds
Other Sources of Funding • Federal Agencies • Economic Research Service • Cooperative State Research, Education, and Extension Service • CDC (SHPPS Study) • Department of Education (ECLS Studies) • Outside Federal Government • Robert Wood Johnson Foundation
Funding Large-Scale National Evaluations is Expensive • APEC ($5.6 m) • SNDA-III ($5.0 m) • NSLP/SBP Meal Cost Study ($3.7 m) • School Breakfast Pilot Project ($6.8 m) • School Food Purchase Study ($1.0 m – 1995)
Sources of Research Ideas • Required by Law • Congressional Report Language • Update of core program information • Update of performance measures (PAR) • Program Stakeholders (Federal, State, & Local Advocates • Extension of other research
Selected Ongoing Studies • Improve Program Access • Pennsylvania SFSP Rural Eligibility Pilot Project • Nebraska CACFP Rural Eligibility Pilot Project • Improve Program Integrity • Evaluation of Direct Verification • School Lunch and Breakfast Meal Cost Study-II • NSLP/SBP Access, Participation, Eligibility, and Certification (APEC) Study • Build a HealthierUS/Obesity Prevention • School Nutrition Dietary Assessment (SNDA) Study-III
Contract Award Process • Advance Acquisition Plan • 8A and Small Business Set-a-sides • Development of Request for Contract • Final Request for Proposals • Free, open competition • MOBIS – pre-qualified group of firms • Sole-Source Procurement • Technical Review Panel • Contract Award
Contract Award Timeline 4 ½ - 7 months 30-60 days 30-45 days 30-45 days 30-45 days 15 days Dev. of RFC RFC on Street Tech. Review Negotiations Contract Award
Critical Milestones for Large National Evaluations • Orientation Meeting (1 mo.) • Study Design and Sampling Plan (1-3 mo.) • Data Collection Instruments and OMB Package (6 mo.) • Select Sample (1-2 mo.) • Select and Train Data Collectors (1-2 mo.) • Collect Data (6-12 mo.) • Create Database and Analyze Data (6 mo.) • Prepare Final Report (6 mo.)
Contract Milestone Timeline for a Large National Evaluation 3 Years Year 1 Year 2 Year 3 Evaluation Plan Dev. OMB Approval Sampling Data Collection Analyze Data Final Report Writing
Case Study 1: APEC • Research Origin – IPIA Requirement • Funding Source – Line Item Appropriations and NSA funds • Funding Amount - $5.6 million • Contract Type – MOBIS • Period of Performance – 9/04 – 12/07 • Key Deliverables • Erroneous Payment Estimates • Econometric Model
Case Study 2: SNDA-III • Research Origin – Update Performance Measures • Funding Source – FNS Research Budget • Funding Amount - $5.0 million • Contract Type – MOBIS • Period of Performance – 9/04 – 12/07 • Key Deliverables • Nutritional Profile of School Meals • Characteristics of NSLP/SBP Participants