90 likes | 242 Views
California Institute for Mental Health (CiMH) MHSA Innovation Evaluation Project. Karen Linkins, PhD Shoshana Zatz April 7, 2014. Key Goals of the INN Evaluation Project. Identify, inventory and evaluate all planned, in-process or completed county evaluations of MHSA Innovation projects .
E N D
California Institute for Mental Health (CiMH) MHSA Innovation Evaluation Project Karen Linkins, PhD Shoshana Zatz April 7, 2014
Key Goals of the INN Evaluation Project • Identify, inventory and evaluate all planned, in-process or completed county evaluations of MHSA Innovation projects. • Use information obtained from the inventory and evaluation to identify and document promising evaluation practices. • Develop and disseminate tools and provide technical assistance to support counties to conduct effective and successful evaluations
Research Aims • Inventory: Identify and describe evaluation approaches used by counties in their evaluations of Innovative Programs. • Evaluation: Identify and describe the efficacy of evaluation approaches
Key Activities/Products and Timeline • Report of Proposed Inventory Method and Research/Evaluation Design: Draft Under Review • Inventory of County-Level Innovation Evaluations (due 10/31/14) • Report of Research/Evaluation Results and Promising Practices (due 12/31/14) • Develop and Provide Tools, Training, and Technical Assistance to Counties (over the course of the project) • Report of Innovation Evaluation Policy Recommendations (due 2/28/15)
Process for Collecting and Verifying Data and Creating Inventory 1: Review Innovative Program Evaluation Verification Data Request format and administration process with Counties 2: E-mail pre-populated Verification Data Request and gather basic information on the INN program and evaluation (e.g., status, contact information, etc.) 3: Verify programs meet criteria for inclusion in evaluation (i.e., program has a new or changed mental health practice) 4: Develop and pilot draft data request with 2 Counties (volunteers) 5: Finalize data request 6: E-mail data request (tailored to each county); Conduct follow up telephone calls, as needed 7: Summarize and create an Inventory, with descriptions of key elements, for all Innovative Programs and Evaluations
Process for Conducting and Reporting on the Evaluation 1: Code narrative/open ended data 2:Assess the soundness of Innovative Program Evaluation elements 3: Analyze the relationships among the input and outcome variables 4: Conduct selected special studies 5: Disseminate findings
TIMELINE APRIL • CiMH Meets with Counties to Review Inventory Format and Process • CiMH Compiles from Existing Sources Information to Verify the Universe of Innovative Programs MAY • CiMH sends Counties information to verify and counties send back verification information JUNE and JULY • CiMH Conducts Data Collection
Questions and Feedback? Karen Linkins: karen@desertvistaconsulting.com Shoshana Zatz: szatz@cimh.org