310 likes | 330 Views
Learn strategies to collect, manage, and analyze data to inform decision-making and create effective action plans. Improve your data literacy and use data to tell your organization's story.
E N D
Data-Informed Decision-Making and Strategic Action Planning Emma Connell and Nicole MartinRogersWILDER RESEARCH
WilderResearch – a division of Wilder Foundation • Mission: To improve the lives of individuals, families, and communities through research • We help state and local government agencies, schools, nonprofits, foundations, health systems, and community action agencies: • Better understand community trends • Identify needs, opportunities, and solutions at the policy, community, and program level • Measure program effectiveness • Increasing public awareness of issues
Goals for today Help you learn strategies to: • Define what data you want to collect • Increase your data literacy • Improve your data management and quality • Use data effectively to inform decisions at all levels of your organization • Tell your organization’s story using data
Agenda • What is data-informed decision-making? • How to assess your organizational readiness for data-informed decision-making • Improving your organization’s data literacy • Strategies you can use to support data-informed decision-making in your community action agency
What is Data Literacy? The ability to find meaningful information in data
What is Data-Informed Decision-Making? Collecting and analyzing different types of data and using that data to guide decisions for improving programs and policies that ultimately lead to better outcomes Do it as a part of your organization’s standard operating procedures, ingrained in staff’s minds as “they way we do it here” “data culture”
Quick discussion on data literacy and data-informed decision-making • Discuss with the person next to you: • What does your organization do well with your data in terms of using it to make changes? Please discuss and write down one or more specific examples (if you have them). • What areas do you want to improve in terms of how you or your organization (staff/leaders) uses your data to make improvements over time?
Organizational readiness • Leadership commitment • Common understanding • Staff buy-in • Learning and trusting culture • Time and structure • Facilitation • Data literacy
A logic model illustrates your theory of change You want to be here. IF the activity/program is provided THEN what should be the result (impact) for participants? What ACTIVITIES need to happen, and in what INTENSITY and DURATION, for participants to experience the desired OUTCOME? What EVIDENCE do you have that this activity/program will lead to the desired result? You are here. What needs to happen to get from here to there?
Elements of a logic model Purpose statement:What we do, for whom, and for what purpose/benefit?
Example: Citizens League Capitol Pathways logic model program evaluation • Participant survey • Supervisor survey • Alumni survey • Host site interviews
Tool: Team-Based Inquiry – Question (see worksheet) • Collaborative process to bring consensus around data priorities • Use TBI to • Brainstorm and prioritize research/evaluation questions of interest • Identify importance and intended use(s) of data • Identify appropriate data source(s)
Critical steps to ensure quality data • Select appropriate data collection tools • Develop a data collection plan, including a timeline and roles and responsibilities • Collect the information • Process the information (data entry) and clean up the data • Don’t forget about quality control!
Sort and analyze the information • Organize your information effectively • Analyze and identify key findings • Interpret results • Consider implications • Make recommendations and implement changes
Participatory data analysis • Engaging stakeholders (users, participants, staff, community members, etc.) in the process of analyzing and interpreting data in order to determine meaning and implications • Purpose • Participatory methods help to include in multiple perspectives, opinions, and voices • Build trust and create buy-in among stakeholders • Demonstrates commitment to using results/data
Quadrant Analysis: What is it? • Helps to categorize data that have common qualities in order to use it and make meaning or sense from it • Is a form of participatory data analysis SOURCE: Gray, D., Brown, S., & Macanufo, J. (2010). Impact & Effort Matrix. Game Storming: A Playbook for Innovators, Rulebreakers, and Changemakers, 241. Sebastopol, CA: O’Reilly
Quadrant analysis: Preparation and analysis A goal, topic, or decision that needs to be discussed by your group Data that can be easily dichotomized: ex. high/low, most/least-type categories • Examine your data and decide what goes on the X and Y axes of your quadrant ahead of time
When interpreting results be sure to… • Involve stakeholders • Consider (practical and statistical) significance of findings • Beware of data inconsistencies • View the data in context • Let the data (not your preconceived ideas) drive the identification of key findings and the meaning of these findings
What do your results mean? • Are there emerging patterns/themes? • What is surprising? • What is consistent with other data? • Are your findings significant? • Do the results suggest potential program improvements? • Do the results lead to new questions? • When should this evaluation be repeated? TOOL: Team-Based Inquiry: Reflect & Action
Example: East Metro Pulse • Data parties • Storytelling through data
Use and share the information How should you share your evaluation results? Who needs to know what you learned? • What is the best way to tell them the story? • Are there multiple ways to share the information? • Formal reports • Executive summary • Infographics • Dashboards • Narrative stories • PowerPoint • Live presentation • Website • Social Media/Webinar
Keep in mind… • Tailor your reporting to your audience • And remember that all audiences prefer short, clear, and visually appealing reporting! • Feel free to combine data sources and your informed opinion • Be very clear about your sources
Thank you! Contact Us: www.wilderresearch.org www.mncompass.org Nicole MartinRogers Nicole.MartinRogers@wilder.org 651.280.2682 @nmartinrogers Emma Connell Emma.Connell@wilder.org 651.280.2717