1 / 28

Monitoring and Evaluating Inclusive Program Practices

Monitoring and Evaluating Inclusive Program Practices. David J. Bernstein, Ph.D. DJB Evaluation Consulting Rockville, Maryland Presented November 2, 2018 2018 American Evaluation Association Conference Cleveland, OH. Introduction.

angelac
Download Presentation

Monitoring and Evaluating Inclusive Program Practices

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Monitoring and Evaluating Inclusive Program Practices David J. Bernstein, Ph.D. DJB Evaluation Consulting Rockville, Maryland Presented November 2, 2018 2018 American Evaluation Association Conference Cleveland, OH

  2. Introduction • How will we know that inclusive coordinated transit planning makes a difference? • If yes, are lessons learned about inclusive coordinated transportation planning applicable to other areas?

  3. Inclusive Coordinated Transportation Project Funded by the U.S. Department of Health and Human Services Administration for Community Living Partnership with the Federal Transit Administration Current Partners: CTAA, Institute for Community Inclusion, the National Association of Area Agencies on Aging (n4a), DJB Evaluation Consulting

  4. What is Inclusive Planning? A process in which stakeholders, including participants (people with disabilities and older adults), partner organizations, and coordinated transportation partners are actively and meaningfully involved in transportation planning.

  5. What is a Participant? Older adults and people with disabilities (including people with intellectual and developmental disabilities) who must be actively and meaningfully involved in programs. Serve as key advisers and informants, information resources, and decision-makers. Empowered to act independently and exert influence on decisions, activities, outcomes.

  6. Pathway to Inclusion

  7. Exercise #1 Discuss: Who are the participants in your programs? How are they actively and meaningfully involved in program planning/operations?

  8. Theory of Change

  9. Expanded Inclusive Planning: Results for Everyone Customers Organizations

  10. Project Logic Model Project Goals and Objectives Mi t i ga t i ng Fac t o r s Mi t i ga t i ng Fac t o r s Customer/Rider/Stakeholder Satisfaction Mitigating Factors

  11. Demonstration Projects Four rounds of grants. 25 competitive planning demonstration grants addressing transit planning issues. Initial 6 month planning grant funding to find participants, solidify partnerships, assess inclusion, identify problems, discuss and explore potential solutions. Larger, longer-term grants (1 year +) to inclusively explore problems/solutions.

  12. Grantee Progress

  13. Grantee Performance

  14. Grantee Performance

  15. Grantee Performance

  16. Grantee Performance

  17. Participant Satisfaction with the Planning Process

  18. Participants Who Felt Opinions Had an Impact

  19. Stakeholders/Partners Satisfied with the Planning Process

  20. Grantee Performance Against Target

  21. Inclusive Planning Toolkit http://www.acltoolkit.com/

  22. Inclusive Planning Toolkit:“Measuring Performance” Have a Baseline: First Assess the State of Inclusion Know Where You Are Headed: Use a Logical Approach Have a Model to Logically Link Activities with Results Understand Measurement Versus Evaluation Track Inclusive Performance Over Time

  23. Measuring Progress in Inclusion • Goals and objectives must take into account: • an agreed upon starting point • targets to determine desired results • ways to measure results to be achieved • Participants may have VERY different opinions on extent of inclusiveness • Participants input will lead to improved programs and services!

  24. Measuring/Evaluating Progress • Hard to gauge progress if you don’t have objective information (data). • Data can be used for many purposes: • Monitoring program progress. • Inform decisions. • Accountability/reporting to funders and decision makers. • Keeping stakeholders/riders informed.

  25. Baseline: Assess the Status of Inclusion Discuss the Pathway to Inclusion to inclusively set a baseline. Do participants feel included? Do participants attend meetings? Are meetings held in a time/place so they can participate? Are participants’ opinions sought? Is there time to ensure that what organizers are hearing is what the participants intended?

  26. Baseline: Assess the Status of Inclusion Are surveys conducted? Are participants satisfied with inclusion? Do they feel their voices are heard/has an impact? Are participant suggestions tracked/ vetted/implemented? Do participants share in the decision-making process? Do participants play leadership roles?

  27. Track Inclusiveness Over Time Set up a system to routinely and regularly collect objective data. Develop a survey to collect feedback on inclusiveness and use it regularly. Monitor results Track both inclusiveness as well as program results. Investigate irregularities in your results.

  28. Contact Information David J. Bernstein, Ph.D. DJB Evaluation Consulting djbeval@gmail.com (301) 738-3520 @DJBernstein on Twitter

More Related