1 / 19

Evaluating the Aboriginal Programs and Initiatives at the Department of Canadian Heritage

Evaluating the Aboriginal Programs and Initiatives at the Department of Canadian Heritage Canadian Evaluation Society Conference 2003 Vancouver, British Columbia. Purpose of Presentation. Provide context to the evaluations within the Aboriginal Affairs Branch at PCH

Download Presentation

Evaluating the Aboriginal Programs and Initiatives at the Department of Canadian Heritage

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Evaluating the Aboriginal Programs and Initiatives at the Department of Canadian Heritage Canadian Evaluation Society Conference 2003 Vancouver, British Columbia

  2. Purpose of Presentation • Provide context to the evaluations within the Aboriginal Affairs Branch at PCH • Present two methodological approaches • Aboriginal Languages Initiative – project site visits • Aboriginal Women’s Program – Family Violence Initiative – learning circle • Discuss evaluation challenges and lessons learned • Discuss next steps

  3. Aboriginal Affairs Branch - PCH • 13 programs and initiatives • Focussed mainly off-reserve • Pan-Aboriginal in nature • Developed over some thirty years • Multifaceted approach to complex Aboriginal issues • Facilitate participation in Canadian society • Strengthen Aboriginal cultural distinctiveness

  4. Types of Program Support • Sustaining – established Aboriginal organizations • Representative, women’s, friendship centres, broadcasting • National, provincial/territorial, regional • Project • Partnering • Accords with territorial governments – mutual goals • Aboriginal organizations

  5. Program Delivery – 3 approaches • Canadian Heritage administration • Aboriginal Affairs Branch • Regional offices • Aboriginal organizations • Six western cities – youth advisory councils

  6. Comprehensive Review • Retrospective study • Environmental scan • Consultations – Aboriginal organizations/groups • Evaluation of 13 programs and initiatives

  7. Evaluation Challenges • Complex approach to program delivery • Ensuring a collaborative approach (involvement of delivery partners) • Ensuring cultural sensitivity • Availability of baseline data and performance indicators

  8. Evaluation of the Aboriginal Languages Initiative • Evaluation Methods • Document and File Review • Secondary Research and Statistical Review • Key Informant Interviews • Case studies of delivery organizations (AFN, ITK and MNC) • Project Site Visits – 10 • Working group and steering committee comprised of representatives from PCH (Aboriginal Affairs Branch and Corporate Review Branch) AFN, ITK, MNC)

  9. ALI Project Site Visits • 2 Inuktitut sites, 2 Michif sites, 6 First Nations languages sites • Sites were selected to include all regions and geographic locations (near urban, rural, and isolated) and from each type of “project cluster”

  10. Opportunities and Benefits • Opportunities • Conduct face-to fact interviews with those involved directly and indirectly with the project • Conduct focus groups/dialogue circles with project beneficiaries and other community people • Benefits • Observe projects and activities directly • Place project in context of the community within which it operates • Obtain information on program impact directly from beneficiaries - how they define success - • Obtain information in a culturally sensitive manner • Communities see themselves as part of evaluation process

  11. Evaluation of the AWP Family Violence Initiative • Evaluation Methods Document& File Review LearningCircle Key Informant Interviews

  12. What is a Learning Circle? • Gathering of people from different organizations • Opportunity for open sharing and exchange • Inclusion of range of projects and perspectives

  13. Learning Circle Process Sharing knowledge Stories and journeys What have we learned? Common threads Issues and challenges Future direction

  14. Learning Circle Opportunities and Benefits Benefits: Connection at the community level Meaningful results Lessons learned Inspiration & momentum Future program directions Opportunities to: Share experiences and insights Learn Explore ideas Reduce isolation

  15. Disadvantage of methodological approaches • Costly and time consuming • Results from site visits or learning circles are not statistically representative of the results of the program as a whole – findings need to be balance with other lines of evidence • One time assessment rather then continuous measurement of results

  16. Lessons Learned • Importance of including Aboriginal communities in evaluation work – legitimizes results • Qualitative data should be balanced with quantitative information • Evaluations can be designed that meet both government and Aboriginal community information needs • Importance of information sharing

  17. Aboriginal Affairs Branch Next Steps… • Analysis of information • Development of position paper • Consultation • Development of a new consolidated policy

  18. Evaluation reports available electronically Department of Canadian Heritage Website www.pch.gc.ca

  19. Presenters • Audrey Greyeyes, Aboriginal Affairs Branch, PCH (819) 994-2121 audrey_greyeyes@pch.gc.ca • Dianne Lepa, Corporate Review Branch, PCH (819) 994-7485, dianne_lepa@pch.gc.ca • Wanda Jamieson, JamiesonHartGraves Consulting (613) 730-2595 wjamieson@jhgconsulting.com

More Related