980 likes | 1.05k Views
Explores a national initiative integrating HIV/AIDS and substance abuse prevention in minority communities, focusing on African-American and Hispanic women, and minority youth. The research design includes baseline and follow-up surveys in English and Spanish. The presentation shares preliminary data on risk factors, demographic composition, drug use, risky behaviors, and program effectiveness. Emphasizing process evaluation, the objectives include detailing intervention strategies, recruitment and retention techniques, and challenges faced in program development and evaluation. The initiative aims to increase prevention capacity and identify effective service delivery mechanisms.
E N D
Integrating HIV/AIDS and Substance Abuse Prevention in Minority Communities: A U.S. National InitiativeFunded by the Substance Abuse and Mental Health Services Administration,Center for Substance Abuse PreventionLucille Norville Perez, MD Fabian Eluma, MDJSI Research & Training InstituteProject Coordinating Center
Understanding Client Needs:Baseline Risk Factors Thomas W. Mangione, Ph.D. Rodolfo Vega, Ph.D. Anita Raj, Ph.D. Hortensia Amaro, Ph.D. Kim Watson Lucille Perez, M.D.
Goals of Initiative • To increase capacity in minority communities to prevent HIV and/or substance abuse • To deliver prevention services to African-American women and Hispanic Women • To deliver prevention services to minority youth • To identify effective mechanisms to deliver prevention services to these communities.
Research Design • Baseline, 3 month follow-up, 9 month follow-up • Constructed comparison groups • Scannable, Self-Administered surveys • Adult, Youth (13+) & Children’s versions • Translated into Spanish • Program staff available to help complete survey if needed • Centralized Processing for Scanning, Cleaning Data
Additional Types of Data Being Collected • Process Data on # persons serviced and types of services • Yearly site visits • Client focus groups in some sites • Cost Data for delivery of service units • Access Capacity for Providing Services both Directly and through Other Community Agency Linkages
Baseline Data Status • 3 Different Baseline Groups of participants • Adults • Youth (13+) • Children • Before Study is finished we expect between 1000-1500 baseline surveys for participants and similar n’s for comparison groups • Today’s presentation based on 1000 youth & 1000 women combining participants & comparison group members • Additional baseline and follow-up data is being collected • Additional completed surveys are being cleaned • Today’s data should be considered preliminary
Women’s Drug Use In Past 30 Days Rates calculated to include entire sample in denominator. * This number was changed after APHA 2001 presentation.
Women’s Sexual Risk Taking Behaviors - Past 30 Days (of sexually active) * Calculated to include entire sample in denominator.
Women’s Perceptions of “Great Risk” When Having Sex with Other Partners or Sharing Needles
Youth Alcohol & Drug UseIn Past 30 Days Rates calculated to include entire sample in denominator. * This number was changed after APHA 2001 presentation.
Youth Sexual Risk Taking Behaviors In Past 30 Days (among sexually active) * Calculated to include entire sample in denominator.
Youth Perceptions of “Great Risk” for Sexual & Drug Use Behaviors
SAMHSA/CSAP Initiative is Providing HIV & Substance Abuse Preventionin Minority Communities at Risk
Integrating HIV and Substance Abuse Prevention Programs: How Racial/Ethnic Minority Communities are Meeting the Need Anita Raj, Ph.D. Rodolfo Vega, Ph.D. Thomas W. Mangione, Ph.D. Jacqueline J Nolan, MPH Maya Y Mauch, MPH Lucille Perez, M.D.
Process Evaluation • Goals were to determine: • What strategies, supports, and resources are necessary for agencies to implement HIV and Substance Abuse Prevention programs for women and youth • What strategies, supports, and resources are necessary for community-based agencies to participate in a cross-site program evaluation
Process Evaluation • Research Questions: • What do programs look like? • What recruitment and retention strategies work for different populations? • How are participants responding to the program? • What has facilitated or hindered agencies when engaging in program evaluation?
Research Methods • Quantitative and Qualitative data collection methods • Intervention data from quarterly report • Site visits • Monthly technical assistance calls
Presentation Objectives • Describe intervention strategies used by different population-based programs • Describe recruitment and retention strategies and how special populations are reached • Describe challenges for program development, implementation, and evaluation • Describe characteristics that facilitate successful program implementation
Populations Served • 25 Youth-Focused Sites • 11 Women-Focused Sites • 7 Family-Focused Sites • 4 Other Sites • indicative of multiple populations served • 3 of these sites include men
Youth Programs Women Programs Family Programs Education and Skills Training 13% 15% 6% Multi-session Groups 17% 15% 17% Single Session Groups 16% 9% 6% Individual Risk Reduction Counseling 8% 7% 4% Street Outreach 10% 11% 6% Intervention Strategies
Youth Programs Women Programs Family Programs Case Management 4% 4% 8% Mental Health/ Support Groups 8% 9% 25% Community Building 15% 9% 3% Other 9% 21% 25% Intervention Strategies
Successful Recruitment Strategies • Make services accessible to communities where they are: • Community Centers • Home visits • Street Outreach • Mobile Approaches • Deliver educational messages using peer approach • Referral from family, friends, and other service agencies • Provide services in other organizations that have access to clients • Provide intervention in a safe space without judgement and expectations • Develop a trusting relationship with the community
All Peer driven Recognition of Participants High Program stability Culture, Gender, Developmental Competence Youth Parent supported Women Childcare and Transportation Family provide family activities Characteristics of Programs with Strong Retention
Challenges to Program Development: Curriculum Development • Developing HIV and Substance Abuse prevention integrated curricula was challenge • Programs brought varying levels of expertise in curriculum development • Culturally tailoring programs was a necessary and time-consuming process • Developing mechanism for documenting curriculum changes remains a challenge
Challenges to Program Implementation: Staff Turnover • Staff Turnover was often high • Often funded for part-time jobs, resulting in overworking of employee or inability to fill position • Training and continuing education not included, minimizing opportunity for advancement • Salaries and benefits not strong • Work itself is mentally draining, and some programs have no built in support systems for their staff
Challenges to Program: Inadequate Infrastructure • Infrastructure of agency was often not prepared for increased funding • SAMHSA funding provided a huge increase in agency budget, and many agencies did not have structure to manage budget of this size. • Inadequate MIS systems were common • difficult for sites to manage new budget • communication difficulties with PCC and other sites (within program and outside program) were common • staff were often not available and/or sufficiently trained to manage current MIS systems
Challenges to Evaluation • The GFA did not make explicit the requirement of a cross-site evaluation • Many grantees were unfamiliar with the IRB/FWA/COC processes • FWA rules changed during processing • Many grantees were unfamiliar with evaluation methodology and requirements • Evaluation-related challenges resulted in delays in program implementation
Conclusions • Despite significant challenges, programs have been able to develop and implement integrated HIV and substance abuse prevention programs focused on women, youth, and families. • Program strategies are tailored to the unique needs of target populations • Youth and Women Programs focus more on HIV and Substance Abuse intervention solely • Family Programs focus on more holistic related issues, including mental health and group support • Culture-tailoring is an integral part of program development.
Conclusions • Recruitment strategies are similar across groups, relying on captive groups, referral, and outreach. • Retention strategies are also similar across groups and primarily relate to increasing strength of program (e.g., program stability, recognition and involvement of participants). • Needs of Special Populations (gay youth, street youth, homeless, substance abusers) are primarily reached by providing a safe, nonjudgmental place in which education and skills can be gained.
Conclusions • Major support is needed for programs to be able to accomplish this work. • This support must include • Assistance with Curriculum Development and Documentation of Curriculum Changes • Adequate Staff Resources to minimize Staff Turnover • Adequate Support for Agency Infrastructure changes required by initiatives such as the MAI • Training and Support for Evaluation
Getting Ready to Implement and Evaluate: Lessons Learned Jacqueline J Nolan, MPH Maya Y Mauch, MPH Dianne Perlmutter, MSW, MPH Patria Rojas, MSW, MPH Leslie Roberts, MPH Lucille Perez, M.D.
Overview • One component of the SAMHSA Integrated HIV/AIDS and Substance Abuse Targeted Community Capacity Initiative is to provide technical assistance (TA) to the 47 funded programs • TA needs ranged from program implementation to program evaluation. • Most TA provided was in the area of evaluation.
Technical Assistance • The TA section of today’s panel discussion will profile: • The programs: settings, target population, and curricula • The TA framework • The TA needs of the programs • The TA strategies used to address the needs of the programs
Programs’ Settings • Health Centers/Hospitals • Community Wide • Homes • Housing Developments • Shelters • CBO • ASO • Community Centers • Street Outreach • Schools • Head Start • Churches/Faith Based • Prisons
Examples of Science-Based Curricula Used by the Programs • ASK US • Be A Responsible Teen (BART) • Be Proud Be Responsible • Education Now And Babies Later (ENABL) • Family Strengthening Programs • Focus on Families • Life Skills and HIV • Prochaska Trans Theoretical Model • Safety Net
The Technical Assistance Framework • Building and maintaining a trusting relationship • Maintaining and delivering TA through regular communication and contact with the programs • Developing an in-depth understanding of the proposed intervention, the program, the affiliated agency/organization, and the evaluation plan • Developing a technical assistance plan
Building and maintaining a trusting relationship • Acknowledge the program’s expertise, experience and commitment to the work • Assess the program’s knowledge and perception of research and evaluation • Frequent check-in calls • Clarify and reinforce the goals and purpose of the technical assistance
Developing an in-depth understanding of all aspects of program • What is the intervention model or design? • What science-based curriculum is being used? • How has the intervention design changed from the original proposed plan? • How has the intervention or curriculum been modified to be culturally relevant/appropriate? • What is the evaluation plan and design? • Staffing structure • What partnerships or collaboration have been developed as a result of this program? • Location of program within the organization • How has agency capacity increased as a result of this program?
Frequent communication and contact with the program • Using the “dental” approach (frequency of contacts/proactive vs.. reactive) • Using a diverse array of modes of communication including, the listserv, telephone, website, fax, and face-to-face site visits • Cluster meetings within states or regions • Grantee meetings/steering committee meetings
Development of a technical assistance plan • Developed jointly between program and technical assistance coordinator • Framed within the context of the goals of the overall project • Incorporating local and national resources to support the technical assistance plan
Technical Assistance Needs of the Programs: • Development, adaptation, and documentation of curriculums integrating HIV/AIDS and Substance Abuse prevention • Recruitment and retention of program staff • Service delivery issues • Outreach and recruitment of clients • Development of adequate job descriptions • Building and maintaining collaborative relationships • Development of capacity and infrastructure in the areas of MIS and fiscal monitoring • Development of increased understanding of the federal funding and reporting procedures
Evaluation TA Needs of the Programs • Developed an increased understanding of the need for and purpose of an internal review board (IRB), federal-wide assurance (FWA), and a certificate of confidentiality (COC). • Developed an understanding of comparison group issues • Supported data collection via survey administration