260 likes | 273 Views
Swedish intervention programme initiated and financed by the Swedish spirits & wine suppliers (SSWS) and Brewers of Sweden - Since 2006. Agenda: Recap of the programme (target group, delivery mechanisms, teaching tools, period, etc ). - Evaluation methodology and results.
E N D
Swedish intervention programme initiated and financed by the Swedish spirits & wine suppliers (SSWS) and Brewersof Sweden - Since 2006 • Agenda: • Recap of the programme • (target group, delivery mechanisms, teaching tools, period, etc). • - Evaluation methodology and results
Talk About Alcohol (SWE) • A school-based program adjusted to compulsory and secondary school • Purpose • Delay the age of alcohol consumption and prevent young people from alcohol-related harm • Change the attitude and behavior to alcohol among youth • Reduce over consumption and motivate to responsible drinking • Teachers workbook, containing • Classroom activities • Family skills programme • School policy programme
Reach • 75 % of the schools within the target group have ordered the programme • Approximately over 5 000 teachers and 250 000 students have used the programme in Sweden • Implemented as autonomous programmes in Finland, Denmark and soon Estonia • 16 000 copies of the short story book ordered by schools
Short story competition Over 5 000 students have participated and we have produced a short story book each year containing the best stories Advertising/campaign contest Students create campaigns to influence other people about Don’t Drink & Drive Last year winner >> Additional activities 2008 2009 2010 2011
Key strategic partnerships • Governmental partnerships at a regional level all over Sweden • Governmental partnership at a national level with ‘The Swedish Transport Administration’ • ‘The Swedish National Agency for Education’ use the programme as a reference within the topic
Yearly teacher survey Yearly quantitative web survey to measure the usability and believed effects among the teachers using the programme Key results from web survey 2011, (n=140) • 70 % of the respondents believe that the programme influence the pupils to delay the age of alcohol consumption • 70 % of the respondents believe that the programme lead to better attitude and motivates to responsible drinking • 99 % of the respondents say that they would recommend the programme to colleagues
Scientific evaluation 2010 To examine the extent to which Talk About Alcohol (SWE) can influence young people: (partly using the template approach) • Not to consume alcohol • To encourage the young people who consume alcohol; • to reduce over consumption • to reduce risk behavior • motivate to responsible drinking
Research team Two independent research consultants In cooperation with and supervised by two scientists from Örebro University faculty School of law, Psychology and Social work and Martin Stafström PhD, faculty alcohol and illicit drug researcher at Lund University
Basic study conditions • The study was executed in two phases: • Phase 1 – Pre-test in January 2010 • Phase 2 – Follow up test May/June 2010 • The evaluation followed students exposed (interventions group) and not exposed (control group) to the intervention • Target group: 15-16 years old (last year in compulsory school)
Barriers running the study • Intervention and control groups were easily found from our existing network of schools and teachers • Most schools are willing to let an evaluation take place but it’s difficult to find teachers willing to participate due to lack of time • There are no ethical barriers for questionnaires to students older then 15 years old – younger then 15 we need approval from parents
Sample and validity • The data collection is done from a random sample of teachers, selected from a list of teachers that have ordered the school material • 6 equivalent intervention and control groups (in terms of size, demographics, social and risk behaviours) with a sufficient number of participants • Statistic method: “Student t-test” and the t-tests are calculated on observations over time through the column proportion method • Statistic significance is measured at a level of 90 %-, 95 %- and 99 %
Method issues • All quantitative studies have methodological problems as selection errors, non-response (dropout) errors and measurement errors • The study is done during a relatively short time, which means that we only can discuss the results due to this specific period • The study is done on a group level – not individually, which affect the effect-size of the measured significances
Key results and conclusions Several results in the study argue in favour of the programmeas an effective school material for alcohol prevention • We couldn’t find any significant difference between the groups regarding delay of alcohol consumption • The intervention group displays a shift of greater awareness and a healthier attitude to alcohol use than the control group • Significantly less frequent alcohol consumption in the interventions group compared to the control group over time • Clearly smaller degree of risky behaviour in the interventions group compared to the control group over time • Lower degree of intoxication in the interventions group when drinking • Higher frequency of intoxication in the control group over time • The increase in consumption and higher frequency of intoxication together with a higher risk behaviour in the control group also signifies a negative “compound interest”-effect, which means that the influence of Talk About Alcohol on the intervention group becomes even more positive.
Next step for a scientific study • Additional quantitative study to get stronger evidence by including longitudinal studies of individuals • Improve the existing study by conducting a qualitative study • To examine the implementation process and find out if the students learn what the teacher aimed to teach
Tried alcohol (Figure 2) Bas: total Talking About Alcohol aims to encourage young people to choose to abstain from alcohol. The percentage of students who have tried alcohol, however, has risen slightly in both the intervention group and the control group. As earlier mentioned, a decrease in alcohol consumption during the specific period of time for the inquiry may be difficult to achieve.
Number of times alcohol was consumed (Figure 5) Looking at the reported alcohol consumption during different periods of time over the recent past (1 year, 3 months and 1 month), The intervention group is seen to have consumed alcohol more frequently than the control group throughout the year. However, consumption rates have gradually declined in the intervention group and this group drank less than the control group over the past month. The results therefore indicate a positive trend for the intervention group. Interventionsgrupp Snitt druckit antal ggr 15,45 ggr 3,7 ggr 0,8 ggr Kontrollgrupp 9,2 ggr 3,1 ggr 1,7 ggr
Experience of being intoxicated (Figure 4) (90%-nivå) (90%-nivå) There is an increasing trend (based on a 90% significance level)in the control group of students reporting that they have been intoxicated at some time. The trend towards increase is also evident in the intervention group, but is not as clear as in the control group.
How often intoxication is felt when drinking (Figure 7) (95%-nivå) (95%-nivå) In terms of how often intoxication is felt when drinking, a small but significant shift can be seen in the control group (based on a 95% significance level) from “seldom” becoming intoxicated while drinking to “more often” or “every time”. There is not the same clear increase in frequency in the intervention group, but no decrease either.
What has happened when alcohol was consumed (Figure 8) (95%-nivå) (95%-nivå) (90%-nivå) In the control group, we see an increase in risky behaviour among those who had consumed alcohol. This is due to the significant increase in this group (based on a 95% significance level) of participants who had “got a hangover/felt ill” and “felt relaxed” when drinking. There are also tendencies in the control group who have been drinking to have had an increase in risky behaviour in terms of incidents such as “hurt themselves”, “been near vandalism/another crime” and “could not function as usual in school”. (90%-nivå) (90%-nivå)
Last time alcohol was consumed (Figure 9) The young people in the control group who drink show a significant increase (based on a 95% significance level) in having consumed alcohol over the past 1-7 days. The intervention group had not consumed alcohol nearly as frequently as the control group during the same period. These results also show that young people in the control group who had consumed alcohol had higher rates of recent drinking than those in the intervention group. (95%-nivå) (90%-nivå) (95%-nivå)
Level of intoxication felt the last time alcohol was consumed (Figure 10) (95%-nivå) Looking at the degree of intoxication at the most recent time of consumption, we can see a significantly positive shift (based on a 95% significance level) in the intervention group, from “rather” and “very” intoxicated to a medium degree of intoxication. The control group does not show the same positive shift.
Reasons for not trying alcohol (Figure 11) Topbox/andel som instämmer The intervention group who had not tried alcohol, we see a significant increase (based on a 95% significance level) in the view that you “feel ill” if you drink alcohol. Apart from this, there are no clear differences in comparison with the benchmark measurement for this group. In the control group, there is a significantly higher number (based on a 95% significance level) of those who have not tried alcohol who do not socialise with friends who drink. We also see a trend in the control group, where students to a lesser extent were choosing not to drink because of siblings who do not drink. However, because the bases are small for this particular question, it may be risky to draw any far-reaching conclusions concerning shifts. (95%-nivå) (90%-nivå) (95%-nivå)
Youth & alcohol in Sweden today 57 % of the boys and 62 % of the girls in the age of 15-16 years in Sweden consume alcohol (Definition: If you have been drinking any alcohol during the last 12 months) The consumption of alcohol in the age of 15-17 has decreased from 2004 to 2010 Considerable problems with low-priced alcohol brought in from Germany or eastern Europe Historically – Sweden have a lack of alcohol-preventive education in schools
Is this a scientific study? • The study is based on gathered observable, empirical and measurable evidence. The method is accepted and consists of systematic collection of data through observation and testing of hypothesis. • Full disclosure – the study is objective and transparent. All documents and data is archived and available for verifying the study and for further investigation from other scientists.
In favour of Significant positive awareness about the risks and consequences of alcohol, which is extensively dealt with in the programme. The students in the intervention group who had not tried alcohol had a significant increase in the knowledge that they could “feel ill” from alcohol. This knowledge can be related to the work with the material. The intervention group has a higher proportion of girls (due to the Swedish situation) Not in favour of The survey indicates two external circumstances that may have affect the control group in a negative way. 1. The control group shows a marginally higher degree of school absence than the intervention group. 2. Students in the control group who say that they do not drink alcohol indicate that they have been influenced in this decision to a lesser extent by the fact that their friends do not drink. Prata Om Alkohol as isolated effect