1 / 45

The Development and Application of the SACMEQ HIV-AIDS Knowledge Test for Pupils at the Upper-Primary School Level in 1

Kenneth N. Ross University of Melbourne, Australia 2 September 2010. The Development and Application of the SACMEQ HIV-AIDS Knowledge Test for Pupils at the Upper-Primary School Level in 15 African Countries. Sub-Saharan Africa, HIV-AIDS, and the SACMEQ III Project. SACMEQ Membership.

tovi
Download Presentation

The Development and Application of the SACMEQ HIV-AIDS Knowledge Test for Pupils at the Upper-Primary School Level in 1

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Kenneth N. Ross University of Melbourne, Australia 2 September 2010 The Development and Application of the SACMEQ HIV-AIDS Knowledge Test for Pupilsat the Upper-Primary School Level in 15 African Countries

  2. Sub-Saharan Africa, HIV-AIDS,and the SACMEQ III Project

  3. SACMEQ Membership A Network of 15 Ministries of Education 3

  4. SACMEQ’s Mission To deliver training and research programmes for African educational planners and researchers that will enable them to: • (a) monitor and evaluate the quality of their basic education systems; and • (b) generate research-based information that can be used by decision-makers to plan improvements in the quality of education.

  5. Context Information for SACMEQ School Systems

  6. General Policy SACMEQ Managing Committee Scientific & Measurement Committees Detailed Policy and Monitoring Training and Technical Support SACMEQ Co-ordinating Centre Co-operation General Administration and Country-Specific Technical Issues “External Friends” Training and Technical Support 15 SACMEQ NRCs and 30 D/NRCs SACMEQ Assembly of Ministers of Education 6

  7. SACMEQ Conceptual Model School Characteristics: Type, Location, Enrolment, Resources, Principal’s Qualification, Parental Involvement, etc. Learner Characteristics: Age, Sex, Attendance, Repetition, SES, Nutrition, Siblings, Home Help, etc. Teacher Characteristics: Age, Sex, Qualifications, Subjects, Classroom resources, Behaviour, In-Service Training, etc. Learner Achievement • Reading • Maths • HIV/AIDS 7

  8. Adults and children estimated to be living with HIV (UNAIDS/WHO, 2007)

  9. Children (< 15 years) estimated to be living with HIV (UNAIDS/WHO, Dec 2007)

  10. Adult HIV/AIDS Prevalence Rate (Aged 15-49) in SACMEQ Countries (UNAIDS, 2007)

  11. 2. SACMEQ HIV-AIDS Knowledge Test (Known as the HAKT)

  12. UNGASS Indicator 13: “Knowledge about HIV Prevention” Percentage of young people aged 15-24 who provide correct answers to the following questions about (a) sexual transmission of HIV, and (b) misconceptions about HIV. SEXUAL TRANSMISSION OF HIV 1. Can the risk of HIV transmission be reduced by having sex with only one uninfected partner who has no other partners? 2. Can a person reduce the risk of getting HIV by using a condom every time they have sex? MISCONCEPTIONS ABOUT HIV 3. Can a healthy-looking person have HIV? 4. Can a person get HIV from mosquito bites? 5. Can a person get HIV by sharing food with someone who is infected? 13

  13. Problems with the UNGASS 13 Indicator 1. LOW RELIABILITY (0.28) 2. LOW CONTENT VALIDITY (a) Poor Curriculum Coverage, and (b) Concentration on “Misconceptions” 3. LINGUISTIC COMPLEXITY (Intersecting questions & qualifiers). 4. INVITATION TO CHANGE INDICATOR QUESTIONS “The first three questions should not be altered. However, Questions 4 & 5 ask about local misconceptions and may be replaced by the most common misconceptions in your country.” 5. WRONG TARGET GROUP (15-24 years is too late). 6. JUSTIFICATIONS GIVEN FOR ITEM SELECTION For example; “The belief that HIV is transmitted through mosquito bites can weaken motivation to adopt safer sexual behaviour.” 14

  14. TWO DEFINITIONS OF AIDS “AIDS, the acquired immunodeficiency syndrome, is a fatal disease caused by HIV, the human immunodeficiency virus.” (UNAIDS, 2007, p. 8). “AIDS is not a disease. It is a syndrome or group of illnesses resulting from a weakening of the immune system.” (UNESCO, 2007. p. 28).

  15. SACMEQ HIV-AIDS Knowledge Test • Based on Official Curriculum, Teaching Guides & Materials • Target Group = Grade 6 Pupils (Average Age = 13.5 years) • Extensive Approval Process: MoEs (at all levels), Ministers of Education), SACMEQ Scientific Committee, External Experts. • Standardized Test Administration (Scripted Group Interview) • Balance of True/False Items (86) • Administered to over 60,000 pupils in around 2800 schools across 15 countries. • Reliability Coefficient = 0.85

  16. Administration of the HAKT 1. Two data collectors manage group administration of the HAKT for samples of 25 pupils per school. 2. Extensive training of data collectors via role play. 3. Practice questions (eg. “Elephants can fly like birds.”) 4. Presentation (double reading) of test items. 5. Supervision and checking of progress. 6. After the testing session – explanation/discussion. 17

  17. SACMEQ Knowledge Topics for HAKT

  18. Selected Items from the HAKT

  19. Three Pupil & Teacher Performance Scores: Transformed Scores – scaled HAKT scores transformed to a SACMEQ pupil mean of 500 and standard deviation of 100. Minimal Knowledge Scores – dichotomous scores that indicated whether or not respondents had mastered at least 50% of the official curriculum. (Expectation=100% of pupils reach this level) Desirable Knowledge Scores – dichotomous scores that indicated whether or not respondents had mastered at least 75% of the official curriculum. (Expectation=at least half of the pupils reach this level)

  20. What knowledge do Grade 6 pupils and their teachers have about HIV-AIDS? Question 1

  21. What are the within-country regional variations in pupil knowledge about HIV-AIDS? Question 2 24

  22. Gaza Inhambane Maputo City Mozambique Sofala Sofala

  23. HAKT Scores by regions

  24. Are there gender differences among Grade 6 pupils in knowledge about HIV-AIDS? Question 3

  25. What was the variation in Grade 6 pupil knowledge about HIV-AIDS – between and within schools? Question 4

  26. How did Grade 6 teachers rate their own risk of becoming infected with HIV? Question 5

  27. Teacher Assessment of Personal Risk of Infection with HIV

  28. What percentage of Grade 6 pupils attended lessons on HIV-AIDS? Question 6

  29. What did Grade 6 pupils nominate as “the best source of information about HIV and AIDS”? Question 7

  30. Best Source of Information on HIV-AIDS Percent Medium Electronic (Radio, TV, Video) 42.3 Performance (Play, Drama, Concert) 7.7 Printed (Books, Magazines, Newpapers) 6.8 Computer/Internet 1.7 Person Teacher 17.7 Health Professional 13.0 Family 4.4 Friend or Peer 3.8 Person with HIV 1.6 Religious 0.9 TOTAL100.0

  31. What were the “Curriculum Gaps”? Question 8

  32. List of the 25 best understood questions (pupils)

  33. List of the 25 worst understood questions (pupils)

  34. List of the 25 best understood questions (teacher)

  35. List of the 25 worst understood questions (teachers)

  36. What were the country rankings on the HAKT compared with the UNGASS 13 indicator? Question 9 43

  37. Comparison of National Rankings on UNGASS and HAKT Indicators

  38. FUTURE DIRECTIONS • IIEP Policy brochures (2010) • SACMEQ III Data Archive (2010-11) • UBW research programme (2010-11): designing and validating different language versions of the HAKT • SACMEQ IV Project FURTHER INFORMATION Kenneth N. Ross University of Melbourne k.ross@unimelb.edu.au • WWW.SACMEQ.ORG 45

More Related