DETERMINANTS OF FORECAST ACCURACY FOR PAEDIATRIC ANTIRETROVIRAL DRUGS IN KENYA

1. DETERMINANTS OF FORECAST ACCURACY FOR PAEDIATRIC ANTIRETROVIRAL DRUGS IN KENYA NJOGO, SUSAN MUTHONI GICHUKI (U51/82556/2012)

2. Outline • Introduction • Study objectives • Methodology • Results • Conclusion • Recommendations

3. Introduction (1) • Forecasting is the process of estimating quantity required of particular products to meet demand for aspecified period of time. • It is a fundamental and basic input to decision making in operations management on future demand, budget preparation, supply planning and storage requirements.

4. Introduction (2) • Two important aspects of forecast are expected level of demand and degree of accuracy • Forecast accuracy is a function of the ability of forecasters to correctly model demand, random variation, and sometimes unforeseen events.

5. Introduction (3) • Forecast errors should be stated in order to help forecast users to plan for possible errors and provide basis for comparing alternative forecasts

6. Introduction (3) • Management of HIV infection calls for uninterrupted supply of required products • Forecast for both adult and paeds antiretroviral (ARV) drugs is done annually by NASCOP • Forecasting is largely dependent on assumptions due to poor quality or lack of required data

7. Introduction (4) • All children <15 years are generally assumed to weigh <25Kg and to use paeds ARV formulations • Forecasting for paeds ARV drugs has been reported to be specifically challenging because; • Dosages change over time as a child grows • Dosing is individualized based on weight • A mix of formulations exist for children

8. Study aim The aim of the study was to evaluate forecast accuracy for paediatric antiretroviral drugs in Kenya and assess determinants of forecast accuracy

9. Study objectives • Establish forecast accuracy for paediatric ARV drugs by for period July 2010 to June 2013. • Determine the relative proportions of children within various weight categories, ARV regimen and formulations at Mbagathi District Hospital. • Determine within and between-individual changes over time with regards to weight, regimen and formulation. • Identify factors that influence choice of antiretroviral formulations dispensed to children at Mbagathi District Hospital from the pharmacy staff perspective

10. Methodology • Forecast accuracy was established by computing 12-months and quarterly Mean Absolute Percentage Error (MAPE) using Microsoft Office Excel • A retrospective longitudinal cohort design was used to determine effect of age, weight and sex on ARV formulations dispensed to children aged <15 years at Mbagathi District Hospital. • In-depth interviews were carried out on pharmacy staff dispensing ARV drugs at Mbagathi District Hospital

11. RESULTS

12. Baseline characteristics (1)

13. Baseline characteristics (2)

14. Forecast accuracy • Mean Absolute Percentage Error (MAPE) 12-moths MAPE • 12-month and quarterly MAPE were observed across all the products • However, NVP-10mg/ml had reasonable forecast based on Lewis MAPE scale of judgment of forecast errors

15. b. Randomness of forecast errors test ADF test Run test *z-critical= -2.972 at 95% confidence level; **significant randomness at p<0.05; Null hypothesis for ADF test: Errors are non-random. *r: >12 and <26;**significant non-randomness at p<0.05; Null hypothesis for Run test: Forecast errors are random.

16. Visual inspection for randomness of forecast errors

17. Univariate analysis • Proportions of children in the <25Kg and ≥25 Kg weight categories • More than 50% of children were in the ≥25 Kg weight category across the three periods

18. b. Average proportion of children for selected ARV combination • A significant proportion of children were on adult ARV formulation

19. Bivariate analysis • Relationship between ARV formulation and weight category • Chi square test revealed that significant relationship (p=0.00) existed between ARV formulation and weight category across all the years

20. b. Relationship between age category and weight Profile for mean weight over age

21. Within-subject effects and population-average response • Within-subject effects: Only 17(5.5%), 49(16.0%) and 26(9.1%) of children changed ARV formulation due to weight change for 2010/11, 2011/12 and 2012/13 respectively. • Population-average response: Odds ratio of being given paeds ARV formulation when weight is ≥25Kg was 0.37, 0.03 and 0.07 for 2010/11, 2011/12 and 2012/13 respectively • Therefore, 63%, 97% and 93% of children were likely to receive adult formulations when weight changed from <25Kg to ≥25Kg for 2010/11, 2011/12 and 2012/13 respectively

22. In-depth interviews • Four factors were identified to influence choice of ARV formulation dispensed to a children; • Weight • age • availability of paediatric ARV drugs and • preference of the dispensing staff to dispense paediatric antiretroviral drugs to children below 15 years regardless of the weight

23. Conclusion • Of the seven paediatric ARV drugs, only nevirapine10mg/ml had reasonably accurate forecasts. However, forecast errors for all drugs were non-randomness. • The assumptions that all children aged less than 15 years weigh <25Kg and use paediatric ARV formulations were incorrect. • Weight was found to be an important determinant of formulation selection. Recommendation To improve forecast accuracy, • Forecast accuracy need to be routinely monitored and evaluated • Children weight need to be incorporated in the routinely reported program data item or analysis be carried for a sample of facilities.

24. Acknowledgement • National AIDS/STI Control Program (NASCOP) • Mbagathi District Hospital • My supervisors • Dr. George Osanjo • Dr. Eric Guantai