1 / 23

Quality Assurance at the European Monitoring Centre for Drugs and Drug Addiction

Quality Assurance at the European Monitoring Centre for Drugs and Drug Addiction. Sandrine Sleiman European Conference on Quality in Official Statistics, Rome 8-11 July 2008. Contents. Scope of EMCDDA activities Quality assurance: operating framework Challenges and results. Who we are.

harken
Download Presentation

Quality Assurance at the European Monitoring Centre for Drugs and Drug Addiction

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Quality Assurance at the European Monitoring Centre for Drugs and Drug Addiction Sandrine Sleiman European Conference on Quality in Official Statistics, Rome 8-11 July 2008

  2. Contents • Scope of EMCDDA activities • Quality assurance: operating framework • Challenges and results

  3. Who we are • A decentralised EU agency • Formally established in 1993 • Based in Lisbon, Portugal (operating since 1995) • The hub of drug-related information in the EU

  4. Principles Scientific excellence Partnership Good governance and efficiency Priorities Consolidating monitoring and reporting activities Enhancing data analysis Communicating more effectively Guiding principles and priorities: 2007-2009

  5. Collecting and analysing existing data Areas: • Epidemiology — drug situation, monitoring new trends, five key indicators • Interventions — health, social and criminal justice responses, best practice in demand and supply reduction • Legislation — national and Community strategies and policies • Policy — political and institutional framework, coordination

  6. Five Key indicators • Drug use in the general population (students and young adults): prevalence and patterns of drug use in the general population • Drug users accessing treatment (TDI) • Drug related infectious diseases (HIV, HCV, HBV) • Drug related deaths and mortality of drug users • Problem drug use: prevalence and patterns of problem drug use Requires commitment from MS to invest in data collection on a routine basis

  7. Annual registry and epidemiological data Descriptive and qualitative data (non-annual) Data from research studies Institutional data Database cases Coverage and availability of prevention, treatment and harm reduction Statistics from law enforcement sources Type of data collected

  8. Collecting and analysing existing data • Reitox national focal points (NFPs), national experts • Annual reporting to EMCDDA (national reports, standard tables, questionnaires) • Expert groups for developing indicators (nominated by NFPs) • Ad hoc working groups

  9. Reporting system: standard templates • National reports and selected issues (based on detailed guidelines) • Standard Tables (ST) for quantitative information • Sturctured Questionnaires (SQ) for qualitative information supplementing ST and NR

  10. Data submission in FONTE, including quality control at national level Quality assurance at EMCDDA level Quality Control by Scientific Units Quality Assurance by QA team National data providers National Focal Points & National data providers Data Validation Quality overviews National Focal Points Data collection instruments Data collection instruments, protocols and guidelines Quality Management at the EMCDDA

  11. Main quality related outputs & reports • Annual Quality reports • Implementation Needs Profiles on the 5 key indicators • EU experts groups ad-hoc documents • Regular reporting to EC on implementation of 5 KI and on quality of reporting

  12. Quality criteria : Completeness, insight, reliability, usefulness, internal consistency Quality reports includes feedback on : National reports Structured Standard tables questionnaires 1. Global C1 evaluation C2 - Level of details 2. Method. C3 (insuf., suff., Aspects C4 good) 3. By section : M1 level of details, M2 - Conciseness clarity, strong/ M3 (insuf., suff. , weak points, D1 good) suggestions for improvements, + Number of - Discrepencies discrepencies tables uploaded; with NR st 4. Compliance Date of 1 with formal upload; r equirements Number of 5. Layout uploads. presentation incl. deadline Annual Quality reports

  13. Criteria for National reports • Completeness: the report contains all the necessary and existent information in order to provide an overview of the situation • Insight: the report includes complete and significant information, giving an interpretation to the reported information, according to social and political contexts. • Reliability: the extent to which the information in the report allows comparisons (between different time periods). • Usefulness: information oriented to the targets; acceptable and pertinent to the report objectives; no redundant information is presented. • Internal consistency: the extent to have coherent information in the report or to describe the reasons for a lack of internal consistency.

  14. Criteria for data checking in STs

  15. Criteria for SQ

  16. Implementation Needs Profiles • Concerns 5 key epidemiological indicators • Focuses on activities related to indicators and partially on content • Is a general analysis, helps to identify problematic areas, status quo or improvement in data collection

  17. Criteria used • Most recent data • Reference • Description • Weaknesses • Activities implemented or ongoing/planned • Actions needed

  18. Quality assurance: work in progress Quality Assurance… • is mentioned as a priority in the EU action plan • is mentioned in the external evaluation report • is part of the EMCDDA’s 3-year work programme Quality documents should be … • considered as real tools for the EMCDDA and the REITOX network (as well as for external actors) • aimed at scientific excellence and not administrative purposes • an overview of strengths and weaknesses of data or collection processes • …

  19. Quality assurance: work in progress • Production of 5 KI methodological packages • Definition of precise assessment criteria for 5 KI based on : • minimum implementation standards • specific to each indicator • sensitive to national contexts • somewhere between pragmatism and perfection • Redefinition of templates and guidelines with adaptation of quality criteria

  20. Understand needs and capacity to deliver from the Reitox network Promisewhatcanbedelivered Change capability to match future needs: - Quality feedbacks - Capacity development activities Priorities for value delivery: revision of reporting guidelines Deliveriesmatching standards andpriorities Changecapability to matchpromise Quality assurance : work in progress

  21. Case study: national reportsSuccess • Recommendations for improvement are generally applied as regards adherence to guidelines: • Document layout • References to standard tables and structured questionnaires • Sources and use of Harvard for bibliography • Methodological information is more precise • Efforts in writing the National report

  22. Case study: national reports Gaps • Deadlines missed • Conciseness • Lack of insight on trends and interpretation of results • In some countries, it is still too early to have information on trends • Work on quality assurance depends on external factors, such as Member States’ involvement in quality issues

  23. THANK YOU FOR YOUR ATTENTION Sandrine.Sleiman@emcdda.europa.eu http://www.emcdda.europa.eu

More Related