110 likes | 606 Views
breakout session of the measurement subgroup, CD4.0 TT A review of Statistical capacity assessments. François Fonteneau (PARIS21 ). Outline. Purpose and methodology Results Possible next steps. Purpose. Check what Assessments actually measure – and what they mean by capacity.
E N D
breakout session of the measurement subgroup, CD4.0 TTA review of Statistical capacity assessments François Fonteneau(PARIS21)
Outline • Purpose and methodology • Results • Possible next steps
Purpose Check whatAssessmentsactuallymeasure– and whattheymean by capacity. • Measure on NSO and otherrespondents(on-going). the responseburden • Propose an analytical question bank(next).
Method • Step 1: Select14 assessmentstools on statisticalcapacity • 1974 questions and indicators total • Step 2: Code each question/indicator to one or two dimensions from CD 4.0 Framework, using OAR • Resulting 2353 relations* • Step 3: Quantitative and qualitative analysis of questions and assessments
Method • US Census Bureau / IADB Tool for Assessing Statistical Capacity (TASC) • UNECA Self-Assessment Guidance Questionnaire from (SAGQ) • UNECA African Statistical Development Indicators from UNECA (StatDI) • Eurostat Snapshot • Eurostat / EFTA Global Assessment of the National Statistical System • GS – FAO/AfDBCountry Assessment of Agricultural Statistical Systems in Africa • EC/OECD Light Self - Assessment Questionnaire on the implementation of the European Statistics Code of Practice • Eurostat /AUSTAT Pan-African Statistics Programme: Peer Reviews of NSIS/NSSS in African countries (PAS) • World Bank Statistical Capacity Indicators from the World Bank (SCI) • HMN Assessing the National Health Information System • UNSD Environment Statistics Self-Assessment Tool (ESSAT) • UNSD Generic National Quality Assessment Framework (NQAF) • IMF Data Quality Assessment Framework for National Accounts Statistics (DQAF)
Results • Assessments focus mainly on organizational skills and knowledge • Power and politics and incentives are marginally assessed • Although most capacity development programmes target individuals, their capacities are marginally assessed Categories ranked by relevance
Altogether, the top five dimensions represent more than half of the questions/indicators.
Crowded: ‘Methods, practices and quality control’ • Purpose: Mapthese questions : • to GSBPM phases • to data qualitysub-dimensions • Results: uneven distribution of questions
Orphan: ’IndividualResources: education and workexperience’ WeTENTATIVELY proposed questions: • Is the NSO able to attract enough candidates from the national/regional labour market to meet its staffing needs? • What is the minimum educational attainment in statistics or related, required to qualify for a statistician / managerial position in the NSO? • Does the NSO have a policy requiring future hires to have experience working with statistical software in a similar environment? • Does the NSO have a young professionals programme? • …
Next steps Further analysis: • Further assessments? … which ones? • Further analysis by type of assessments? • Further “crowded category” work? Further “orphan category” work? • Towards a stat Cap question bank ? - Further document response burden?
Thank you Francois.Fonteneau@oecd.org www.paris21.org