270 likes | 278 Views
Learn about the data collection challenges faced during the Brazilian census, including training, logistics, management, monitoring, and validation. Discover the IT architecture used for data transmission and management. Presented by Marcos Rodrigues Pinto, Census Software Development Team Manager at the United Nations Technical Meeting on Use of Technology in Population and Housing Censuses.
E N D
Enumeration in Brazilian Census Marcos Rodrigues Pinto Census Software Development Team Manager United Nations Technical Meeting on Use of Technology in Population and Housing Censuses Amman, Jordan, 28 November-1 December 2016 1
Data Collection Challenges in Brazil • Country with 8.516.000 km² (47.3% of the continent's land area) • More than 200 million inhabitants in 67 million housing units • 27 Federation Units • 5570 municipalities 2
Data Collection Challenges in Brazil • Very diverse infrastructure
Training • Training plantoqualify more than 200.000 people (2010 Census) during 6 months • Chaining training plan (cascade), toqualifypeopletopassthroughknowledge • Four paralelgroups: pre-census, administrative, IT andoperational • Practical training classes usingspecial • versionofthe data collection mobile application, withmultimediaandinteractive for self-learning 5
Logistics • To minimize theshippingofelectronicdevicesbetweenthe IBGE central administrationandthefield, themanufactoriesdelivereddirectlytothe 27 federal units • Equipamentspreparedwithallacessories • andwithallAppspre-installed
Management • Decentralized management by regional coordination and sub divisions
The data collection station • Supervisor distributetheworkload, verifythequalityandcoverageofthe data collection • Wherethe supervisor andtheenumeratormeet, andthe data syncronizationismade, transmitingthe data tothe central servers • Equippedwith • Laptop computerwith • Kioskmode • Wifirouterallowedonlyto • IBGE devices • Printer 8
Monitoring the field enumeration • Management systems capable to monitor in real-time the evolution of the field enumeration: • Performance indicators • Distribution of enumerator work load • Supervision alerts • Charts • Reporting • Cartograms • Georeferenced information
Monitoring the field enumeration • Performance indicators: • Operational: • Number of enumeration areas by status (non-initialized, initialized, finished, supervisoned) • Total of population count • Total of housing units count • Comparison of housing units with pre-census • Enumerator production • IT Monitoring • Number of data transmissions per day
Monitoring the field enumeration • Supervision alerts created from comparison of collected data with the statistically expected numbers: • Population count per day below/above expected • Male population proportion below/above expected • Proportion of population under 3 years and above 69 below/above expected • Housing units count below/above expected • Household income above/below expected • Alerts created to the data collection station supervisor, and monitored by all managers above (municipality, operational, regional) • Could generate request for interview again a sample of housing units
Monitoring the field enumeration • Roles • Data collection station supervision • Monitor operational supervision alerts, operational indicator, distribute workload • Interview sampled housing units • Check sampled enumeration area coverage • Municipality, subarea, and others managers • Monitor on superior aggregations • IT supervision • Monitor data stations network, data transmissions, PDAs
Monitoring the field enumeration • Georeferenced location where the enumerator has started an interview (captured by the device GPS), with the possibility to take photo of the enumeration area
Monitoring the field enumeration • GPS to monitor the data enumeration area and identify possible misuse by the enumerator 14
Monitoring the field enumeration • Cartograms
Validation and Coverage • Questionnaire with high level of validation and guidance, avoiding many common inconsistencies related to the paper based enumeration • Address list updated by pre-census, used for enumerators routing and coverage control • Device is equipped with the enumerator area map, questionnaires and list of addresses • One enumeration area per enumerator (not shared)
Validation and Coverage • Data quality control reviewed for each Enumeration Area, including ratio of species of housing units, average number of persons per housing unit, ratio of people by gender, age, etc • Approval process to finish an enumeration area and start the enumerator payment process
IT Architecture –Isolated areas communication • VSAT - VerySmallAperture Terminal • BGAN - Broadband Global Area Network 20
IT Architecture – Recomendations • Load balance data reception servers to accept transmisions • Secure reception channel with server certificate (HTTPS) • Request client certificate, to trust the client identity • Keep database inside protected network
Confidentiality • Enumerators do not have access to data stored on the the device, witch is encrypted and saved in the app storage area • Data transferred to IBGE through a secure network • Device and app secured by password • Devices locked to be used only as data collection equipment, using programs certified by IBGE: avoid undesired usage by enumerator and theft
IT Architecture – Internet Data Collection • E-Ticket processto match theaddressandquestionnaire
Risks • Data collection app not properly developed • Allow invalid data input • Data loss • Ineffective use of the enumerator device, due to lack of training • Servers infrastructure not properly scaled for receiving transmissions • Management systems and team not prepared to monitor the enumeration
IBGE´s Challenges for 2020 • Multi-mode data collection with internet and app for self-response; • How to minimize the software development effort to build internet self-response, enumerator app and self-response app; • How to match the address list with the internet self-response data without the need to visit the household
Thank you Marcos Rodrigues Pinto marcos.pinto@ibge.gov.br +55 21 2142 4565