170 likes | 308 Views
NILS Beta Testing – Principles and Procedures. NILS-RSU February 2013. Overview. Rationale General principles Benefits for researchers Expectations for researchers The process – including timing Useful documents Questions?. Objectives.
E N D
NILS Beta Testing – Principles and Procedures NILS-RSU February 2013
Overview • Rationale • General principles • Benefits for researchers • Expectations for researchers • The process – including timing • Useful documents • Questions?
Objectives • Test the NILS 2011 data for accuracy, comparability and consistency through active analytical use (after Alpha Testing); • Use the feedback from beta test researchers to inform the decision whether to release the NILS database to the wider research community; and • Provide an opportunity for some initial findings from the NILS to be reported at the UK LS 2011 link launch.
Selected Projects • Between 5 and 8 projects to test various aspects of the NILS. • 2001 to 2011: • Geography: comparability and usability of the new geography codes and look‐ups • Qualifications, occupation coding and NS‐SEC classifications • Household composition and relationships within the household • Community background and ethnicity • Caring: including transitions in caring responsibilities between 2001 and 2011 • Limiting long-term illness and general health
Selected Projects • New in 2011: • International migration: including address one year ago and a range of new migration related variables such as month and year of arrival, intended length of stay • National identity, passports held • Language –English proficiency and Ulster-Scots • Health Conditions
Criteria • Criteria for individual projects • Simple projects that could be completed in approximately 20 days • Experienced academic and government researchers who could adequately test the database (at least one team member with experience of any of the three UK LSs) • Criteria for portfolio of selected projects • Projects that examine comparability over time (testing consistency) • Projects that examine variables that were new in 2011 (testing question usefulness) • Projects looking at 2011 Census and vital events • Project teams involving collaboration between academic and government researchers • 1 DLP project to test the DLP linkage process using 2011 data
General principles • Teams must include experienced researchers • However, applications would also be welcome that • Involve government researchers • New or less experienced users • Should be feasible – eg doable in 20 or less working days • And the work done by the researchers themselves in the RSU
The Data • 2011Match Rates • Early indication that match rates are very similar to 2001 • Final match rates and working paper due to be published in May 2013 • 2011 Variables • 300+ variables of various type including Database management variables, basic variables and derived census variables ( e.g. adaptability question has 10+ derived variables) • SOC2000 and SOC2010 for full census database (NILS members and HH members) • List of variables (like ONS beta-test application) will be available in mid-March (at time of alpha-testing) • Data dictionary finalised early May 2013
2001 Health Card Registrations Central Health Index All Live Patients (4th May 2001) 1,768,473 List Inflation 83,206 4.7% Published 2001 census population One Number (29th April 2001) 1,685,267 Imputed Records 81,626 4.6% Imputed Records 81,626 Enumerated 2001 census population (29th April 2001) 1,603,641 Enumerated 2001 census population (29th April 2001) 1,603,641 90.7%
Estimate for NILS sample Health Card Registrations with NILS Date Central Health Index All Live Patients (4th May 2001) 508,279 4.7% List Inflation 23,914 • Don’t know who is ‘list inflation’ • Don’t know who is ‘imputed’ • Assume sample is representative 4.6% Imputation 23,460 90.7% Enumerated 460,904
NILS Match Rate (2001) 4.7% Health Card Registrations with NILS Date Central Health Index All Live Patients (4th May 2001) 508,279 List Inflation 23,914 List Inflation 23,914 4.7% Imputation 23,460 Imputation 23,460 4.6% 4.6% Unmatched 13,447 90.7% Enumerated 460,904 2.6% Matched 447,457 88.0% 88.0% Match Rate 97.1% Match Rate Adjusted
Benefits for researchers • Pre-release access to the NILS database in the secure environment to prepare data and analysis • Understanding of the 2011 Census link prior to further application submissions– this may help researchers scope further projects; • Opportunity to be one of the first projects to identify some interesting findings from the launch
Expectations for researchers • Specify a project and data specification • Load data into appropriate software • Structure data in a way suitable for analysis including adding value labels etc. • Complete the analysis of the data • Interpret the analysis to see if results are as expected • Report back to NILS on any quality issues • Possibly give a presentation for the launch (planned for October\November 2013) • Report any errors or problems that arise in the course of the work, discuss with NILS-RSU staff, and write a short written summary of their experiences
Key DatesAll dates quoted are subject to change. Beta-test projects will only proceed after NI data from Release 3 of the 2011 Census results are released and successful completion of the Alpha testing of the database.
Key Dates • Key dates • Early March 2013 Application form agreed, Launch beta-test at NILS User Forum meeting, Beta Test information will be published on the NILS websites • April 2013 Deadline for applications (25th April 2013) • May 2013 RAG assess applications (2nd May 2013) • May 2013. Applicants will be notified (w/c 9th May 2013) • May 2013 An initiation meeting with all Beta Test project teams (24th May 2013) • June 2013 Beta test database available for researcher teams (dependent on Census Releases) • August 2013 Progress review meeting with researchers (23rd August 2013) • September 2013 Final review meeting (20th September 2013) • September 2013 Meeting of the RAG 19th September (Review & Sign Off) • October 2013 Release for new NILS Research Database. Researchers able to publish outputs from beta test projects
Useful Documents 2011 Census formhttp://www.nisra.gov.uk/archive/census/2011/H4%20-%20Final%20Household%20Form%20for%202011%20-%20with%20watermark.pdfCensus Output Prospectushttp://www.nisra.gov.uk/Census/2011CensusProposedOutputs.htmlDefinitions and Output classificationshttp://www.nisra.gov.uk/Census/pop_def_2011.pdf2001 vs 2011 questions comparisonhttp://www.nisra.gov.uk/census/comp_2011.pdfData issues loghttp://www.nisra.gov.uk/Census/correction_log_2011_results.pdf