Census and administrative data sources

1. Census and administrative data sources 2: Outputs and access

2. Census and administrative data • Lecture overview Objectives of lecture Introductory questions 2001 Census Data outputs Neighbourhood Statistics Service Access mechanisms

3. Objectives • To introduce the the UK Censuses • To understand the different forms of output • To recognise the difference between the Census and Neighbourhood Statistics • To be able to identify and obtain the appropriate census and neighbourhood data

4. 2001 Census basics • Separate censuses in England and Wales; Scotland; Northern Ireland • Differences in questions, data output and access arrangements • 200 years of the census (1801-2001, ex. 1941, inc. 1966) • Statutory data collection exercise • Most detailed source of small area data

5. What topics are covered?

6. Introductory questions… How do we obtain access to the census datasets? What output products are produced from the census?

7. 2001 Census outputs • Multiple output products • Aggregate statistics • Boundaries • Interaction data • Microdata • Lookup tables • Metadata • NB national differences

8. Aggregate statistics • Key statistics; census area statistics; standard tables (Previously small area statistics;local base statistics) • Data aggregated to geographical areas • 2001 lowest level is Output Area • Nested hierarchical geography • Threshold populations • Tabular layout for areas

9. 1991 SAS table 5 layout

10. Digital boundary data • Created by census organizations for the purposes of the census • Nests within statutory geography (statistical wards) • Different methodologies in Scotland (very) and NI (slightly)

11. 2001 Output Areas England and Wales (n=175,434)

12. 2001 OA 1991 Ward 1991 ED Code-Point

13. Census interaction data • Describes flows extracted from census returns • Journey to work • Migration from usual address one year ago • To produce two datasets • Special Workplace Statistics • Special Migration Statistics

14. Samples of anonymised records • Literally, a sample of anonymised records from actual census forms • Known as microdata (internationally, public use microdata samples PUMS) • 1991 2% sample of individuals (~LADs) and 1% sample of households (regions) • Unique tabulations and analyses

15. ONS longitudinal study • Since 1971, longitudinal microdataset • 4 DoBs, ~1% sample, ~500,000 persons • Confidentially linked records from census, B&D and cancer registration • Unique resource for study of socioeconomic lifecycle – esp. health • No direct researcher access to dataset

16. Problems with Using the Census • Census data go out of date quickly • People missing from the Census • Census data are subject to other inaccuracies • Problems with comparison • Census data are aggregated

17. Census data access • 2001 Census Access and Neighbourhood Statistics Service • Pre-2001 data purchase • Academic access to all products funded by ESRC/JISC Census Programmes

18. Census Access Census organizations Other data suppliers 2001 datasets Pre-2001 datasets Other Census Access partners ESRC/JISC integrated dataset services Data support units Registration service Users Academic census users

19. Academic access agreements Census organizations Data registrar ESRC Data redistributors End users

20. Neighbourhood Statistics Service • Government departments contributing datasets derived from administrative records • Aggregating initially to 1998 wards, soon to be super output areas (SOAs) • Varying levels of SOA reflect sensitivity of different administrative datasets • No facilities for bulk/research download

21. Neighbourhood Statistics Service

22. NeSS Interactive Mapping

23. NeSS thematic mapping

24. Using Casweb Log on by clicking icon

25. Dataset selection Click here to start Select dataset of interest

26. Select country Select country

27. Define area of interest Step through hierarchy, progress highlighted in geography selection diagram

28. Select output geography Complete selection of areas of interest, and then choose level of output geography

29. Choose census table Select the census table containing the data required

30. Select variables from the table Check boxes representing the cells for which data are required, variables are added to current selection list

31. Options for data download Specify output requirements – plain text or GIS format

32. Download data file to own PC Click to download specified data in requested format

33. Load data into own software

34. Assignment 5/Coursework 1 • Use Casweb to obtain additional Census data for your chosen neighbourhood: major changes from 1991? • Neighbourhood description wrt literature • Use data to provide neighbourhood profile • Assessment of geography compatibility

35. Lecture summary • Census basics • Census output products • Census access arrangements • Neighbourhood Statistics Service • Ease of access but limited download • Academic access to census • Aggregate statistics from Casweb