160 likes | 275 Views
IPUMS-International: Expanding Support For International Comparison and Data Access. Wendy Thomas / Peter Clark Minnesota Population Center wlt@umn.edu, pclark@umn.edu IASSIST 2010, Ithaca, NY. Support for comparison and data access. IPUMS International Collection Preservation
E N D
IPUMS-International: Expanding Support For International Comparison and Data Access Wendy Thomas / Peter Clark Minnesota Population Center wlt@umn.edu, pclark@umn.edu IASSIST 2010, Ithaca, NY
Support for comparison and data access • IPUMS International • Collection • Preservation • Harmonization • IHSN / IPUMS Project • Returning resources to the country of origin • Making IPUMS International DDI compliant • Long term preservation
Overview: IPUMS International • Coverage – 1960 to 2007 • Microdata • Individual household and person records • Documentation • Over 25,000 documents related to censuses in over 223 countries • Data available for scholarly research • Registration required
Getting Data into IPUMS-I • Get data from donor country/NSO • Draw a sample and anonymize • Clean up • Variable construction • Pointers to mother and father records • Harmonization • Hierarchical harmonization structures • Detailed metadata construction
Metadata Processing • Original data and metadata come in a variety of structures • Digitized and translated if necessary • Midterm metadata in structured documents and spreadsheets • Includes original questions and retained variables • Variable information for harmonization process • Final metadata in IPUMS database
IHSN/IPUMS Project One year effort to produce DDI 2 (IHSN compliant) metadata from IPUMS-I for all samples outside of US, Canada and Europe Allows originating country to use IPUMS produced DDI with their original data and provide access through the Toolkit components
IHSN Toolkit Components Editor CD-ROM builder Nesstar Explorer IHSN Report Center
Metadata Repatriation • Facilitate local access • Creation of statistics, web site and CD • Creation of National Data Archives • http://www.ihsn.org/home/index.php?q=tools/nada
DDI Output from IPUMS-I • Known issues • Creating DDI for original files using output from the final IPUMS database • Upper-level metadata not in IPUMS database • Dublin core descriptions for associated documents are missing • Detailed geographic and other variables are not used by IPUMS or are removed during anonymization
Goals for project Provide DDI metadata back to IPUMS donor countries for use with their own datasets Map IPUMS database to DDI to enable DDI output for IPUMS and all other datasets under curation
Secondary goals Identify metadata required for curation of the original data, cleaned sample, and final IPUMS database Evaluate means for capturing and retaining metadata currently lost or “sidelined” in IPUMS processing