1 / 19

Metadata Portal Project: Using DDI to Enhance Data Access and Dissemination

This NSF-funded project aims to improve metadata for the General Social Survey and American National Election Study series. It showcases the use of rich structured metadata and encourages software development. The project spans three phases and delivers a metadata portal with various tools to enhance data access and dissemination.

louisp
Download Presentation

Metadata Portal Project: Using DDI to Enhance Data Access and Dissemination

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Metadata Portal Project: Using DDI to Enhance Data Access and Dissemination Mary VardiganAssistant Director, ICPSRDirector, DDI Alliance

  2. Metadata Portal Project • NSF-funded project to improve metadata for the General Social Survey and American National Election Study series (SES-1229957) • Several partners

  3. More on the Project • Showcases what you can do with rich structured metadata • Products designed to apply to other survey data • Intended to encourage more software development • Spans two years with three phases • Create markup • Establish portal with prototype tools • Revise business process to capture metadata and reduce cost

  4. Metadata Portal Project -- Phase 1 Deliverables: • Inventory of all ANES, ICPSR, and GSS files • Resolve any versioning issues • Markup (DDI Codebook level) of all existing ANES and GSS codebooks, shared freely • Profiles of markup for specific purposes • Indicate which elements are needed

  5. Metadata Portal Project -- Phase 1 (cont.) • Markup enhancements (DDI Lifecycle) for a subset of the codebooks, to include: • Provenance and process (e.g., recodes) • Harmonization and comparison (e.g., concepts) • “Reverse universe generator“ to detect and mark up branching patterns and missing data • Bibliographic references • Findings and lessons learned

  6. Metadata Portal Project -- Phase 2 Deliverables: • A Metadata Portal demonstrating tools such as: • Survey catalog and documentation library • Question banks • Classification banks • Dynamic codebook generators • Script generators for syntax • Variable comparison tools • Resources for developers

  7. Metadata Portal Project -- Phase 3 Deliverables: • For both GSS and ANES, develop new metadata-driven workflows to capture metadata early in the data collection process for re-use • Disseminate findings to others • GSS has already started mapping its processes to the Generic Statistical Business Process Model (GSBPM)

  8. GSBPM

  9. How Project Relates to Data Lifecycle Task 1: Markup Task 3: Workflow Task 2: Tools

  10. Project Infrastructure

  11. Where Are We Now? • Inventorying and analyzing all ANES and GSS files ported to iRODS repository • Populating a spreadsheet with study-level information from all three data sources • Getting started on the reverse-engineering project to understand routing through questionnaire • Generating variable-level DDI markup

  12. Where Are We Going? • Looking to create innovative tools based on structured metadata • Some ICPSR examples…

  13. Search for Variables

  14. Check Variables to Compare

  15. Display Side by Side

  16. Search for Studies by Variable Relevance

  17. Variables in Context

  18. All made possible by rich, structured DDI metadata

  19. Questions? • Mary Vardigan vardigan@umich.edu

More Related