1 / 13

Research Program and Enterprise Architecture for Adaptive Survey Design At Census

Research Program and Enterprise Architecture for Adaptive Survey Design At Census. Peter Miller Anup Mathur Michael Thieme May 23, 2014. Adaptive Design Elements. A tailored and dynamic approach to case management in data collection

fritzi
Download Presentation

Research Program and Enterprise Architecture for Adaptive Survey Design At Census

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Research Program and Enterprise Architecture for Adaptive Survey Design At Census Peter Miller Anup Mathur Michael Thieme May 23, 2014

  2. Adaptive Design Elements • A tailored and dynamic approach to case management in data collection • Uses auxiliary frame data, paradata and response data to guide contact approaches and resource allocation • Employs a centralized system for controlling multiple data collection modes

  3. Data Resources for Adaptive Design • Frame data: e.g. type of structure, block group demographic statistics, alternative modes, (previous response data) • Paradata: contact history (effort and response propensity), interviewer observations, time and travel, progress, Web survey metrics • Response data: Current estimates for key variables • Quality metrics -> sample balance, response rate, stability/quality of estimates

  4. Tailored and Dynamic Case Management • Prioritize cases (e.g. NSCG, 2013 Census Test) • Prioritize modes (e.g.NSCG) • Shift priorities with experience (e.g. NSCG, 2013 Census Test) • Subsample open cases (e.g. Econ Census) • Stop data collection (e.g. NHIS) • Faster provision of data (e.g. NSCG)

  5. What Does it Take to be Adaptive? • An organizational mandate to “prove in” adaptive approaches to data collection • An understanding of the elemental capabilities required • An architectural approach

  6. Organizational Mandate Census Bureau Example • Established a Center with the primary responsibility for researching and implementing Adaptive Design for the enterprise • Staffed the new Center for Adaptive Design (CAD) with motivated representatives from each Directorate (Decennial, Demographic, Economic, Information Technology) • Inserted Adaptive Design goals in key strategic documents • Insisted that the CAD be a combined effort of Statistical Methodology and IT Enterprise Architecture • Robert Groves and John Thompson

  7. Architectural Approach • Work with Standards (common conceptual frameworks) • Create a solution architecture • Create a Program Roadmap

  8. Challenges • Accidental Architecture1 1 Source: Fostering Interoperability in Official Statistics: Common Statistical Production Architecture (UNECE, 2013)

  9. Challenges • This is what Accidental Architecture looks like at Census:

  10. Single Platform to Manage Multiple Data Collection Modes XML XML XML XML Maestro Sample & Response Processing User Interface Sample Policy Automation – Business Rules Layer Response + + Workflow Automation – BPM Layer Integration & Access Services Layer Responses From Modes Status From Modes Workload, Instrument for Modes Paper Mode Systems Internet Mode System Interview Operations Control (CATI, CAPI, TQA, Listing)

  11. Augment Frame Data XML XML XML XML Administrative Records Admin Records – Frame Augmentation Maestro Sample & Response Processing User Interface Sample Policy Automation – Business Rules Layer Response + Workflow Automation – BPM Layer + Integration & Access Services Layer Workload, Instrument Response Status Paper Mode Systems Internet Mode System Interview Operations Control (CATI, CAPI, TQA, Listing)

  12. Adaptive Orchestration of Data Collection XML XML XML XML XML XML XML Paradata Visualization, Modeling, Analysis, & Estimation Admin Records Administrative Records Paradata Admin Records – Frame Augmentation Estimates Response Sample & Response Processing Maestro Sample User Interface Policy Automation – Business Rules Layer Response + Paradata Workflow Automation – BPM Layer + Integration & Access Services Layer Workload, Instrument Response Status Paper Mode Systems Internet Mode System Interview Operations Control (CATI, CAPI, TQA, Listing)

  13. Plan for Rolling Out Adaptive Design Cale Baseline 1: Maestro Platform: Support ACS in 2016 Baseline 2: Maestro in place, add Paradata & Concurrent Analysis – Bring on Decennialand some Demo surveys in 2017 Baseline 3: Bring on more Demo surveys, start bringing on Econ surveys and Econ Census

More Related