P-20 Data Warehouse Integration and Governance

1. P-20 Data Dictionary November 16, 2011 11:15 – 12:15 Kit Goodner, FL Mike McKindles, IL Rod Packard, WI

2. P-20 Data Dictionary: FL Background FL Administrative Rule 6A-10015 determines content of Education Data Warehouse (EDW); DD not mandated but metadata standards defined by source systems (F.S. 1008.31) EDW implemented in 2002; Metadata tool developed to manage the EDW DD Metadata tool custom built for managing DD; Access/Oracle; DataStage ETL tool .Net Tool for public access to the EDW DD; http://edwapp.doe.state.fl.us/home.aspx Content and current architecture EDW incorporates 26 total source systems in a single warehouse; Metadata tool currently manages DD only for EDW Multiple data dictionaries exist for individual source systems; source systems are multiple platforms (from Excel and Access to mainframe DB2) PK-12, Florida Colleges and Universities, Technical Centers are the major contributors – approx 60% of EDW data; Assessment data approx 30%

3. P-20 Data Dictionary: FL Data Dictionary Audience Internal technical staff for developing ETL, advanced reports Internal researchers using Business Analytics/Intelligence tools External researchers and users (data requests/reports) Standards Current DD based on FL statewide standards and FL law – considered more detailed than CEDS in certain areas (for Florida) National standards continue to be evaluated and adopted where possible Future Direction COTS Metadata Management Tool to be employed as part of SLDS 09 grant Consolidated Model for EDW and source systems; Single Metadata Management tool to be utilized for managing all data dictionaries Multiple integration points in addition to DDs – ETL tools, data mining tool; BI tools, etc.

4. P-20 Data Dictionary: IL P-20 Organizations - defined by P-20 state legislative act Illinois State Board of Education (ISBE) – K-12, Early Childhood Illinois Community College Board (ICCB) – Community college data Illinois Board of Higher Education – 4 year institutions Illinois Higher Education Consortium – voluntary organization to collect postsecondary data Workforce – Illinois Department of Economic Security (IDES), Department of Commerce and Economic Opportunity (DCEO), Licensing agencies Human Services ILDS Data Advisory Committee, P-20 Council – serve in advisory capacity Architecture Federated/distributed verses Consolidated Scope of P-20 – not determined, driven by usage scenarios • Owners of data determines usage Governed by Intergovernmental Agreements • Data Governance – in formulation phase

5. P-20 Data Dictionary: IL P-20 Data Warehouse based on State Core Model (SCM), CEDS • Use of SCM includes mapping to NEDM, SIF, other specifications • Model includes mapping to existing CEDS, will need to be updated for new release • Model has been suggested to postsecondary, workforce Data Architecture includes “first generation” metadata tool – will need to build tooling, metadata will be publicly accessible ILDS project includes data stewardship, will maintain metadata for ILDS project Challenges Large number of K-12 districts – 869, with local control of systems, data Large number of K-12 collection systems will require data integration, and resolution of definitions Postsecondary collection to include public, private, and proprietary institutions Multiple governance structures – ILDS DAC, P-20 Council, Workforce, Human Services Federated/distributed verses Consolidated architecture Major K-12 data collection systems undergoing rewrites

6. P-20 Data Dictionary: WI Wisconsin P20 Introduction Compact to “establish, maintain and govern” an LDS crafted by the WI Legislature early in 2010 • Does reference Early Childhood and workforce but emphasizes K16 • Signed by UW System (UWS), Wisconsin Technical College System (WTCS), Wisconsin Association of Independent Colleges and Universities (WAICU) and DPI Solidified by SLDS Grant and project charter signed in September 2010 • Project today concentrating on K12 to post-secondary The result is the extension of the state K12 data warehouse into higher education with a federated system and interoperable datasets, governed by MOU • All partners have their own data warehouse that includes student level data (or will) • Wisconsin Student Number (WSN) is used to link these datasets

7. P-20 Data Dictionary: WI Data Dictionary? Today each P20 partner has documentation and data on their data What is “New” is the alignment or connection of these datasets Plan is to define and publish common file layouts using subject areas/attributes as defined by CEDS • PS Course and PS Enrollment • Each partner will map to these (single document) • Create standard extracts to produce these files Publish contact information for each P20 partner • No single point of entry Anticipated audience – policy analysts and researchers • Requestor is required to navigate the different organizations Curious what tools CEDS 2 will provide?

8. P-20 Data Dictionary: Contact Info and Resources Contact Info: Kit Goodner, 850-245-0072, Keith.Goodner@fldoe.org Mike McKindles, 217-782-0335, mmckindl@isbe.net Rod Packard, 608-266-7049, Rodney.Packard@dpi.wi.gov Resources: NCES Forum Guide to Metadata: http://nces.ed.gov/pubs2009/2009805.pdf