280 likes | 378 Views
Building Footprint Data Collection and Processing. Allen Sparks Enterprise GIS Program Resource Information Management Division National Information Services Center Office of the Chief Information Officer. Presentation Outline. History of the Buildings Standard
E N D
Building Footprint Data Collection and Processing Allen Sparks Enterprise GIS Program Resource Information Management Division National Information Services Center Office of the Chief Information Officer 2008 GIS & Data Management Conference
Presentation Outline • History of the Buildings Standard • Buildings Data Model Implementation • Initial Data Collection Efforts • Lessons learned • Next Steps 2008 GIS & Data Management Conference
History of the Buildings Standard • Buildings chosen as “low-hanging fruit” • Standards team formed • Standard developed through multi-year process • Regional GIS programs agree to support effort • Implementation started FY2007 2008 GIS & Data Management Conference
Buildings Data Model Original Model 2008 GIS & Data Management Conference
Buildings Data Model Implemented Model 2008 GIS & Data Management Conference
Initial Data Collection • Geodatabase & Shapefile templates • Rudimentary Upload/Download Workflow • Simple Summary Statistics • Documentation • Support (Contact Form) 2008 GIS & Data Management Conference
Access to External Data • FMSS • Read-only Direct Access to Oracle DB • SQL Server Integration Services (SSIS) to Replicate Data. (Session 19) • Efficient & Easily Repeatable • LCS • Unable to Obtain Direct Access • Manual Extract/Transform/Load • Generate 3 Reports – Save as Access97 • Load from Access97 into SQL Server • Inefficient & Error-Prone 2008 GIS & Data Management Conference
Creating Park Templates • Model Builder used to: • Query FMSS & LCS extracts • Create schema and relationships • VBScript generated • Command line wrapper • 4-6 hours to create templates for all parks 2008 GIS & Data Management Conference
Download / Upload • Active Directory Organizational Unit • EGIS “OU” • Park Groups used for Access Control • Scripts for creation and management of groups • Read, or Edit (Upload) Access • Folder structure with Access Control Lists (ACLs) containing EGIS Groups 2008 GIS & Data Management Conference
Download / Upload • Active Directory Organizational Unit 2008 GIS & Data Management Conference
Download / Upload • http://egis.nps.gov • EGIS Contacts Table • Simple Table in SQL Server • Doesn’t Support 1:Many User:Park relationships • “Primary” users get Upload access • ‘Data Grabber” Web Page • Integrated Windows Authentication • User selects Park, then Dataset • Uploaded data placed in folder • Email sent to RIMD Staff • All transactions logged 2008 GIS & Data Management Conference
EGIS Contacts Table 2008 GIS & Data Management Conference
Download / Upload Overview 2008 GIS & Data Management Conference
Download / Upload Overview 2008 GIS & Data Management Conference
NPS System Viewer http://insidemaps.nps.gov/npssystemviewer 2008 GIS & Data Management Conference
Completion Statistics (20080401) 2008 GIS & Data Management Conference
Lessons Learned • Database Model • Highly “Normalized” is good for data integrity, but increases complexity of data development; • Solutions: • Simplify the Model; • Develop Tools for Loading and Validating Data; • Tools would need to be Model-Specific • Generalize the Model and develop tools • ** Reusable Model and Tools ** 2008 GIS & Data Management Conference
Lessons Learned • Database Model • Requests for minor revisions to standard • Polygon_Type, Point_Type • Map_Method • Position_Error • Opportunity to simplify model • Remove Subtypes • Move link fields to Buildings Table • Some re-coding of data required • Implications for data distribution • need to deliver transformed data back to the field 2008 GIS & Data Management Conference
Lessons Learned Data Collection and Distribution • Download / Upload is labor intensive • ** Current process does not support delivery of existing Building Footprints to parks • Current Solution is Not Scalable / Sustainable for Multiple Simultaneous Theme Collection Efforts • Solutions: • Improve Download / Upload Process (Interim) • Use Distributed Geodatabase technology • Leverage Lessons Learned by Dave Best • Collaboration with Army Corps of Engineers 2008 GIS & Data Management Conference
Lessons Learned • Data Display • Basemap Performance • It is not feasible to develop a service-wide basemap with reasonable performance • A commercial-service is required • Currently using ESRI ArcWebServices 2008 GIS & Data Management Conference
Next Steps • Database Standard and Model • Publish comments and responses to proposed standard revision • Final revision to model • Publish on Data Store • Transform Existing Data into New Model 2008 GIS & Data Management Conference
Evolution of the Model 2008 GIS & Data Management Conference
Next Steps • Data Collection / Distribution • Revise Process for Generating GDBs • Generate New GDBs and Shapefiles • Update Documentation • Begin a new Data Collection Cycle 2008 GIS & Data Management Conference
Next Steps • Data Display • Revisions to System Viewer • See Session 24 (Nate Irwin) • ArcGIS 9.3 Services • Microsoft Virtual Earth Basemap 2008 GIS & Data Management Conference
Park Media Future “Generic” Standard 2008 GIS & Data Management Conference
Questions? 2008 GIS & Data Management Conference