580 likes | 600 Views
DEQ BMP Warehouse Overview. Bill Keeling. NPS Modeling and Data Coordinator. 6/17/2019. Agenda. CBP Reporting – National Environmental Information Exchange Network - NEIEN DEQ reporting application – WH development Application status and updates Website and link
E N D
DEQ BMP Warehouse Overview Bill Keeling NPS Modeling and Data Coordinator 6/17/2019 Virginia Department of Environmental Quality
Agenda CBP Reporting – National Environmental Information Exchange Network - NEIEN DEQ reporting application – WH development Application status and updates Website and link Registration and Operation Templates Search/Export Options Issues/solutions Q&A 3
Reporting to the Bay Program Nonpoint Source BMP data reporting - condition of EPA Chesapeake Bay Implementation and 319 Grants 2009 last year partnership jurisdictions allowed to report using spreadsheet input decks to CBP 2010 progress first EPA mandated use of the National Environmental Information Exchange Network (NEIEN) NEIEN uses XML instance file database to database transfer using a schema and governed by most current Data Element Table, Codes Lists, and BMP Appendix A http://webservices.chesapeakebay.net/schemas/ Process best described as a hungry but very finicky consumer of BMP data 4
Development of the Warehouse(2014Concept) • 2014 to early 2015 • Conceptualization and requirements development • Contract development and award • Summer 2015 development begins • Data flow • Begins with successful upload – import database • BMPs located outside CBWS or not currently accepted by CBP not transformed to NEIEN XML schema • BMPs located inside CBWS and accepted by CBP are made ready to submit to DEQ NEIEN node – NEIEN export database • From 1 to on average 3,000 records are selected per NEIEN submission – unique tracking IDs associated with unique submission ID 6
Application Use and Upgrades • 12/2015 first instance of WH system operational • Supplied 2015 annual BMP data to phase 5 model • 2016 DEQ updated system for reporting 2017 progress data • phase 5’s final year and begin phase 6 reporting includes historical record – ability to report to both phases of CBP model • Ability for MS4 BMP reporting • Ability to collect Section 319 NPS Grant funded BMPs • Replaces Attachment D1 NPS BMP Reporting Form • 2018 annual reporting and onward will be to phase 6 7
Bay Program Data Flow Warehouse NEIEN Scenario Builder Reporting Entity VADEQ VADEQ node CBP node CBP node CBP Watershed Model Data may pass NEIEN validation but fail processing in CBP Scenario Builder – Iterative correction process Report by 12/1 of each year for CBP progress year i.e. 7/1/2017 to 6/30/2018 = 2018 progress year 8
Phase 6 Historical Record • Submitted several times with different EPA mandated changes to NEIEN (4/2016, 5/2016, 9/2016, 12/2016, and 8/2017) • Developed by hand and submitted outside WH • 2/2018 all records through 6/30/2016 (2017 Progress) re-submitted via WH application • Simplifies updating information – i.e. Inspection/Maintenance dates provided CBP 9
Current Status • Utilized for 2015 thru 2018 “Annual Progress” reporting • As of June 3, 2019 • 216,896 records imported (earliest record 1955) • 186,057 records submitted for CBP phase 6 model • 45,212 records submitted for CBP phase 5 model • 175 users (141 external or non-DEQ) • 527 listed organizations 10
Planned Use • For Virginia’s future annual progress reporting to CBP • Data collection for grants reporting • Collect more than just CBP (non-Bay) BMP implementation • Target Deadline for submitting data to DEQ BMP Warehouse for CBP reporting • October 1, 2019 11
Website and Link to Application https://apps.deq.virginia.gov/BMP/ 12
Registering 13
Landing Page 20
Data Validation • Validation is iterative across a record • Records with multiple validation issues will require multiple upload attempts (date out of range, missing extent, no location….) • Until all records validate template will not process 36
Questions • Who can view/upload data? • Registered persons (email associated with a listed organization) can upload, search, and edit that organizations data • Contractors with confirmed organization approval • DEQ can add new organizations at anytime 46
Questions • Who gets “credit”? • Location information uploaded is retained and reported as provided • BMP distribution at finest CBP model segment scale (land river segment) • “Submitted” verses “Credited” and Verification 47
Questions • What can be uploaded? • BMP template as downloaded – any alteration of format/structure = rejection • BMPs listed in the General and Grants Upload Templates • What currently cannot be uploaded? • BMPs not listed in the General or Grants Upload Templates 48
Questions • Are programmatic BMPs reported in the warehouse? • Not currently but could explore adding this functionality • Need BMP names and measures 49
Questions • What about BMPs for industrial facilities, outside of the MS4 service area but within the locality, who reports those and gets the credit? • Any listed organization willing to provide verification can report via the WH. Credit is based on reason selected and location data provided. 50