380 likes | 1.22k Views
White Paper:. Considerations for Regional Data Collection, Sharing and Exchange. Bruce Schmidt StreamNet Program Manager Pacific States Marine Fisheries Commission Presentation to CBFWA Members Advisory Group May 18, 2009. www.streamnet.org.
E N D
White Paper: Considerations for Regional Data Collection, Sharing and Exchange Bruce Schmidt StreamNet Program Manager Pacific States Marine Fisheries Commission Presentation to CBFWA Members Advisory Group May 18, 2009 www.streamnet.org
If everyone wants a regional data delivery system… 2002 Council Contract with SAIC 2000 BiOp RPA 198 Why isn’t there one? 2008 BiOp RPA 72 CBCIS / NED 2006 Col. Basin Data Center Fish and Wildlife Program
Increasing Interest in Data Sharing Coordinated Monitoring ESA Recovery Planning Population Assessments (VSP) Need for Shared Data Listing- Delisting Decisions Inter-jurisdictional Management Co- management BiOp Compliance Legal: Remand, US v OR, PST, etc.
Regional Data SystemsFunctional and Proposed RMIS StreamNet PTAGIS DART IBIS Fish Passage Center PNW Water Quality Data Exchange RECFIN PACFIN Columbia Basin Center of Knowledge NED & PNAMP Columbia Basin Data Center CBCIS 2002 BiOp RPA 198 SAIC
Current Situation SOTR Population models Population Assessments Subbasin planning Planning HLIs Management Public, etc. Comprehensive Data Delivery System Database Projects ? ? db db db Data sources: Agencies / Tribes / Projects
Database Project Agency Database Data sources: field offices, research projects
What would a comprehensive data delivery system look like? Output Interface Data Management System Pacific Northwest Water Quality Data Exchange dd db db … Water Habitat Habitat Fish db db db db db db db Multiple types of data from multiple sources, standardized by data type
Comprehensive data delivery Output Interface Data Management System dd db db … Water Habitat Habitat Fish db db db db db db db db db db db db Multiple types of data from multiple sources, standardized by data type
Comprehensive data delivery Output Interface Data Management System Functionally Equivalent! Data flow can be automated dd db db … Water Habitat Habitat Fish db db db db db db db db db db db db Multiple types of data from multiple sources, standardized by data type
Advantages of automation • Efficiency, Speed • Automatic data updates • Accuracy • Canned products • Translation to regional format • Any database technology
Comprehensive data delivery Output Interface Data Management System standards Standards Standards … Water Habitat Fish db db db db db db db db db db db db Multiple types of data from multiple sources, standardized by data type
Comprehensive data delivery Output Interface … Water Habitat Fish db db db db db db db db db db db db Multiple types of data from multiple sources, standardized by data type
How does the Data Sharing Guide help? • Organize discussions • Consider ALL components • Provide a blueprint • Identify needed support Assure that when a system is built, the data are there to deliver!
Approach: • Non-prescriptive • Recognizes multiple approaches
Approach: • Content neutral • Data management, any data type • About the container, not the contents
Approach: • Agency neutral • Fish management, land management, environmental quality, etc.
Approach: • A basic primer • Provides a checklist of considerations • Elementary • Some already met
The Data Sharing Guide is intended to help development of coordinated data management, from field to highest reporting need Primary focus is on infrastructure to assure data availability
Previous Proposals • Pitched the output tool • Ignored getting data to the tool The Data Sharing Guide is intended to encourage consideration of all aspects
Any data system will need: Uninterrupted data flow, source to output
Data Flow Steps in data flow Regional data application GOAL Data interoperability Post data on the Web Post metadata on the Web Describe full data set(metadata) Regional standards Agency data QA / QC Agency database system Local use of data Describe the data (metadata) Quality Assurance / Quality Control Input to electronic form Field data creation (local office/project)
Data Flow Steps in data flow Regional data application GOAL Data interoperability Post data on the Web Post metadata on the Web Describe full data set(metadata) Regional standards Agency data QA / QC Agency database system Local use of data Describe the data (metadata) Quality Assurance / Quality Control Input to electronic form Field data creation (local office/project)
Data Flow Steps in data flow Regional data application GOAL Data interoperability Post data on the Web Post metadata on the Web Describe full data set(metadata) Regional standards Agency data QA / QC Agency database system Local use of data Describe the data (metadata) Quality Assurance / Quality Control Input to electronic form Field data creation (local office/project)
Data Flow Steps in data flow Regional data application GOAL Any missed step can prevent data flow! Data interoperability Post data on the Web Post metadata on the Web Significant effort to bridge the gaps! Describe full data set(metadata) Regional standards Agency data QA / QC Agency database system Local use of data Describe the data (metadata) Quality Assurance / Quality Control Input to electronic form Field data creation (local office/project)
Any data system will need: Data validated by agency
Any data system will need: Data and metadata on the Internet
To be useful, shared data on the Internet must be machine readable! Database: Access SQL Server My SQL Oracle GIS Spread-sheet: Excel Etc. Delimited Text (ASCII) Portable Document Format (.pdf) Extensible Markup Language (XML) Word Processing: Word Perfect Word
Any data system will need: Data roll together • Common definitions & formats, or • convertible to standard
All steps must be in place for seamless data delivery We can implement these steps before deciding on a data sharing tool
Sampling Crews Sampling Agencies Roles Database Projects Policy Makers Funding Entities Regional Data Users
Data Collectors (field crews) • Sample • Enter the data • Quality control • Data maintenance • Answer local questions
Data Collecting Agencies/Projects • Establish procedures, standards • Agency data systems • Post data • Select the posting approach • Biological and IT responsibilities
Funding / recommending entities • Negotiate • methods • data disposition • Contract language • Support data infrastructure
Regional policy makers • Priorities • Policies to encourage data sharing • Agency commitments
Database projects • Technical guidance • Systems development • Perform data tasks for agencies • Support regional data needs • Manage data channels
Data Sharing Guide will: • Inform development of regional data system • Assure all steps are in place (infrastructure) • Help us get started
Questions? www.streamnet.org Funded by: Through: Fish and Wildlife Program Administered by: