150 likes | 290 Views
NOAA Office of Ocean Exploration End-to-End Data Management: A Success Story. NOAA Tech Conference November 2005 Susan Gottfried National Coastal Data Development Center. Research Proposals. Expeditions Information System. Website archives, weblogs, situation reports, etc.
E N D
NOAA Office of Ocean ExplorationEnd-to-End Data Management:A Success Story NOAA Tech Conference November 2005 Susan Gottfried National Coastal Data Development Center
Research Proposals Expeditions Information System Website archives, weblogs, situation reports, etc. Post-cruise Reports & Publications ShipTracks & Underway Data Dive and non-dive activities & locations Scientific Instrumentation Raw/Processed Data Files Dive Videos and Digital/Still imagery and annotations Database & Documents Data files Video Physical samples Geological/Biological/Water Samples The Data Management Challenge • Standardize diverse data collection and management efforts • Handle multiple types of data and formats • Automatically generate required metadata • Make data discoverable and accessible
Integrated Product Team (IPT) NOAA’s Office of Ocean Exploration (OE) Expedition Information System (EIS) National Undersea Research Center (NURC) Management Information System (MIS) National Coastal Data Development Center (NCDDC) Metadata Enterprise Resource Management Aid (MERMAid) National Oceanographic Data Center (NODC) National Geophysical Data Center (NGDC) NOAA Central Library (NCL) College of Charleston Mitretek Systems, Inc.
Phase II Data Flow Research Proposals & Cruise Plans record MIS (Access Data Project, SQL Server) export/initialize Master EIS (Filemaker Pro 6) generate import/update ingest Runtime EIS Access db catalog Metadata Generation and Archive Public and Protected Data Discovery and Access reference
Phase III Data Flow record CIMS Portal CIMS Web-Instance (cruise specific) reference Metadata Generation and Archive Public and Protected Data Discovery and Access CIMS Data Repository
Cruise Information Management System (CIMS) • Proposal Management • Researchers submit and manage their proposals • OE Proposal managers use for decision making • Cruise Planning • Common interface for cruise participants • Standard cruise plan document • At-Sea Data Collection • Logical, efficient UI guides data manager • Synchs to main project data management component automatically • Project Data Management • Secure, controlled access to project data, post-cruise • Meets OE’s mission to eventually make data accessible to public
CIMS Technology Zope/Plone/Python • Web Based • Cost Effective • Readily Accessible • Strong Programming Community and Support • Built-in Security Features
Metadata Generation and Archive FGDC records ingested for cruise, project, dives, scientific activities CIMS Online Metadata Catalog for Public Discovery FGDC translated via MarcXML to Marc21, bundled with video, imagery, products and documents NOAA Central Library FGDC formatted metadata FGDC metadata bundled with oceanographic data sets NODC Archive FGDC metadata bundled with geophysical data sets MERMAid Create/Validate NGDC Archive
Data Discovery and Accesshttp:\\www.ncddc.noaa.gov\ocean-exploration\Home
Data Discovery and Access Video Data Management Systemwww.lib.noaa.gov • Developed by NOAA Central Library for OE • Developed digital video workflow requirements • from acquisition through archiving • Provides NOAALINC (online library catalog) access to OE data and information • Digital video clips - Maps • Cruise reports - Images • Raw data - Web Site • Establishing original materials archive • Participates in outreach and collaboration
Data Discovery and Access Data Discovery via Metadata Search Metadata management facilitates data access • Points of Access • National Spatial Data Infrastructure • NCDDC Metadata Catalog • NOAALinc • Geospatial One-Stop (GOS) • Data download available • Open data format
Collections Data Discovery and Access Digital Atlas GIS • Internet mapping of OE data collection activities • Integrates OE data with other NOAA and non-NOAA data • Integrates geospatial data with other data products • Developed in accordance with NOAA E-GIS characteristics Data Documents
Contact Information OE Deputy Director: John McDonough 301-713-9444 x113 John.McDonough@noaa.gov Federal Program Manager (NCDDC): Sharon Mesick 228-688-2256 Sharon.Mesick@noaa.gov Project Manager (NCDDC): Susan Gottfried 228-688-2459 Susan.Gottfried@noaa.gov CIMS Software Engineer (NCDDC): Stacy Ladnier 228-688-1878 Stacy.Ladnier@noaa.gov