140 likes | 268 Views
Infrasound Data: Assets, Availability, Access Roger Bowman and Robert Woodward Second NSF Infrasound Workshop June 8, 2005. Overview. US Army SMDC Monitoring Research Program Supports the R&D community through the Research and Development Support Services (RDSS) project The RDSS provides
E N D
Infrasound Data: Assets, Availability, Access Roger Bowman and Robert Woodward Second NSF Infrasound WorkshopJune 8, 2005
Overview • US Army SMDC Monitoring Research Program • Supports the R&D community through the Research and Development Support Services (RDSS) project • The RDSS provides • Waveform archive • Extensive infrasound waveform data (1995 – present) • Seismic data • Hydroacoustic data • Event bulletins • Prototype IDC products (1995-2000) • IDC products (2000-present) {this function is migrating to the US NDC} • Research databases • Research tools • This presentation provides an overview of infrasound-related RDSS products and services 2
Infrasound Data Assets • Archiving data from 34 stations • We provide a complete archive of these data • Instant access to archived data (local and remote) • Web-based tools for viewing and downloading data I57US 3
Data Storage • The entire 14 Terabyte waveform archive is on spinning disk • Infrasound • Seismic • Hydroacoustic • Benefits • Rapid data access • Two orders of magnitude improvement in access speed relative to tape-based system • Data anywhere in the archive may be accessed in seconds • Facilitates new data access tools • Instant downloads • Waveform browsing • Data stored in “analysis ready” format 4
Data Availability Yearly • Interactive view of data holdings, via web site • Yearly • Monthly • Daily • Hourly • Infrasound data from 1995 to the present Monthly Daily Hourly 5
Dynamic Data Browsing • Interactive viewing of all data holdings • Web based • Standard web-browsers with no client-side modifications, no software to download • Completely dynamic (not just static pictures) • Fast! 6
Data Downloads Refine Request • Access to all data in archive (every sample!) • Infra, seismic, hydro • CSS3.0 and SAC formats View Waveforms Download Waveforms 7
Data Downloads (2) Select Event • “Short cut” requests for bulletin events • User defined events • Calendar–based time selection • Arbitrary stations/times Refine Request Download Waveforms 8
Monthly Infrasound Status Report and Web Site • E-mail monthly status report • Companion web site • Network maps • Data summary plots • Station metadata Data & Metadata Web Sitewww.rdss.info/infrastat E-mailed Report 9
Station Metadata Wind Filter Parametric Metadata • Major effort to assemble a comprehensive DB of station metadata • Parametric metadata • Location • Calibration/response • Instrument type • Wind filters • Environmental metadata • Vegetation • Terrain • Review of data and metadata to identify errors • Inconsistent units • Mismatched calibration epochs • Etc. Terrain and Land Cover Environmental Metadata for I34MN 10
Validating Metadata Example of metadata validation • Compute • RMS pressure • RMS wind • Median wind direction • One month intervals • Examine data quality, range, etc. wind direction wind speed micropressure 11
Support for Data-Intensive Computing • Entire data archive resides on a 14Tb spinning disk mass-store system • Data are stored in analysis-ready format (CSS3.0) • A remotely accessible UNIX server provides direct access to the entire data archive • Host has Oracle access, Matlab, compilers • Supports data-intensive computations • Upload code rather than downloading data • Example: Milton Garces uploaded his code to this machine and is processing multiple station-years of data • Software accesses data in same manner as if data are “staged” on a local disk 14 Tb Mass-Storage System 12
Infrasound Database Historical and Modern Infrasound Recording Locations • Database of special events and waveforms to support research activities • Database content • 31 nuclear explosions • 10 chemical explosions • 7 bolides/fireballs • Expanding infrasound database in 2005 • Growing network enables us to add important new events 13
Conclusions • Extensive infrasound data archive • Open site at http://www.rdss.info • Some data and products only available via the restricted web site • https://www.rdss.info • IMS confidentiality restrictions • Quality controlled metadata • Tools and services • Interactive data availability • Waveform browsing • Instant data downloads • Data intensive computing • Research databases 14