100 likes | 237 Views
More Data Center Tools. Rick Benson IRIS DMC. SHAPE Software SEED Header Assembly and Preparation Engine. SHAPE - Build dataless SEED files from SEED RESP and other info
E N D
More Data Center Tools Rick Benson IRIS DMC Data Management Workshop Kuala Lumpur, Malaysia
SHAPE SoftwareSEED Header Assembly and Preparation Engine SHAPE - Build dataless SEED files from SEED RESP and other info Controlled with a Header Assembly Template (HAT) file in XML format wherein SHAPE finds the needed details for building a SEED file including names of RESP files and blockette field values • Easily used in scripts, good for batch creation of dataless SEED, complimentary to PDCC at this point • Good for templating (common components defined once) • Java, runs anywhere a JVM is available Available from http://www.isti.com/~sid/shape/ Data Management Workshop Kuala Lumpur, Malaysia
SHAPE HAT Examples SHAPE Header Assembly Template examples Field substitution: Very simple example: Data Management Workshop Kuala Lumpur, Malaysia
Portable SEED File Reading Jrdseed - Java port of the IRIS-DMC’s ‘rdseed’ • Reads full SEED, dataless SEED and Mini-SEED+dataless • Writes SEED, SAC, AH, CSS, SEGY, SEED RESP • Time-window and other output selection possible • Runs anywhere a JVM is available • Based on generic JavaSeed classes available separately • Not as complete as ‘rdseed’ yet Data Management Workshop Kuala Lumpur, Malaysia
libmseed - Mini-SEED Library • Allows reading and writing of Mini-SEED records • Written in C • Supports all structures of SEED 2.4 with a few minor caveats (blockette 2000 and blockette 405) • Supports all valid record lengths and big or little endian • Supports ASCII, int-16, int-32, float-32, float-64, Steim-1 and Steim-2 encoding formats for reading and writing; supports SRO/ASRO, DWWSSN and GEOSCOPE encoding formats read-only • Manages arbitrarily long continuous trace segments and groups of continuous trace segments composed, for example, of many Mini-SEED records • Tested on Solaris, Linux, Mac OSX and MS-Windows Available from: http://www.iris.edu/pub/programs/ Data Management Workshop Kuala Lumpur, Malaysia
Example libmseed programs msi - Mini-SEED Inspector Parse and print useful information about Mini-SEED in one or many files. Including continuous segment construction, data sample printing, etc. msstat - Calculate minimum, maximum, arithmetic mean, standard deviation and RMS for Mini-SEED in one or many files. msrouter - Sort Mini-SEED records based on one or many format details (network, station, location, start time, sample rate, quality, etc.), for example “%s-%c.mseed” PQLII/PQLX - Data visualization/analysis program using libmseed. Data Management Workshop Kuala Lumpur, Malaysia
Example converters seisan2mseed - SeisAn to Mini-SEED converter mars2mseed - MARS 88/lite to Mini-SEED converter gse2mseed - GSE 2.0/2.1 or IMS 1.0 to Mini-SEED converter, supports both INT and CM6 data encoding sac2mseed - SAC to Mini-SEED converter mseed2sac - Mini-SEED converter to SAC converter All run on Linux, Solaris, Mac OSX and MS-Windows Available from: http://www.iris.edu/pub/programs/converters/ * Many other converters are available at the IRIS-DMC, IRIS-PASSCAL, ORFEUS, etc. Data Management Workshop Kuala Lumpur, Malaysia
PQLII/PQLX Software The evolution of the PASSCAL Quick Look software for data viewing and analysis Key new features: • - Data display organized as continuous time series (by channel), large data sets • - User-defined filters • - Integrate and differentiate time series • - Remove mean from trace • - Read "RESP" format metadata • - PDF plots Coming soon: • - Compute cross-correlation coefficient between selected traces • - PSD plots for selected data • - Remove instrument response • - Event-orient analysis: predicted arrivals, alignment, sorting PQLII: http://www.passcal.nmt.edu/software/software.html PQLX: http://geohazards.cr.usgs.gov/staffweb/mcnamara/Software/PQLX.html Data Management Workshop Kuala Lumpur, Malaysia
Real-time Data Exchange A number of open-source and commercial data exchange systems exist, the bridges between them are illustrated below. Data Management Workshop Kuala Lumpur, Malaysia
IRIS-DMC Contact Information • Administration, cooperative agreements, etc. Tim Ahern, Program Manager, Data Management System tim@iris.washington.edu • Operations: submitting and/or requesting data and metadata Rick Benson, Director of Operations rick@iris.washington.edu • Software details Robert Casey, Director of Software engineering rob@iris.washington.edu • Quality control and related bits Chad Trabant, USArray Lead Data Control Analyst chad@iris.washington.edu Data Management Workshop Kuala Lumpur, Malaysia