1 / 10

More Data Center Tools

More Data Center Tools. Chad Trabant and Rick Benson IRIS DMC. SHAPE Software SEED Header Assembly and Preparation Engine. SHAPE - Build dataless SEED files from SEED RESP and other info

anise
Download Presentation

More Data Center Tools

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. More Data Center Tools Chad Trabant and Rick Benson IRIS DMC Data Management Workshop São Paulo, Brazil

  2. SHAPE SoftwareSEED Header Assembly and Preparation Engine SHAPE - Build dataless SEED files from SEED RESP and other info Controlled with a Header Assembly Template (HAT) file in XML format wherein SHAPE finds the needed details for building a SEED file including names of RESP files and blockette field values • Easily used in scripts, good for batch creation of dataless SEED, complimentary to PDCC at this point • Good for templating (common components defined once) • Java, runs anywhere a JVM is available Available from http://www.isti.com/~sid/shape/ Data Management Workshop São Paulo, Brazil

  3. SHAPE HAT Examples SHAPE Header Assembly Template examples Field substitution: Very simple example: Data Management Workshop São Paulo, Brazil

  4. Portable SEED File Reading Jrdseed - Java port of the IRIS-DMC’s ‘rdseed’ • Reads full SEED, dataless SEED and Mini-SEED+dataless • Writes SEED, SAC, AH, CSS, SEED RESP • Time-window and other output selection possible • Runs anywhere a JVM is available • Based on generic JavaSeed classes available separately Data Management Workshop São Paulo, Brazil

  5. libmseed - Mini-SEED Library • Allows reading and writing of Mini-SEED records. • Written in C. • Supports all structures of SEED 2.4 with a few minor caveats (blockette 2000 and blockette 405). • Supports all valid record lengths. • Supports ASCII, int-16, int-32, float-32, float-64, Steim-1 and Steim-2 encoding formats. • Tested on Solaris, Linux, Mac OSX and MS-Windows. • Supports big or little endian data records, all data read on a given machine will be in the local byte order. • Manages arbitrarily long continuous trace segments and groups of continuous trace segments composed, for example, of many Mini-SEED records. Writing of traces or trace groups to Mini-SEED. • Design to be used in multiple ways from very detailed oriented handling to hiding all the details of the SEED data format. • Able to read full SEED volumes by skipping the non data records. Available from: http://www.iris.edu/pub/programs/ Data Management Workshop São Paulo, Brazil

  6. Example libmseed programs msi - Mini-SEED Inspector Parse and print useful information about Mini-SEED in one or many files. Including continuous segment construction, data sample printing, etc. msstat - Calculate minimum, maximum, arithmetic mean, standard deviation and RMS for Mini-SEED in one or many files. msrouter - Sort Mini-SEED records based on one or many format details (network, station, location, start time, sample rate, quality, etc.) PQLII/PQLX - Data visualization/analysis program using libmseed. Data Management Workshop São Paulo, Brazil

  7. Example converters seisan2mseed - SeisAn to Mini-SEED converter mars2mseed - MARS 88/lite to Mini-SEED converter gse2mseed - GSE 2.0/2.1 or IMS 1.0 to Mini-SEED converter, supports both INT and CM6 data encoding sac2mseed - SAC to Mini-SEED converter mseed2sac - Mini-SEED converter to SAC converter All run on Linux, Solaris, Mac OSX and MS-Windows Available from: http://www.iris.edu/pub/programs/converters/ * Many other converters are available at the IRIS-DMC, IRIS-PASSCAL, ORFEUS, etc. Data Management Workshop São Paulo, Brazil

  8. PQLII/PQLX/PQLY Software The evolution of the PASSCAL Quick Look software for data viewing and analysis Key new features: • - Data display organized as continuous time series (by channel), large data sets • - Read event hypocenter information and phase picks • - Sorting by distance from user-specified location or known event • - Compute and display predicted arrivals based on hypocenter event info • - User-defined filters • - Trace alignment based on picks • - Compute cross-correlation coefficient between selected traces • - Integrate and differentiate time series • - Read "RESP" format metadata • - Remove mean from trace • - PSD and PDF plots • - Remove instrument response PQLII available from: http://www.passcal.nmt.edu/software/software.html Data Management Workshop São Paulo, Brazil

  9. Real-time Data Exchange A number of open-source and commercial data exchange systems exist, the bridges between them are illustrated below. Data Management Workshop São Paulo, Brazil

  10. Content • SHAPE - Build dataless from RESP - Easily used in scripts, good for batch creation of dataless, complimentary to PDCC at this point. - Good for templating with common SEED. - Java, runs anywhere. • Libmseed overview - more than simple record reading • Libmseed based tools: msi, msrouter, msstat • Libmseed based converters: seisan2mseed, gse2mseed, sac2mseed, mseed2sac, mars2mseed • Mention a number of internal DMC data fixing tools are available upon request, some similar to what PASSCAL uses. • PQLII/PQLX/ILL • Jrdseed • Real-time systems and bridges… • Verseed usage? (need more?, already illustrated in QC portion) • JPlotResp/JEvalResp (maybe done at end of PDCC lab?) Data Management Workshop São Paulo, Brazil

More Related