orfeus-eu neries-eu Reinoud Sleeman ORFEUS Data Center

1. Seismological Data Exchange in Europe www.orfeus-eu.org www.neries-eu.org Reinoud Sleeman ORFEUS Data Center Royal Netherlands Meteorological Insitute (KNMI) sleeman @ knmi.nl IRIS - ORFEUS Workshop “Managing Waveform Data and Related Metadata for Seismic Networks”, Helwan, Cairo, Egypt 8 – 17 November 2009

2. International coordination local experts organizations regional service organization seismological observatory seismological observatory seismological observatory • Central expertise (ODC): • efficient way for archiving and • user access • different communication protocols • uniform QC / metadata • uniform data format • observatories coordination • international coordination • uniform data services • long-term archiving • Local expertise: • operations • site/equipment • acquisition • communication • QC • metadata • analysis User

3. International coordination . . . GEOSCOPE IRIS DMC GEOFON INGV seismological observatory • Coordination, standardization and development on European and global scale (FDSN): • formats (SEED, QuakeML) • interconnected data archive exchange • protocols (ArcLink; EIDA; QuakeML) • services for distributed, interconnected • data archives (Portal; websevices) seismological observatory seismological observatory • Central expertise (ODC): • efficient way for archiving and • user access • different communication protocols • uniform QC / metadata • uniform data format • observatories coordination • international coordination • uniform data services • long-term archiving • Local expertise: • operations • site/equipment • acquisition • communication • QC • metadata • analysis User

4. ODC structure Quality Control (Events, PQLX, PSD, manual processing, user feedback) Antelope 4.x Antelope 4.x EarthWorm SeedLink Antelope 4.x Antelope 4.11 SeedLink SeedLink SeedLink SCREAM Data Storage (MySQL, GDI) Data access services CD1.1 CD1.0 mini-SEED day-files 1 – 100 sps; BB InterNAQS

5. ODC structure • RT acquisition • Antelope 4.11 • SeedLink • SCREAM • CD1.x • InterNAQS • metadata (dataless SEED) • BB data; 1 – 100 sps • Processing and QC • Antelope 4.11 • PSD vs. Time • PQLX • histograms • manual QC • polarization analysis • SC3 (test) • data completeness • Storage • Antelope 4.11 • SCREAM • mini-SEED day-files • MySQL • GDI • Services • direct access (ftp) • Wilber II • OWI • NetDC • Breq_fast • AutoDRM • QuakeExplorer • ArcLink • Webservices • Portal • Linux RHE 5.1 • Solaris 10 • SAN 8 TB (“dynamic”) • RAID • tape robot • Linux RHE 5.1 • Linux RHE 5.1 • Solaris 10 • Windows NT

6. NERIES www.neries-eu.org Network of Research Infrastructures for European Seismology Addressing a European infrastructure challenge: archival and availibility of seismological data gathered by observatories and research facilities in Europe and its surroundings. NERIES is an Integrated Infrastructure Initiative (I3) project in the Sixth Framework Program (FP6) of the European Commission (EC), aiming at networking the European seismic networks, improving access to data, allowing access to specific seismic infrastructures and pursuing targeted research developing the next generation of tools for improved service and data analysis. The NERIES consortium consists of 25 participants (European universities and research centres) executing 18 different activities: 9 Networking Activities (NA), 5 Joint Research Activities (JRA), and 5 activities concerning Transnational Access (TA). The core of the NERIES project organization lies with the Observatories and Research Facilities for European Seismology (ORFEUS) and the European Mediterranean Seismological Centre (EMSC). Both organizations are working under the auspices of the European Seismological Commission (ESC). The NERIES Project Office is situated at the Royal Netherlands Meteorological Institute (KNMI). Duration: 1 June 2006 – 31 May 2010

7. NERIES Activities • Infrastructure Networking • Real-time data exchange (ORFEUS/Dost) • Distributed European waveform data archive (GFZ/Hanka) • Distributed European historical data archive (INGV/Stucchi) • Access to European accelerometer data (ICC/Roca) • Broadband OBS networking (IPGP/Singh) • Portal and data services (EMSC/Bossu) • Technology Transfer (workshops, grants) (KNMI/van Eck) • Infrastructure Research • European seismological reference model (INGV/Morelli) • Real-time hazard tools (ETHZ/Wiemer) • Shake-maps and rapid loss estimation (Kandilli/Erdik) • Geotechnical site characterization (LGIT/Bard) • New approaches to data mining (UnLiverpool/Rietbrock) • Infrastructure Access (grants) • Dense broadband network seismology SDSN/ETHZ (Christofferson) • Verification seismology CEA/DASE (Guilbert) • Historical seismograms SISMOS (INGV/Ferrari) • Array seismology NORSAR (Schweitzer) • Instrumentation test facility CONRAD (ZAMG/Lenhardt)

8. VEBSN – Virtual European Broadband Seismograph Network 2002 One of the primary data sources of the ODC is the Virtual European Broadband Seismograph Network (VEBSN). The VEBSN is a joint effort of European-Mediterranean seismological observatories in creating and maintaining a sustainable pool of broadband seismograph stations, the data of which is shared in (near) real-time to the ODC. This joint effort is coordinated within ORFEUS.

9. 2003

10. 2004

11. 2005

12. 2006

13. 2007

14. 2008

15. 2009

16. VEBSN contributoring networks (53; Nov 2009) II - IRIS/IDA Network IP - Instituto Superior Tecnico Broadband Seismic Net IS - Israel National Seismic Network IU - IRIS/USGS Network IV - Italian National Seismic Network KO - Kandilli Observatory MN - MEDNET NA - Netherlands Antilles Seismic Network NI – North-East Italy BB network (OGS, Uni. Trieste) NL - Netherlands Seismic Network NO - Norwegian Seismic Array Network NR - NARS Array NS - Norwegian National Seismic Network OE - Austrian Seismic Network PL - Polish Seismological Network PM - Portuguese National Seismograph Network RO - Romanian Seismic Network SJ - Serbian National Network SK - Slovak National Seismic Network SL - Slovenia Seismic Network SS - SINGLE STATION (Ebro Observatory) SX – Saxon network / Leipzig TU - National Earthquake Observ. Netw., Ankara, Turkey UP - University of Uppsala Network VI - Icelandic National Digital Seismographic Network pending: Irpinia Seismic Network, Napels, Italy University of Genua, Italy AI - Antarctic Seismographic Argentinean Italian Net BE - Belgian Seismic Network BN - UK-Net BS - National Network of Bulgaria BW - BayernNetz CA - Catalan Seismic Network CH - Switzerland Seismological Network CR - Croatian Seismograph Network CZ - Czech Seismic Network DK - Danish Seismological Network DZ - CRAAG, Algeria EI - Irish Regional Digital Seismic Network ES - SPANISH DIGITAL SEISMIC NETWORK FN - Northen Finland Seismological Network FR - French Broadband Seismological Network G - GEOSCOPE GB - Great Britain Seismograph Network GE - GEOFON GR - German Regional Seismic Network HE - Finnish National Seismic Network (HEL) HF - Swedish Seismic Array Network HL - National Observatory of Athens Digital Broadband HP - University of Patras HT - Aristotle University of Thessaloniki Seismology HU – Hungarian Seismological Network IG - Instituto Andaluz de Geofisica All permanent VEBSN stations are ISC registered and have a FDSN network code !

17. Meredian NERIES number of connections number of stations providing data % stations without data 20 %

18. Distributed data access EIDA – European Integrated Data Archive ArcLink (QuakeML DB; metadata + routing synchronization) • synchronization • routing on network level

19. NERIES Portal and Web application development Shopping for earthquake data and services in Europe and surroundings Develop a low maintenance sustainable portal using open source front-end technologies and latest standards for future evolutions Interactive request tool for easy and unified access to earthquake data and products for diverse audiences Involve the (European) seismological community in e-science developments, i.e. create an interested user community. New innovative and interoperable approaches to managing and exploring seismological data

20. Neries Web Services Example: CMT catalogue NERIES data portal Data Portal Agents (e.g. perl, java, pyton) Clients/applications HTTP Internet SOAP / REST comunication protocols WSDL (XML syntax) Webservices Seismolink QuakeML Taup SMI BB waveforms Event info Travel times Meta data (provenance) WSDL: Describe the services and their bindings (access points). Published and available on the Neries Portal

21. Seismic Data Portal SeismoLink webservice: stations inventory, waveform data retrieval Neries Portal Wraps the whole ArcLink network. Provides a single access to distributed archives of continuous waveform data Seismolink WebService getInventory dataRequest dataRetrieve purgeData checkStatus arcLink TCP client ODC arcLink node INGV arcLink node IPGP arcLink node GFZ arcLink node ~ 640 BB stations already available

22. Seismic Data Portal “Waveform Explorer” Remote Portlet Multi Modal waveform requests, Event or Time Modes Composition of datasets by the aggregation of distributed data sources within interactive mashups Users` Waveform “Event Explorer” Jetspeed Portlet Seismic Events Selection User Events Cart RapidSeis Portlet (Liverpool)