1 / 24

OSN Archive: Current status and future implementations

OSN Archive: Current status and future implementations. José Miguel Ibáñez Instituto de Astrofísica de Andalucía - CSIC Sierra Nevada Observatory First SVO Workshop on data publishing in the Virtual Observatory. Outline. Observatory Instruments Data Archive Architecture Current status

maribeth-madsen
Download Presentation

OSN Archive: Current status and future implementations

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. OSN Archive: Current status and future implementations José Miguel Ibáñez Instituto de Astrofísica de Andalucía - CSIC Sierra Nevada Observatory First SVO Workshop on data publishing in the Virtual Observatory

  2. Outline • Observatory • Instruments • Data Archive • Architecture • Current status • Future implementations • Conclusions

  3. Observatory • OSN: Observatorio de Sierra Nevada (www.osn.iaa.es) • Observatory located at the ski resort of Sierra Nevada (2896m), Granada (Spain) • Founded in 1981 by IAA-CSIC • Instrument Control Systems developed and maintained by IAA staff • Optics maintained by IAA staff • Remote, In-situ and Service observing • Production: ~20 papers/year

  4. Hard working conditions

  5. Instruments • T150cm • CCD • VersArray 2048B - 2k x 2k • FOV ~ 8’ x 8’ • Filtros: Johnson, Strömgren, Gunn, Molecular, Halpha, Emission, Cometary • Albireo Spectrograph (CCD 2kx2k) • Slit, Argus (IFU) • 5 Diffraction Gratings • Under upgrade (GAIA RVS duplicator)

  6. Instruments (II) • T90cm • CCD • VersArray 2048B - 2k x 2k • FOV ~ 13’ x 13’ • Filtros: Johnson, Strömgren, Gunn, Molecular, Halpha, Emission, Cometary • Strömgren photometer • simultaneous observations of the bands uvby • bands n and w Crawford Hb photo-metric system

  7. Instruments (III) – to be archived • T60cm • BOOTES-IR (under development) – GRBs alerts • T35cm • CCD Kodak 4008 x 2672 • FOV ~30’ x 20’

  8. Data Archive - www.osn.iaa.es

  9. Data Archive Architecture • Lector • Automatically retrieve FITS files from the instruments (daily) • Parse headers • FITS renamed YYYYMMDD.HHMMSS.<filaname>.fit • Insert data into BD • User subscription and notification • Generate report • GUI • Web interface • Queries and data download (public & proprietary) • Image & header preview

  10. Architecture

  11. E-R Database

  12. ADA project • ADA (Archivo de Datos Astronómico) • Funded by project P07-FQM2864 of Junta de Andalucía • Started March 2008 • First release: Sep 2009 • Raw data (science & calibrations) • Collaboration with company

  13. Main functionalities • Raw data (science & calibrations) • Easy to add new instruments  Edit XML config file • Automatic user subscription  OBSERVER keyword • Public & Proprietary data • Proprietary period: • Metadata (headers): used defined, default to 1.5 year • Data (images): used defined, default to 1.5 year • Name Resolver (Sesame service) • Outputs: html, csv, VOTable • Download: Tarball

  14. Development tools • Linux OS: Debian 5 • MySQL DB • Apache Tomcat 6 • GUI: Spring Framework v2.5.6 + jQuery 1.3.x

  15. Computer system • 2 x CPU Xeon E5430 @2.66 GHz (2 x 4 cores) • 16 GB RAM • 5 TiB RAID 5+1 • Linux Debian 5.05 • @ IAA • Radio-link OSN-IAA

  16. Web interface: query

  17. Web interface: results

  18. Current status: numbers • 60 users • 2013: 210 GB / 68k files • Total: 786 GB / 260k files)

  19. Future developments • Update OS: migration to Debian 7 • Add Strömgren data (photometric tables)  convert to FITS • Improvements to Web interface • Query optimization • Improvement of user data search (by campaign ID) • Improvement of file download process (dataset > 3000 files) • Astrometric calibration (WCS): Astrometry.net • VO services data publication • ConeSearch • SIAP (Simple Image Access Protocol) • SSAP (Simple Spectrum Access Protocol)

  20. Future++ developments • Make available to the community observations taken before September 2009 (2002-2009): CD/DVDs ingestion • Reduced data  Pipelines • Spectra • Image • Photometric catalogs High level data products VO

  21. Questions ?

More Related