90 likes | 189 Views
MARVELS Viewer SDSS3 - BPG Luiz Nicolaci da Costa Paris, 15th September 2010. Outline Download of MARVELS data Data model MARVELS Viewer. Download of MARVELS data Download of whirls spectra: spectro/redux/v00.1.17/<MJD>/reduction1/whirls and RV curves:
E N D
MARVELS Viewer SDSS3 - BPG Luiz Nicolaci da Costa Paris, 15th September 2010
Outline • Download of MARVELS data • Data model • MARVELS Viewer
Download of MARVELS data • Download of whirls spectra: spectro/redux/v00.1.17/<MJD>/reduction1/whirls • and RV curves: spectro/redux/v00.1.17/RESULTS • Total: 337G in 915940 files, many of them (the whrl spectra) are quite small (20K) many http connections, difficult to download • Should keep the whirls spectra (*.whrl) and the aggregated FITS (by plate) in different folders • Should pack the <MJD> folder for download
Download rate Download a list of ~ 10.000 files in parallel (wget) Gaps caused by excessive disk I/O Not a good strategy. Should pack files for download.
MARVELS data model • Entities: targets + spectra + radial velocity curves • Relations: each target can have many spectra but only one rv curve.