1 / 2

LSST = Large Synoptic Survey Telescope:

LSST: Preparing for the Data Avalanche through Partitioning, Parallelization, and Provenance (poster P2, room 1307) by Kirk Borne. LSST = Large Synoptic Survey Telescope: A ten-year movie of the night sky, which generates 100,000 alerts each night – anything that goes bump in the night!

asha
Download Presentation

LSST = Large Synoptic Survey Telescope:

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. LSST: Preparing for the Data Avalanche through Partitioning, Parallelization, and Provenance(poster P2, room 1307) by Kirk Borne • LSST = Large Synoptic Survey Telescope: • A ten-year movie of the night sky, which generates 100,000 alerts each night – anything that goes bump in the night! • Cosmic Cinematography! = The New Sky • How do you process, archive, catalog, and distribute a 65-Petabyte image archive and a 70-Petabyte database catalog? ... come to the poster #P2 to find out. • Features of LSST data management system: • Sky Partitioning of the data speeds ingest and retrieval. • Data Parallelization speeds pipeline processing. • Data Provenance: • Reduces archive storage requirements • Tracks every configuration change and state of the system • Allows data product generation on-the-fly (= VIRTUAL DATA)

  2. LSST Data Challenges Camera Specs: 201 CCDs @ 4096x4096 pixels each!= 3 gigapixels = 6 GB per image, covering 10 sq.degrees = ~3000 times the area of one Hubble Telescope image • 3-Gigapixel camera is largest ever used • Obtain one sky image every 15 seconds • Process image in 5 seconds • Obtain & process a second co-located image for science validation (within 15 + 5 seconds) • Process the 100 million sources in each image, catalog all sources, and generate worldwide alerts within 60 seconds (e.g., incoming killer asteroid) • Generate 100,000 alerts per night • Obtain 2000 images per night • Produce 30 Terabytes per night • Move the data from South America to SDSC daily • Repeat this every day for 10 years (2014-2024) • Provide rapid DB access to worldwide community: • 65-Petabyte image archive • 70-Petabyte database catalog Observing Strategy: One pair of images every 40 seconds for each spot on the sky, then continue across the sky continuously every night for 10 years (2014-2024), with time domain sampling in log(time) intervals (to capture dynamic range of transients).

More Related