1 / 20

Astro -WISE -> TarGet

Astro -WISE -> TarGet. OmegaCEN – TarGet Kapteyn Astronomical Institute University of Groningen 28 August 2009 UU. Edwin A. Valentijn. Astro -WISE information system – fully datacentric. All data beyond pixel data is Metadata all pixel data <–>data servers

amanda
Download Presentation

Astro -WISE -> TarGet

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Astro-WISE -> TarGet OmegaCEN – TarGet Kapteyn Astronomical Institute University of Groningen 28 August 2009 UU Edwin A. Valentijn

  2. Astro-WISE information system – fully datacentric All data beyond pixel data is Metadata all pixel data <–>data servers all Metadata <–> database compute clusters / GRIDs all I/O to db • all components scalable • all components EU distributed

  3. VST - Virtual Survey Telescope

  4. Centers – satellites Brasil

  5. Astro-WISE paradigm

  6. TARGET diagram

  7. Central role db All I/O via db: params, sources, events Objects persistent in db data server access by global filename=key Security, proprietary, privileges parallel processing Web services Synchronized real time National Nodes

  8. the avalanche • on-the fly re-processing for everything • 5LS: 5 Lines Script Awe> prompt Python • Trend analysis Awe > prompt • All dependent bits are traced “tell_me_everything_tool • Administration for parallel processing -compute GRID • Connect to EGEE - Grid • Global solutions • astrometry/photometry • Build–in workflow • Fully user tunable – own provided script • Context: projects/surveys, instruments, mydb • Publish directly in EURO-VO

  9. Example 5LS #Find ScienceFrames for a ccd named ccd53 and filter Awe> q = (ReducedScienceFrame.chip.name == 'ccd53‘) and (ReducedScienceFrame.filter == ‘#841’) # From the query result, get the rms of the sky in image Awe> x = [k.imstat.stdev for k in q] # get the rms of the used Masterflat (dependency) Awe> y = [k.flat.imstat.stdev for k in q] # Make a plot Awe> pylab.scatter(x,y)

  10. + WFCAM, MegaCAM, LBC, ISAAC, LOFAR

  11. www.astro-wise.org

  12. Web servicesTarget processor

  13. Quality view

  14. Extreme data lineage

  15. TarGet TASK24 2009-13 32M

  16. Astro-WISE – LOFAR LTA IBM- Blue Gene/P 5 Petabyte/yr - EoR - Survey

  17. LifeLines165.000 patients 30 yr Molecular Integration MOLGENIS Physiology METABASE Care Healtcare Transaction Base (HTB/HL7)

  18. IJkdijk

More Related