50 likes | 280 Views
Commentary on: The Virtual Observatory. G. Jogesh Babu Center for Astrostatistics http://astrostatistics.psu.edu. Speed Mbps. Rent $/month. $/TB Sent. Context. $/Mbps. Time/TB. 0.04. 40. 1,000. 3,086. 6 years. Home phone. Home DSL. 0.6. 50. 117. 360. 5 months. T1. 1.5.
E N D
Commentary on: The Virtual Observatory G. Jogesh Babu Center for Astrostatistics http://astrostatistics.psu.edu
SpeedMbps Rent$/month $/TBSent Context $/Mbps Time/TB 0.04 40 1,000 3,086 6 years Home phone Home DSL 0.6 50 117 360 5 months T1 1.5 1,200 800 2,469 2 months T3 43 28,000 651 2,010 2 days OC3 155 49,000 316 976 14 hours OC 192 9600 1,920,000 200 617 14 minutes 100 Mpbs 100 1 day Gbps 1000 2.2 hours Moving Data is Slow! How long does it take to move a Terabyte? (how about a Petabyte?) Source: TeraScale Sneakernet, Microsoft Research, Jim Gray et al.
Data analysis for VO • Federate the existing and forthcoming large digital sky surveys and archives, and provide the tools for their scientific exploitation • A dynamical, interactive, web-based research environment for the new astronomy with massive data sets http://astrostatistics.psu.edu/vostat/ • Technology-enabled, but science-driven
The VOStat ProjectWeb-based statistics services for the VO(Babu, Feigelson,Djorgovski, Graham, Mahabal, Nichol, Wasserman, et al.) Data Data Client Data Powerful Statistical Computers VOStat Web service Client Client Tools for data exploration and analysis in the VO and other science environments
Streaming algorithms • Object detection in multi-epoch/band data(Data from different surveys of the same field) • Sequential smoothing of massive multivariate data. • Convex hull pealing methods • Exploratory analysis on subsets of data through VOStat