300 likes | 461 Views
Hanisch. ADASS 1999. Distributed Data Systems and Services for Astronomy and the Space Sciences. Robert J. Hanisch Space Telescope Science Institute Baltimore, MD. ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999. What does it mean for a service to be “distributed”?.
E N D
Hanisch ADASS 1999
Distributed Data Systems and Services for Astronomy and the Space Sciences Robert J. Hanisch Space Telescope Science Institute Baltimore, MD ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999
What does it mean for a service to be “distributed”? • Databases/archives need not be located at the same physical site • User’s query is passed to, and responses are returned from, multiple services via a common protocol • Responses/results presented to the user in an integrated fashion, as if resources were local and of similar structure ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999
Ground-Based Data Space Mission Data Catalogs What does it mean for a service to be “distributed”? ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999
We need distributed information services because... • No one site can hold all information • Information is dynamic; static catalogs and indexes quickly become obsolete • Astronomers use multiple types of data — images, spectra, time series; catalogs, journal tables; journal articles — all should be easily located and accessed with query terms and syntax natural to the discipline • Common entry point for multiple resources simplifies life for users ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999
Distributed information services in astronomy provide... • Information discovery: Search across distributed resources and services • ASDS, Astrobrowse • Information retrieval: Catalog services and on-line archives • VizieR, MAST, HEASARC, IRSA, … • Information integration: Catalog cross-correlation, image and graphical overlays, intelligent query/response management • IMPReSS, AMASE, SkyView, SkyCat, Aladin, Jsky ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999
Astrobrowse ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999
Astrobrowse ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999
AMASE ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999
SkyView ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999
SkyView ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999
SkyCat ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999
Aladin ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999
Next Step: Distributed Information Services for Space Science • Maximize scientific return from space science missions • Enable cross-cutting research utilizing what have traditionally been disconnected data resources • Provide access to and awareness of enabling tools and technologies • Software libraries • Computational resources ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999
Space Science Data Systems Planetary Data System SEC Data System Astrophysics • PDS Management Council • PDS Central Node (JPL) • Discipline Nodes • Atmospheres • Geosciences • Imaging • Navigation & Ancillary Info • Planetary Plasma Interactions • Rings • Small Bodies • Astrophysics Data Centers Coordinating Council • Datatype-Based Data Centers • IRSA (IPAC) • Infrared, Interferometry • MAST (STScI) • EUV, UV, Opt, Near-IR • HEASARC (GSFC) • EUV, X-ray, Gamma-ray • ADC (GSFC) • Catalogs • ADS (SAO) • Abstracts • Chandra (SAO) • SECDS Coordinating Council • Management Office • Service Groups • Solar Physics • Terrestrial Environment Imagery • In Situ Space Physics • Data Providers Planetary Exploration Search for Origins Structure and Evolution of the Universe Sun-Earth Connection Science Themes
Models for a Space Science Information System • “Good” - user can access many resources (current WWW; AstroWeb, SPDS) • “Better” - web-based client directs user queries to appropriate services (current AstroBrowse system) • “Best” - web-based client locates services relevant to user, sends queries, and collates responses (goal of ISAIA) ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999
Query/ Response Agent Query Agent User User User “good” “better” “best” Space Science Data Services Astro-browse The Web ISAIA
Building a Distributed Data System for Space Science • Standardize query protocols through use of profiles • Profiles map generic terms onto discipline or site-specific metadata and define the allowed logical operators (=, >, x .. y) • Keep infrastructure light-weight • Potential barrier for participation must be kept as low as possible • Data providers must not have to modify internal data services/structures • Automate maintenance and distribution of profiles, e.g., using GLU ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999
AstroBrowse AstroBrowse is a first generation effort to implement the query agent • Concept by R. Hanisch and S. Murray (SAO), implementations by T. McGlynn/C. Heikkila (HEASARC) and T. Kimball (STScI), GLU support from P. Fernique and M. Wenger (CDS) as well as CDS implementation AstroGLU • ~1000 resources (observation logs, catalogs) • Preselection of which resources to query by data type, bandpass, data location, etc. • Searches done using object coordinates (obtained from SIMBAD or NED name resolvers) ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999
ISAIA ISAIA (Integrated System for Archival Information Access) is the next step in implementation of the query/response agent • Intended to span all space science disciplines • Will layer upon and interface to existing systems (e.g., Planetary Data System DIS, Distributed Inventory System, and emerging SECDS) • Profiles map high-level standard terms to resource-specific qualifiers • Profile maintenance is distributed among participating sites and services via GLU ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999
ISAIA Development Requirements • “Light weight”: minimal to zero costs to data providers for participation, no constraints on how an organization manages its data internally • Preserve identity of participating services yet make their data available as seamlessly as possible Development Plan • Define profiles (work in progress) • Implement query agent based on profiles (next step in evolution of AstroBrowse) • Develop integrator ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999
ISAIA Profiles • Three components: • Resource profile characterizes data holdings and allows query agent to determine which sites and services to send queries to • Query profile provides map of generic query terms to site/service specific terms (e.g., bandpass filter name) • Returned information profile labels returned metadata to facilitate integration of results from different services • Profile implementation likely to utilize XML ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999
ISAIA Resource Profile Queryable Fields FACILITY name of observatory, mission, program, etc. DISCIPLINE astronomy, space physics, planetary science, solar physics INSTRUMENT HOST name of telescope (HST, IUE, COBE, …) INSTRUMENT NAME name of instrument (WFPC, NICMOS, FIRAS, …) INSTRUMENT TYPE magnetometer, spectrometer, imager, photometer, ... OBSERVED PHYSICAL photon, electron, proton, ion, atom, molecule, magnetic QUANTITY field, electric field, pressure, temperature, ... SAMPLING MODE time series, image, aperture, spectrum, visibility, scan, ... DATA CLASS pointed observation, survey observation, derived (catalog), simulation, model fit, ephemeris, software, literature DATA FORMAT FITS, CDF, PDF, HDF, ASCII, … TIME SPAN range of times covered by resource PRIN. INVESTIGATOR name of PI for INSTRUMENT NAME OBJECT NAME astronomical object name, planet name, region of space OBJECT TYPE asteroid, planet, star, quasar, solar wind, aurora BANDPASS optical, UV, IR, 2-10keV, ... ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999
ISAIA Integrator Following development of profiles, proto-typing will also be done on an integrator • An integrator is an application which receives query responses, labeled using the terms of the response profile, and presents response information in a uniform format • Functions include • conversion of units and coordinates into common system (, , , , l, b, t) • sorting of tabular data • maintaining intermediate results • cross-correlation ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999
ISAIA Team A. Rots (SAO) S. Hughes (PDS/JPL) S. McMahon (PDS/JPL) M. A’Hearn (UMd) R. Beebe (NMSU) F. Genova, F. Ochsenbein, P. Fernique, M. Wenger, F. Bonnarel (CDS) P. Giommi (BSDC) R. Hanisch (STScI), PI T. McGlynn, N. White (GSFC/HEASARC) J. King (GSFC/NSSDC) C. Cheung, E. Shaya (GSFC/ADC) R. Plante, R. McGrath, D. Guillaume (NCSA/UIUC) J. Mazzarella (IPAC/Caltech) • Interested in collaborations with other groups! ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999
URLs • Space Science Data System • http://ssds.nasa.gov/ • http://spds.gsfc.nasa.gov/ • http://pds.jpl.nasa.gov/ • AstroBrowse • http://heasarc.gsfc.nasa.gov/ab/ • http://archive.stsci.edu/starcast/ • http://simbad.u-strasbg.fr/glu/cgi-bin/ astroglu.pl • ISAIA • http://heasarc.gsfc.nasa.gov/isaia/ • GLU • http://simbad.u-strasbg.fr/glu/glu.html ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999