1 / 1

NASA Goddard Space Flight Center, Goddard Earth Sciences Distributed Active Archive Center,Greenbelt, MD, 20771

To give Users the capability to upload, test their algorithms and mine data from the GDAAC online cache. Manage User’s research data more efficiently Decrease download time by applying algorithm closer to the Data Apply Knowledge Discovery in Database (KDD)

anitra
Download Presentation

NASA Goddard Space Flight Center, Goddard Earth Sciences Distributed Active Archive Center,Greenbelt, MD, 20771

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Togive Users the capability to upload, test their algorithms and mine data from the GDAAC online cache. • Manage User’s research data more efficiently • Decrease download time by applying algorithm closer to the Data • Apply Knowledge Discovery in Database (KDD) • Access 50 Tera Byte of online data i.e. MODIS, AIRS and more • Automated Subscription Processing onlinecache Original Data Mining Results NADM FTP WEB User Developed Algorithm GDAAC Web Site:http://g0dug03u.ecs.nasa.gov/OPS/www/nadm/index.html http://lake.nascom.nasa.gov/movas/ Acknowledgements:Authors would like to acknowledge all GES DAAC data support teams for their contributions and Edee Ocampo for graphics support. This work is supported by the NASA/GSFC Earth Science Enterprise. GES DAAC Services and Tools for the Terra and Aqua MODIS User Community A. Gopalan, D. Nickless, D.Ouzounov, A.Savtchenko, L. Pham, C. Lynnes, S. Berrick, Z. Liu and H.Rui http://disc.gsfc.nasa.gov • NASA Goddard Space Flight Center, Goddard Earth Sciences Distributed Active Archive Center,Greenbelt, MD, 20771 GDAAC SERVICES Summary Near-line Archive Data Mining (NADM) • The aim of this poster is to inform the MODIS User Community about the newest Services and Tools available from the GDAAC. We also show examples (MOVAS) of the same that have resulted from collaborative partnerships with various groups here at GSFC and elsewhere. • The Data Services are Applications that run on the GDAAC Systems and manipulate GDAAC data based on User demand. • The Data Tools are “Desktop Applications” that Users will need to download along with Data and then execute them on their local systems. MODIS L3 Atmospheric Products Online Visualization and Analysis System (MOVAS) GES DISC/DAAC is pleased to announce the GES DAAC Data User Online Collaboration forums. These Web-based forums have been set up to help you, the Data User, interact and collaborate with other Users and the DISC/DAAC on issues regarding the Data we distribute. The URL to bookmark is: http://disc.gsfc.nasa.gov/forum/ MODIS – User Discussion Forum specifically for users of GES DAAC MODIS data Data -> Aerosol – User Discussion Forum specifically for users of GES DAAC aerosol data.Data -> Cloud - User Discussion Forum specifically for users of GES DAAC cloud data.Data -> Ocean Color – User Discussion Forum specifically for users of GES DAAC ocean color data. • Easy to Use Web-based Tool (aerosol, water vapor and clouds, 1 x 1 degree, monthly,  April 2000 - present). Grid Analysis and Display System (GrADS) is used as a back-end engine for analysis. • The basic functions of MOVAS consist of, area plot, time series, Hovmoller diagram, animation, ASCII output for all plot types (excluding animation), multiple ASCII output for time series, and multiple area plots. MOVAS is easy to use. • MOVAS is the result of a Joint Collaboration between GES DAAC and AEROCENTER (GSFC Code 913) GES DAAC SERVICES: GES DAAC DESKTOP TOOLS: Automated Subscriptions to any Data in the Archive. Subsetting Services: These include On-demand Channel and Paremeter Subset, On-the-Fly subsetting. HDFLook-MODIS is a new, multifunctional, data processing and visualization tool for Radiometric and Geolocation, Atmosphere, Ocean, and Land MODIS HDF-EOS data. Features include: accessing and visualization of all swath (Levels l and 2) MODIS and AIRS products, and gridded (Levels 3 and 4) MODIS products; re-mapping of swath data to world map; interactive and batch mode capabilities; subsetting and multi-granule processing; and data conversion. MOVAS (MODIS L3 atmospheric data Online Visualization and Analysis System)is designed for quick exploration, analyses, and visualization of MODIS Atmospheres Monthly Level-3 product. NADM (Near-line Archive Data Mining) give Users the capability to upload, test their algorithms and mine data from the GDAAC online cache. SIMAPis an IDL-based script that is designed to read and map MODIS Level 1B and Level 2 Ocean and Atmosphere products. The resulting maps are scaled to physical units (e.g., radiances, concentrations, brightness temperatures etc.) and saved in binary files. One of simap's strengths is the composition of global maps, or the stitching together of multiple L1B or L2 granules on a single world map. WebGISis an online web software that implements the Open GIS Consortium (OGC) standards for mapping requests and rendering. Content-based Services (Only for MODIS Direct Broadcast Radiance Data) Overview of GES DAAC Services and Tools Functionality Data Services Data Pool (Fast Online Disk Cache): This consists (50 TB) Anonymous FTP area where "fresh" data are made available on a rotating basis. Its advantage is the ability for users to directly download data of interest, without having to submit an order. FTP Scripts automatically generated by the System, On- the-Fly Compression Capability can be used to optimize Data transfer process. http://daac.gsfc.nasa.gov/data/datapool/ Automated Data Subscriptions: (10 Gb Limit per Subscription per Day) to any Data in the Archive. Can Customized to various Data Attributes (e.g Area of Interest). Suited to Users who require a regular stream of Data over their Area of Interest. Special arrangements with GDAAC are necessary to use this Service. Please contact (help@daac.gsfc.nasa.gov). Data Distribution Options: Electronic (FTP) Options include FTPPULL (User will need to FTP Data staged on a GDAAC FTPServer) and FTPPUSH (User FTP Server is Configured to accept Data Transfer from GDAAC). Distribution subject to Limit of 1000 “Granules per Order”. http://daac.gsfc.nasa.gov/MODIS/FAQ/A_max_size.shtml Hard Media Options include DVD (GDAAC supplied Limit: 95 per Year), 8mm Tapes (GDAAC supplied Limit: 65 per Year), DLT (GDAAC supplied Limit: 6 per Year). User will be required to supply their own media if their Data order exceeds above limits. content-based subscription calibratedradiance “Send only scenes where Lake Winnebago, Wisconsin is visible” content-based subset classifypixels Extract useful pixels, or Mask out useless pixels and compress onlinecache content-based cache management “Least-recently-used” (LRU) algorithm is less useful for very active caches. Content-based caching applies simple heuristics to scene content to: (1) Retain scenes with more useful/interesting pixels (2) Purge less useful scenes quickly SIMAPhttp://daac.gsfc.nasa.gov/MODIS/simap DESKTOP TOOLS MODIS Global Browse Images SIMAP maps MODIS Level 1B, Level 2 Oceans and Atmosphere Data: • It is an IDL code wrapped in an IDL batch file. • It is a command-line utility and thus focuses on automatic production of mapped imagery. • Platform independent • Can be easily changed/expanded to fit user needs. • Good for automatic production of unlimited number of mapped images. • Features: • Mapping of MODIS L1B, Level 2 Oceans and Atmosphere using all available IDL Map projections. • Uses either native L1B or MOD03 geolocation data. • Detection and interpolation of invalid geolocations. • Stitching of multiple granules in the map space. • Converting to physical units. • Automatically saves the map in image and binary format. • The program is simple so that new modules can be added either in the source code, or in the batch file. • The batch file design allows for inclusion in cron jobs, and shell or Perl scripts. HDFLook-MODIS HDFLook-MODIS is a result of joint collaboration between LOA UST, France, and GES DAAC. Features: • Modular tool, easy to update, add new features • Free to users obtaining it from DAAC • HDF Data Compatibility: All Land, Atmospheric and Ocean MODIS/Terra and MODIS/Aqua products, AIRS L1B and POLDER; • Mapping and Projections: Geo-projection conversion for L2, L3, and L4 products: LINEAR.GOODE’S, MOLLWEIDE, HAMMER, AZIMUTHAL, LAMBERT, MILLER, MOLLWEIDE, ORTHOGRAPHIC, SINUSOIDAL, VAN DER GRINTEN,WAGNER 7, ISIN,POLDER • Multi granule processing: Mosaic and Stitching • Subsetting: Channel, Parameter, Spatial; Subsampling • Data Conversion: HDF-EOS to ASCII, Binary, JPEG and GeoTIFF • Interactive, operational and batch mode: All current capabilities are available in both interactive and command line modes • AERONET data bank access: Aerosol and other ancillary data are available from the ground based sun-photometer measurements (AERONET data bank). • XWindows CE: SGI and Linux MODIS/Terra Level 2: Local Scenes: 5-minute orbital swaths, 1 km (produced with SIMAP) http://daac.gsfc.nasa.gov/MODIS/HDFLook/

More Related