200 likes | 303 Views
Connecting large data bases to users through open-source, web-based tools Part I. Annette Schloss Institute for the Study of Earth, Oceans and Space. Our goals: To broaden the user base of large, scientific data sets and improve our own access to data and analysis tools. MODIS. IKONOS.
E N D
Connecting large data bases to users through open-source, web-based tools Part I Annette Schloss Institute for the Study of Earth, Oceans and Space
Our goals: To broaden the user base of large, scientific data sets and improve our own access to data and analysis tools MODIS IKONOS
Goals for IPCC Data Access data information
Methods - good, bad, and ugly! data • Aggregate data in time and space • Create customized products • Embed information in pictures Aggregate data in time and space information
Climate Impacts from the NCAR Community Climate Model Model Runs 20C simulation 100+yr scenarios Annual & decadal map products Regional trends & time-lines 5 ensembles 3-hourly 6-hourly daily monthly Data reduction for the NCAR IPCC climate runs
Methods - good, bad, and ugly! data • Aggregate data in time and space • Create customized products • Embed information in pictures Create customized products information
http://eos-webster.sr.unh.edu Since 1999
Geotiff Example • 1.4 degree grid • One+ time-steps (1 shown) • Only grids that overlay France Data reduction and reformatting
Next Steps: Make these services Web-accessible New workflows needed
Methods - good, bad, and ugly! data • Aggregate data in time and space • Create customized products • Embed information in pictures Embed information in pictures information
8-bits of Information Chlorophyll • MODIS satellite image • Scaled exponentially 1-255 • Bad data, no data = 0
8-bits of Information 8-bit Gif = 680 Kb HDF-EOS = 6.5 Mb NetCDF = 32 Mb Chlorophyll mg/m3 0 1 60 0 255 Reasonable representation of chlorophyll
8-bits of information green red
Results data • Data stream greatly reduced • Information for many uses is not lost information