1 / 24

Architectures and Technologies Enabling the Diffusion of Atmospheric Science Information

Data. Application. Data. Application. Application. Data. Data. Application. Data. Application. Architectures and Technologies Enabling the Diffusion of Atmospheric Science Information. Think Networking!. Rudolf B. Husar and Erin Robinson Washington University, St. Louis

dolf
Download Presentation

Architectures and Technologies Enabling the Diffusion of Atmospheric Science Information

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Data Application Data Application Application Data Data Application Data Application Architectures and TechnologiesEnabling the Diffusion ofAtmospheric Science Information Think Networking! Rudolf B. Husar and Erin Robinson Washington University, St. Louis Presented at EGU, Vienna April 18, 2007

  2. The Transformational Effect of Networking “Networking has led to an unprecedented surge of productivity” Time Magazine, Person of the Year 2006, YOU • Information has become the main driver of progress • Time and place are no longer barriers to participation and interaction • The Web has become a medium participation - ‘Web 2.0’ phenomenon • These are opportunities to enable Earth Science through more networking • But many resistances to networking exist that need to be overcome

  3. Networking Multiplies Value Creation Enclosed Value-Creating Process - ‘Stovepipe’ Data Application 1 User Stovepipe Value =11 Data x 1 Program = 1

  4. Networking Multiplies Value Creation Application Application Stovepipe Data Application Application Application 1 User Stovepipe Value =11 Data x 1 Program = 1 5 Uses of Data Value =51 Data x 5 Program = 5

  5. Data Application Data Application Stovepipe Data Application Data Application Data Application Networking Multiplies Value Creation 1 User Stovepipe Value =11 Data x 1 Program = 1 5 Uses of Data Value =51 Data x 5 Program = 5 Open Network Value =255 Data x 5 Program = 25 Merging data may creates new, unexpected opportunities Not all data are equally valuable to all programs

  6. Users Provider Public EPA AIRNow NASA DAACs EPA Model Manager Scientist others other Agile Information System: Data Access, Processing and Products Data Value Adding Processes Organizing DocumentStructure/FormatInterfacing

  7. Uniform Access Users Provider Public EPA AIRNow NASA DAACs EPA Model Manager Scientist others other Agile Information System: Data Access, Processing and Products Data Homogenizing Format profile Standard accessData as Service Value Adding Processes Organizing DocumentStructure/FormatInterfacing

  8. Uniform Access Data Processing Web Service Chain Users Provider SciFlo Public EPA AIRNow NASA DAACs DataFed EPA Model Manager Scientist Custom Processing others other Agile Information System: Data Access, Processing and Products Data Homogenizing Format profile Standard accessData as Service Value Adding Processes Organizing DocumentStructure/FormatInterfacing Characterizing Display/BrowseCompare/FuseCharacterize

  9. Uniform Access Data Processing Web Service Chain ProductsReports Users Provider SciFlo Public EPA AIRNow Forecast NASA DAACs DataFed EPA Model Compli. Manager Science Scientist Custom Processing others Other other Agile Information System: Data Access, Processing and Products Data Homogenizing Format profile Standard accessData as Service Analyzing Filter/IntegrateAggregate/FuseCustom Analysis Value Adding Processes Organizing DocumentStructure/FormatInterfacing Characterizing Display/BrowseCompare/FuseCharacterize

  10. Uniform Access Data Processing Web Service Chain ProductsReports Users Provider SciFlo Public EPA AIRNow Forecast NASA DAACs DataFed EPA Model Compli. Manager Science Scientist Custom Processing others Other other Value-Adding Processes Data Homogenizing Format profile Standard accessData as Service Analyzing Filter/IntegrateAggregate/FuseCustom Analysis Value Adding Processes Organizing DocumentStructure/FormatInterfacing Characterizing Display/BrowseCompare/Fuse Characterize Reporting Inclusiveness Iterative/AgileDynamic Report

  11. Uniform Access Data Processing Web Service Chain ProductsReports Users Provider SciFlo Public EPA AIRNow Forecast NASA DAACs DataFed EPA Model Compli. Manager Science Scientist Custom Processing others Other other Agile Information System: Data Access, Processing and Products Control Data Control Seeking Information Negotiating & Market Space Data Providing Information

  12. System of SystemsGlobal Earth Observing System of Systems - GEOSS Characteristics of System of Systems (SoS) • Autonomous constituents managed/operated independently • Independent evolution of each constituent • SoS displays emergent behavior Must recognize, manage, exploit the characteristics: • No stakeholder has complete SoS insight • Central control is limited; distributed control is essential • Users, must be involved throughout the life of a SoS

  13. Lets agree onSpace-Time-Parameter Data Access Query Protocol

  14. Interoperability Stack: Key concept of the Web Connecting Machines and People System components have to be interoperable at each layer Amplify Individuals Connect Minds Service OrientationOpen Architecture Data Standards IP – Internet Protocol

  15. Uniform Access Data Processing Web Service Chain ProductsReports Users Provider Control SciFlo Public EPA AIRNow Forecast NASA DAACs DataFed EPA Model Compli. Manager Data Acquisition Data Science Scientist Custom Processing others Other other Loosely Coupled Data Access through Standard Protocols Server GetCapabilities Client Standard Messaging What data you have? Give me this data Std. Interface Std. Interface Capabilities, ‘Profile’ Back End Where? When? What? Which Format? Front End GetData Data Standard Data Query Language: Where? When? What? (Space-time query - WMS, WCS) T1 T2

  16. Uniform Access Data Processing Web Service Chain ProductsReports Users Provider Control SciFlo Public EPA AIRNow Forecast NASA DAACs DataFed EPA Model Compli. Manager Data Acquisition Data Science Service Chaining & Workflow Scientist Custom Processing others Other other Web Services and Workflow for Loose Coupling Software Mashups Workflow Software:Dynamic Linking Software Mashup:Coarse-grain Linking

  17. Uniform Access Data Processing Web Service Chain ProductsReports Users Provider Control SciFlo Public EPA AIRNow Forecast NASA DAACs DataFed EPA Model Compli. Manager Data Acquisition Data ScreenCast Science Scientist Custom Processing others Other other Collaborative Reporting and Dynamic Delivery Co Writing - Wiki Collaborative Analysis and Writing Wiki, Blogs, Group Annotations Dynamic Content Delivery: GoogleEarth, Screencasting…

  18. Data Providers Info System Info Users Public AIRNow AIRNow Model Manager Compliance Scientist DAACs Science • Current info systems are project/program oriented and provide end-to-end solutions • Part of the data resources of any project can be shared for re-usethrough DataFed • Through the Federation, the data are homogenized into multi-dimensional cubes • Data processing and rendering can then be performed through web services ‘Stovepipe’ and Federated Usage Architectures Landscape • Each project/program can be augmented by Federation data and services

  19. DataFed: 100+ Datasets Non-intrusively Federated Near Real Time Data Integration Delayed Data Integration Surface Air Quality AIRNOW O3, PM25 ASOS_STI Visibility, 300 sites METAR Visibility, 1200 sites VIEWS_OL 40+ Aerosol Parameters Satellite MODIS_AOT AOT, Idea Project GASP Reflectance, AOT TOMS Absorption Indx, Refl. SEAW_US Reflectance, AOT Model Output NAAPS Dust, Smoke, Sulfate, AOT WRF Sulfate Fire Data HMS_Fire Fire Pixels MODIS_Fire Fire Pixels Surface Meteorology RADAR NEXTRAD SURF_MET Temp, Dewp, Humidity… SURF_WIND Wind vectors ATAD Trajectory, VIEWS locs. • Data are accessed from autonomous, distributed providers • DataFed ‘wrappers’ provide uniform geo-time referencing • Tools allow space/time overlay, comparisons and fusion

  20. Sample of Federated Datasets

  21. A Sample of Datasets Accessible through ESIP MediationNear Real Time (~ day) It has been demonstrated (project FASTNET) that these and other datasets can be accessed, repackaged and delivered by AIRNow through ‘Consoles’ MODIS Reflectance MODIS AOT TOMS Index MODIS Fire Pix GOES AOT GOES 1km Reflec NEXTRAD Radar NWS Surf Wind, Bext NRL MODEL

  22. Summary Grand ConvergenceWill we make use of it? • Third-party mediation can homogenize distributed ES data • Agile SOA-based IS can deliver diverse info products to users • Since 2005, one such IS, DataFed is used by EPA and in research • However, more data need to be federated by the community Parting thoughts Think outside the stovepipe – Think networking Divide and Conquer, NO! Connect and Enable, YES! Thank you

More Related