310 likes | 496 Views
The iNtegrated Space Weather Analysis System. Barbara J. Thompson NASA Goddard Space Flight Center. iSWA Team: Marlo Maddox (PI), M. M. Maddox, D. H. Berrios, M. Hesse, M. M. Kuznetsova, P. Jain, P. J. MacNeice, M. L. Mays, R. E. Mullinix, A. Pulkkinen, L. Rastaetter, A.Taktakishvili.
E N D
The iNtegrated Space Weather Analysis System Barbara J. Thompson NASA Goddard Space Flight Center iSWA Team: Marlo Maddox (PI), M. M. Maddox, D. H. Berrios, M. Hesse, M. M. Kuznetsova, P. Jain, P. J. MacNeice, M. L. Mays, R. E. Mullinix, A. Pulkkinen, L. Rastaetter, A.Taktakishvili http://SWL.gsfc.nasa.gov http://CCMC.gsfc.nasa.gov http://iSWA.gsfc.nasa.gov http://twitter.com/NASAiSWA
NASA Mission Data Non-NASA Mission Data Commercial Data University / Educational Institution Data International Data Spacecraft Charging Forecast Energetic Proton Warning Martian Atmospheric Heating Communica- tion Outages Energetic Particle Forecasts
Distributed Space Weather Resources CCMC Space Weather Model Resources Internet Resource Registry iSWA TS Information Retrieval Robot IRR WA >40K files per day • New data products are created using raw data and combinations of existing data products • Routinely ingest and receive external data streams. • Automatically configures / re-configures via a resource registry database • Data products are registered and packaged for display in iSWA system Data Registry DS Data Sorter • Data is registered in database, time-tagged, sorted, categorized, and archived in a data tree Data/Tool Registry Tool Service BACK END Product Registry FRONT END Widget Agent CWDS • iSWA System Interface provides a highly configurable control panel to present operators with only the products and tools of interest Cygnet Registry Configurable Web-Based Dissemination Service Internet • 335Unique Data Feeds, 18.5 Million Files Registered and Archived, 250Consumable Display Products currently managed in iSWA Cygnet Catalog User Configurable Displays
iSWA Design Highlights • Comprehensive data model that drives the system • Minimizes need for actual code modifications • Allows rapid additions and modifications to data feeds and display products • Every granule of data is registered, cataloged, and archived • Access data products for any available time period • Generate new tools and functionality using multiple existing data products BACK END • Consistent Interface with uniquely identifiable product icons • Customizable layout • automatically saved on browser exit • can be bookmarked and shared • Auto-updating products and tools • Individual and global date search functionality for historical impact analysis • Movie mode functionality for all image-based cygnets • Tools to facilitate tracking and monitoring of SWx events FRONT END
Layout & Global Controls Cygnet Control Panel Cygnet Date Controls Options Movie Mode Control
Cygnets: The Building Blocks of iSWA Solar
Cygnets: The Building Blocks of iSWA HELIOSPHERE
Cygnets: The Building Blocks of iSWA MAGNETOSPHERE
Cygnets: The Building Blocks of iSWA IONOSPHERE
Cygnets: The Building Blocks of iSWA EVENT TRACKING
Interactive Products Interactive CME alert tool with chronological record of SWx Desk issued CME time of arrival predictions Interactive timeline tool with pan, zoom, mouse-over, and quantity toggling functionality
Other tools: Widgets and Apps CCMC Widget System Requirements Dashboard: Mac OSX 10.4 or later Yahoo Widget: Yahoo's Widget Engine 4.5 or later
iPhone App Google Earth SWx Service
Summary / Future SWL, CCMC, & SWx Desk aim to advance space weather specification and forecasting capabilities… • Implement new 1D time-series database and interactive timeline capabilities in iSWA • Develop a Movie/Animation Mode for All Cygnets • Provide data export options directly from timeline cygnets • More data products: SDO/EVE, far-side imagery • More Alerts: flares, feature identification systems • Continue to: • develop custom/tailored tools based on customer feedback • bring in the most advanced models and data streams http://iSWA.gsfc.nasa.gov
iSWA Impact • NASA • iSWA provides a new capability to quickly assess past, present, and expected space weather effects. • Mission operators have a resource to assist in both anomaly resolution as well as potential space weather impacts. • iSWA has helped enable the Space Weather Laboratory to establish a new Space Weather Desk service providing alerts, anomaly reports, and weekly space weather summaries based on iSWA tools and products. • External Agencies • Air Force Space Weather Agency can monitor the iSWA system 24x7 for CME eruptionsand notifies the CCMC as soon as an event is detected. A notification triggers a CME Cone Model calculation at CCMC that estimates the CME arrival time, duration, and expected impact on earth. • iSWA has enabled numerous collaborations with data, model, and product developers/providers who want their tools to be available in iSWA. • Science, Education, and Public Outreach • Researchers, universities, and “citizen scientists” have access to a comprehensive suite of real-time and historical space environment data products. http://iSWA.gsfc.nasa.gov
The iNtegrated Space Weather Analysis System Marlo Maddox 674 / Space Weather Laboratory 587 / Science Data Processing Branch Heliophysics Director’s Seminar May 20, 2011 http://SWL.gsfc.nasa.gov http://CCMC.gsfc.nasa.gov http://iSWA.gsfc.nasa.gov http://twitter.com/NASAiSWA NASA Goddard Space Flight Center
Community Coordinated Modeling Center Products & Services What the CCMC provides: • Model Coupling in collaboration with model owners • Scientific Validation of Models • Metrics implementations • Model Runs on Request • Real-Time Products • Anchor for SWx Desk Services at GSFC ( Issue Alerts, Warnings, & Anomaly Reports ) • SWx Support - develop tailored space weather analysis tools in support of NASA missions, Operations, and Forecasters • Data Format Standardization • Advanced Visualization
Model Simulation Runs-On-Request http://ccmc.gsfc.nasa.gov CCMC Center at NASA Requests • 25+ Available Models ( covering from the Sun to Earth ) • User Configurable Input Parameters • Data Downloads • Simulation Archive • Searchable Database • Online Visualization Tools • Downloadable Analysis Software • Automated Movie Generation Tools Results
About The CCMC “A US multi-agency partnership to enable, support and perform the research and development for next generation space science and space weather models.”
CCMC Goals CCMC Address National Space Weather Needs Facilitate Community Research NASA, DoD and NOAA ..through partnering with the international community
High Availability Architectures • IP failover • Load Balancing proxy/virtual proxy front end servers • Database Replication • Data Tree Replication/Mirroring • Multi-site ( multi-building in our case ) backups systems • Redundant Storage Fabrics • Network Failover with Dual Homing
Runs-On-Request vs. Real-Time Processing CCMC Center at NASA Requests Results http://ccmc.gsfc.nasa.gov http://iswa.ccmc.gsfc.nasa.gov
Space Weather Models at the CCMC GUMICS UPOS RB CMIT-LFM WINDMI BATSRUS PFSS Open GGCM LFM-MIX ANMHD Exospheric Solar Wind Fok RC/RB WSA PF+CS/WSA-IH Weimer2K Heliospheric Tomography SAMI2 USU-GAIM CTIP AbbyNormal ENLIL MAS/CORHEL MAS/WSA/ENLIL EMMREM TIE-GCM SWMF SC/IH/BATSRUS+RCM/GITM http://ccmc.gsfc.nasa.gov/models/
iSWA Project Overview • OCE Technical Excellence Initiative Project • Partnership between NASA HQ OCE, SWL, CCMC, & AETD • Address technical challenges in acquiring space weather environment information • Began March 2008 • Version 1.0 deployed November 2009 • Fundamental Challenges To Be Addressed • Existing space weather resources are diverse and scattered • Data accessibility • Accurate real time now-casting & forecasting of the space environment • Historical space weather impact analysis • Initial Requirements Gathering • GSFC SSMO, JSFC SRAG
iSWA Solution & Deliverables • Acquire, ingest, and produce relevant space weather information • Utilize both observational and simulation/model data • Categorize and archive data for historical impact analysis • Produce and provide real-time data streams • Provide customizable and highly configurable displays • Disseminate through the most widely deployed and accessible interface – the web
Data Management Challenges • Ingesting data streams from a variety of sources with varying: • Transfer Methods ( push and pull ) • Levels of availability • Access Protocols ( http, ftp, scp, mv ) • Naming Conventions • Update Intervals ( efficient polling for new data ) • Date & Time Stamp Formats i.e. • [ 2011-01-01_212500] or [ 2011-1-1_212500] or [ 20100101_212500] or • [ 2011_001_212500] or [ 2010_Jan_01_212500] or [ latest] or… • Sorting, Archiving, and Management • Persistent storage ( file system or database ) • Cataloging, How to keep track of what is where • Scalability, Additional storage • Changes ( urls, names, formats, extensions, etc. )