460 likes | 576 Views
Making Climate Change Data Easier to Find and Use. Michael Corsello Seshu Vaddey. Climate Change is a Paradigm Shift. In how we think of climate dynamics : Non- Stationarity. Climate Change is a Paradigm Shift. In how we work As Planners, Engineers, Biologists, Hydrologists, etc.
E N D
Making Climate Change Data Easier to Find and Use Michael CorselloSeshu Vaddey Michael.Corsello@ieee.org http://Eclime.blogspot.com
Climate Change is a Paradigm Shift • In how we think of climate dynamics: • Non-Stationarity Michael.Corsello@ieee.org http://Eclime.blogspot.com
Climate Change is a Paradigm Shift • In how we work • As Planners, Engineers, Biologists, Hydrologists, etc. Michael.Corsello@ieee.org http://Eclime.blogspot.com
Climate Change is a Paradigm Shift • Goal: Maximize the value of climate data in your organization • Aid in Vulnerability Analyses • Support Planning Processes • Support Decision Making Frameworks Michael.Corsello@ieee.org http://Eclime.blogspot.com
Otherwise • We are using old analytical techniques • Designed for an old paradigm • Being applied to a new paradigm of problems Michael.Corsello@ieee.org http://Eclime.blogspot.com
Example • You get new Climate Change data Michael.Corsello@ieee.org http://Eclime.blogspot.com
Example • What’s the first thing you do? Michael.Corsello@ieee.org http://Eclime.blogspot.com
Example • Try to put it into excel Michael.Corsello@ieee.org http://Eclime.blogspot.com
Take a closer look at ClimateChange data • UW CIG CBCCSP • 2 emission scenarios • 10 GCM’s • 3 downscaling methods • From available total of • 6 emission scenarios • 23 GCM’s • Multiple Approaches Michael.Corsello@ieee.org http://Eclime.blogspot.com
Take a closer look at ClimateChange data Michael.Corsello@ieee.org http://Eclime.blogspot.com
Take a closer look at ClimateChange data Michael.Corsello@ieee.org http://Eclime.blogspot.com
Take a closer look at ClimateChange data Michael.Corsello@ieee.org http://Eclime.blogspot.com
Take a closer look at ClimateChange data Michael.Corsello@ieee.org http://Eclime.blogspot.com
Take a closer look at ClimateChange data Michael.Corsello@ieee.org http://Eclime.blogspot.com
Working with Climate Change data • The Challenge • Volume of data swamps Cyber Infrastructure • Steep learning curves to use new tools • Tools are always changing Michael.Corsello@ieee.org http://Eclime.blogspot.com
Enter the Web and Cloud computing • Software as a Service • Platform as a Service • Infrastructure as a Service Michael.Corsello@ieee.org http://Eclime.blogspot.com
Enterprise Data Management • Move away from data living on our computers Michael.Corsello@ieee.org http://Eclime.blogspot.com
Enterprise Data Management • The data and tools / applications now reside on servers (Cloud) • The data is now more crucial than ever • We all “share” common sets of data “through” the cloud Michael.Corsello@ieee.org http://Eclime.blogspot.com
Enterprise Data Management Management of data is paramount • The data and tools / applications now reside on servers (Cloud) • The data is now more crucial than ever • We all “share” common sets of data “through” the cloud Michael.Corsello@ieee.org http://Eclime.blogspot.com
Summary • The need for a paradigm shift • In how we work • This new paradigm must provide for • Ease of use, and value to the organization (Return on Investment) • CRF is working towards this goal • We need users across different domains to work with us Michael.Corsello@ieee.org http://Eclime.blogspot.com
Questions? Blog: http://Eclime.blogspot.com Breakout Discussion Session Wednesday at 10am
CRF Developed Solution Michael.Corsello@ieee.org http://Eclime.blogspot.com
CRF Developed Solution Develop series of database structures Based upon “real-world things” (like flows) Michael.Corsello@ieee.org http://Eclime.blogspot.com
CRF Developed Solution • Organize these structures into separate databases for each “domain aspect” • Rather than a single monolithic database. Michael.Corsello@ieee.org http://Eclime.blogspot.com
CRF Developed Solution Cloud Based Data Warehouse Michael.Corsello@ieee.org http://Eclime.blogspot.com
Metadata Examples • An important form of metadata is “chain of custody” (provenance) • Talks about the process by which data originates • What processing methods were used? • What was the source data? • Who did the work? • Another important form of metadata is descriptive • When was the sensor last calibrated? • What was the nominal error as defined by the manufacturer? • What is the temporal nature of the data (does it “expire”)? • What about licensing info? • Metadata can often be “linked” rather than “stored” Michael.Corsello@ieee.org http://Eclime.blogspot.com
The real Challenge with Climate Change? • We want the ONE true answer to Climate Change • The rest of the data is meaningless • Because the paradigm we work with is deterministic • We have a hard time dealing with uncertainty Michael.Corsello@ieee.org http://Eclime.blogspot.com
Cloud Computing Basics • Move computing from device oriented to resource oriented • Give me enough computing resources to get an answer • I don’t care where • Software as a Service • Software is delivered as an online service • Salesforce.com, Mint.com, Office 365 • Platform as a Service • A software platform (e.g. Sharepoint, Drupal) is provided as a service • Your agency customizes the platform to your needs • Infrastructure as a Service • You rent “virtual machines” and set them up as you see fit • Basically a “virtual” computer • Add or remove machines “on-demand” Michael.Corsello@ieee.org http://Eclime.blogspot.com
Data Models Michael.Corsello@ieee.org http://Eclime.blogspot.com
Workflows • More data to manage as we create more data • All of our “final” data • Much of our “working” data Michael.Corsello@ieee.org http://Eclime.blogspot.com
Workflows • Management translates to • Ease of Access to Data • Analysis / Modeling with Data • Results & Reporting • Store Results for future use Michael.Corsello@ieee.org http://Eclime.blogspot.com
CRF Developed Solution Developed Web and Desktop Tools to Access the Database(s) Michael.Corsello@ieee.org http://Eclime.blogspot.com