1 / 50

ECHO 2013

ECHO 2013. Technical Interchange Meeting April 30 & May 1, 2013. Welcome. ECHO Technical Interchange Meeting. Logistics and Expectations. ECHO Technical Interchange Meeting. Where is the closest exit? Where are the bathrooms? Two groups = two rooms Is my stuff secure?

hayley
Download Presentation

ECHO 2013

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Raytheon EED Program | ECHO Technical Interchange 2013

  2. Raytheon EED Program | ECHO Technical Interchange 2013 ECHO 2013 Technical Interchange Meeting April 30 & May 1, 2013

  3. Raytheon EED Program | ECHO Technical Interchange 2013 Welcome ECHO Technical Interchange Meeting

  4. Raytheon EED Program | ECHO Technical Interchange 2013 Logistics and Expectations ECHO Technical Interchange Meeting

  5. Raytheon EED Program | ECHO Technical Interchange 2013 • Where is the closest exit? • Where are the bathrooms? • Two groups = two rooms • Is my stuff secure? • What’s for lunch? Logistics http://www.shorpy.com/node/9281

  6. Raytheon EED Program | ECHO Technical Interchange 2013 • Why are we here? • Learning & Communication • Idea Exchange • Hey, I’m interested in both tracks! • Switch back and forth as you see fit, please leave between presentations • What is expected of me? • Be respectful • Ask questions • Share ideas The Lay of the Land http://www.shorpy.com/node/6008

  7. Raytheon EED Program | ECHO Technical Interchange 2013 Introductions ECHO Technical Interchange Meeting

  8. Raytheon EED Program | ECHO Technical Interchange 2013 ECHO Project Manager – Andy Mitchell ECHO Operations Manager – Luther Lighty ECHO Task Lead – Art Cohen ECHO Technical Lead – Dan Pilone ECHO Operations Lead – Doug Newman ECHO Systems Administration – Marcus White ECHO Development Lead – Chris Durbin ECHO Systems Engineering – Katie Baynes Who Are We?

  9. Raytheon EED Program | ECHO Technical Interchange 2013 Who Are You?

  10. Raytheon EED Program | ECHO Technical Interchange 2013

  11. Raytheon EED Program | ECHO Technical Interchange 2013 Agenda ECHO Technical Interchange Meeting

  12. Raytheon EED Program | ECHO Technical Interchange 2013 Day 1 - Morning Unified Activities

  13. Raytheon EED Program | ECHO Technical Interchange 2013 Lunch 11:30 AM – 1:00 PM Day 1 - Development Track

  14. Raytheon EED Program | ECHO Technical Interchange 2013 Day 1 - Non-Development Track Lunch 11:30 AM – 1:00 PM

  15. Raytheon EED Program | ECHO Technical Interchange 2013 Pre-History ECHO Technical Interchange Meeting

  16. Raytheon EED Program | ECHO Technical Interchange 2013 Web History * Not actual web interface from 1980 

  17. Raytheon EED Program | ECHO Technical Interchange 2013 ECHO Data Partners Data centers are collocated with centers of science discipline expertise in order to provide the best support for the user community. ASF DAAC SAR Products Sea Ice, Polar Processes SEDAC Human Interactions in Global Change CDDIS Crustal Dynamics Solid Earth LP DAAC Land Processes & Features GES DISC Atmos Composition & Dynamics, Global Modeling, Hydrology, Radiance NSIDC DAAC Cryosphere, Polar Processes OBPG Ocean Biology & Biogeochemistry ORNL DAAC Biogeochemical Dynamics, EOS Land Validation LAADS/ MODAPS Atmosphere GHRC Hydrological Cycle & Severe Weather PO.DAAC Ocean Circulation Air-Sea Interactions ASDC Radiation Budget, Clouds, Aerosols, Tropo Chemistry

  18. Raytheon EED Program | ECHO Technical Interchange 2013 Modern History ECHO Technical Interchange Meeting

  19. Raytheon EED Program | ECHO Technical Interchange 2013 What have we been up to? • Engaging the Community • Onboarding New Providers • CDDIS • OBPG • NRT Data • ISO Preparation • SMAP • SAGE III • “NASA-flavor” • Revisiting Reverb Usability • Picking up on visualization prototypes • Major Tool transitions • Kayako • Torquebox • JIRA? • Ordering Rework http://livelimber.com/images/interface/antique_calendar.jpg

  20. Raytheon EED Program | ECHO Technical Interchange 2013 What Else? • Looking Internally • Preparing for growth • Working on Performance • Stability Fixes • Automating build and deployment workflows • Keeping things secure • Java updates and patches • Rails updates and patches • Keeping better tabs on ourselves • Leveraging Splunk • Revisiting Metrics Reporting • Building a new index for ECHO

  21. Raytheon EED Program | ECHO Technical Interchange 2013 Engaging Users • Two New API Guides • Search and Discovery • Ingest • AGU • Fall 2012 • 5 posters • 2 talks • ESIP • Summer 2012 • Winter 2013 • ESDSWG Participation • User Needs • Open Source • Visualization • Technology Infusion • Semantic Mash-ups • Biweekly ETC Meetings

  22. Raytheon EED Program | ECHO Technical Interchange 2013 Near RealTime Data • Land and Atmosphere Near real-time Capability for EOS (LANCE) • Data is < 3 hours old • L1, L2 and L3 products • Products • MODIS • AMSR-E • OMI • AIRS • MLS • Most Providers Still in Test Source: http://rapidfire.sci.gsfc.nasa.gov/realtime/

  23. Raytheon EED Program | ECHO Technical Interchange 2013 Working towards ISO 19115 • SAGE III ISS – 2014 Launch • Soil Moisture Active Passive – November 2014 launch • ICESat-2 – July 2016 Launch Source: Ted Habermann

  24. Raytheon EED Program | ECHO Technical Interchange 2013 (more on this in a bit) Usability Work

  25. Raytheon EED Program | ECHO Technical Interchange 2013 Revisiting Ordering

  26. Raytheon EED Program | ECHO Technical Interchange 2013 Let’s Talk Numbers ECHO Technical Interchange Meeting

  27. Raytheon EED Program | ECHO Technical Interchange 2013 • Collections: 3862 • Granules: 124 million • Growth: • Current • 475k granules/week • Future • ~1 million granules/day during MODIS Collection 6 Reprocessing Current Holdings As of 4/24/2013

  28. Raytheon EED Program | ECHO Technical Interchange 2013 ECHO Overall Uptime June 2012 – April 2013 Source: Uptrends.com, Cumulative for all ECHO probes, does not include planned maintenance

  29. Raytheon EED Program | ECHO Technical Interchange 2013 Usage

  30. Raytheon EED Program | ECHO Technical Interchange 2013 Order Trends Source: Uptrends.com, Cumulative for all ECHO probes, does not include planned maintenance

  31. Raytheon EED Program | ECHO Technical Interchange 2013 Order Trends Source: Uptrends.com, Cumulative for all ECHO probes, does not include planned maintenance

  32. Raytheon EED Program | ECHO Technical Interchange 2013 ECHO API Usage February March April

  33. Raytheon EED Program | ECHO Technical Interchange 2013 ECHO API Usage February March April

  34. Raytheon EED Program | ECHO Technical Interchange 2013 Reverb represents only 20% of ECHO usage…

  35. Raytheon EED Program | ECHO Technical Interchange 2013 …80% of ECHO search traffic comes from 3rd party applications!

  36. Raytheon EED Program | ECHO Technical Interchange 2013 Client breakdown for a week in Feb 2013

  37. Raytheon EED Program | ECHO Technical Interchange 2013 Client breakdown for a week in April 2013

  38. Raytheon EED Program | ECHO Technical Interchange 2013 Performance Tuning…

  39. Raytheon EED Program | ECHO Technical Interchange 2013 Response Time

  40. Raytheon EED Program | ECHO Technical Interchange 2013 No single graph tells the whole story…

  41. Raytheon EED Program | ECHO Technical Interchange 2013 ECHO Query Histogram (Past 4 Weeks)

  42. Raytheon EED Program | ECHO Technical Interchange 2013 Queries Taking Longer than 60 Seconds

  43. Raytheon EED Program | ECHO Technical Interchange 2013 Reverb Collection Search Types

  44. Raytheon EED Program | ECHO Technical Interchange 2013 Reverb Granule Search Types

  45. Raytheon EED Program | ECHO Technical Interchange 2013 But if we ignore sources of queries…

  46. Raytheon EED Program | ECHO Technical Interchange 2013 Response Time

  47. Raytheon EED Program | ECHO Technical Interchange 2013 Collection and Granules – All Queries

  48. Raytheon EED Program | ECHO Technical Interchange 2013 All Queries vs Reverb Only

  49. Raytheon EED Program | ECHO Technical Interchange 2013 Monitored Clients: 9 Avg Query Time: ~6s Ingest Peak / wk: 20M Ingest Avg / wk: 2.6M Summary As of 4/24/2013

  50. Raytheon EED Program | ECHO Technical Interchange 2013 Questions

More Related