190 likes | 312 Views
ESDSWG Software Reuse Working Group Outcomes, Conclusions, Accomplishments: 2012. Chair: Chris A. Mattmann (NASA JPL) Co-Chair: Bob Downs (SEDAC). Agenda and Summary. NASA Open Source Strategy and Accomplishments DRAG Working Group GIS activities
E N D
ESDSWG Software Reuse Working Group Outcomes, Conclusions, Accomplishments: 2012 Chair: Chris A. Mattmann (NASA JPL) Co-Chair: Bob Downs (SEDAC)
ESDSWG-AnnualMtg-2012 Agenda and Summary • NASA Open Source Strategy and Accomplishments • DRAG Working Group • GIS activities • Trainings in Reuse and Participation in Broader Community Mtgs • ESIP Summer 2012 • ESDSWG Colloquium • Transition to Coherent Web • AGU 2012 NASA “Open Source Summit” for Science Data Systems • Relevant Papers and Recommendations
ESDSWG-AnnualMtg-2012 Hello, Annapolis!
ESDSWG-AnnualMtg-2012 NASA Open Source Strategy • Coordinated with NASA HQ OCIO (Nick Skytland) • code.nasa.gov contribution and center coordination • collection open source project information • NASA Open Source Summit 2 • Attending Planning telecons • Venue will be DC area in June 2012 • Goal is to make it all of government not just NASA • Produced open source process documentation and publish on Coherent Web for ESDSWG guidance • Making sure ESDIS and ESDSWG data systems are prevalent in NASA agency-wide open source efforts
ESDSWG-AnnualMtg-2012 NASA Open Source Summit 2 • Co-organized and held NASA Open Source Summit 2 • http://ossdc.hackpad.com • Paul Ramirez and Andrew Hart helped with organization and coordination • Attendance and presentations by Chris Vein, US Deputy CTO from OSTP along with many other innovators • Chris Mattmannpresentation on Vimeohttp://vimeo.com/45109553
ESDSWG-AnnualMtg-2012 #1 story on NASA news • #1 story on NASA news site was about our IEEE IT Professional Paper on NASA’s open source strategy • Promoted throughout NASA HQ and agency • C. Mattmann, D. Crichton, A. Hart, S. Kelly, C. Goodale, R. R. Downs, P. Ramirez, J. S. Hughes, F. Lindsay. Understanding Open Source Software at NASA. IEEE IT Professional – Special Theme on NASA Contributions to IT, Vol. 14, No. 2, pp. 29-35, March/April 2012.
ESDSWG-AnnualMtg-2012 ESIP Open Source Cluster • Started ESIP Open Source Cluster • http://wiki.esipfed.org/index.php/Opensource • 2 Meetings thus far have focused on • Introduction • Why are you here? • Charter • Membership • Topics • Meets 2nd Wed.of each month at11am PT
ESDSWG-AnnualMtg-2012 ESIP Geospatial Cluster • Paul Ramirez and Cameron Goodale Vice Chairs of Cluster • Several presentations onCO2 data portal, on SnowHydrology for the WesternUS project, and on RCMESproject • ESIP Summer 2012 GISbreakout • Strong FOSS4G and opensource focus
ESDSWG-AnnualMtg-2012 NPP/JPSS Apache OODT JPL-GSFC collaboration • JPL, GSFC and the ESDS Software Reuse WG collaborating on data system software at Apache • JPSS/GRAVITE using Apache OODT to upgrade/update their data system and join a community of folks that are building out OODTfor use in next generation of Decadalmissions (OCO2, NPP Sounder PEATE, SMAP, etc.) • Telecons and virtual meet-ups held, mainly dissemination from JPL to GSFC NPP/JPSSers • Conversation has now come into the open, on the Apache mailing lists and is continuing there
ESDSWG-AnnualMtg-2012 DRAG Working Group Membership and Participation • Kevin Murphy leading an ESDIS study group to determine how to use Coherent Web to develop open source platform for sharing code/services within ESDIS • Software Reuse WG well represented • Framework for NASA open source paper being evaluated by the group • Discussing Licensing issues at the moment • Demonstration at this Meeting • Delineation between software, services, and organizations within ESDIS • Presented at ESIP Summer 2012 meeting
ESDSWG-AnnualMtg-2012 Related Non-NASA Open Source and GIS Meetings • 2 papers presented at IEEE IRI • Andrew Hart presented on Open Source in the Early Detection Research Network • Chris Mattmann chaired the Government/IT/Industry track and presented paper on NASA open source • Attended “MongoLA” Event • Members of the Reuse WG attended Mongo LA event • Mongo DB is a new open source NoSQL scalable data store, used by a number of private industry and academic/government sectors to deal with “big data” • Organized PyCon 2012 Reuse WG Meetup • Paul Ramirez/Cameron Goodale discuss NASA Earth science use cases and needs from the Python community and GIS • FOSS4GNA • Paul Ramirez/Cameron Goodale helping to lead GIS community promoting software reuse – on Program Committee • 42 Countries participating
ESDSWG-AnnualMtg-2012 ESRI/NASA/NOAA GIS meeting • February 2012 meeting at ESRI to coordinate NASA, NOAA, and other agencies efforts towards working with ESRI GIS software • Making the data more accessible and available in ESRI tools • Paul Ramirez attended and helped define remote sensing data role in GIS technologies from ESRI • Follow on Meeting Planned • Coordinating with JPL Chief Technologist (Hyon) and ESRI • Will coordinate with ESIP Geospatial Cluster and Proposed ESDSWG GIS Group
ESDSWG-AnnualMtg-2012 Recap from ESIP Summer 2012 • NASA Open Source “Mini Summit” • Presentations from Christine White,Andy Mitchell, Mike Folk and Ken Casey • ESIP Innovators Talk - Mattmann • NSF Earth Cube Workflows WG • Co-chaired byYolanda Gil,Chris Mattmann,Paul Ramirez • ESIP Geospatial Cluster • Tommy Jasmin,Paul Ramirez,Cameron Goodale
ESDSWG-AnnualMtg-2012 ESDSWG Colloquium Recap • Chris presentedNational ClimateAssessment DataSystem Work: SnowHydrology of the Western US and Alaska (PI: Painter) • Discussed ReuseWG aspects for data systems • GIS, Apache OODT, other FOSS technologies • Attendance from ASF, NSIDC, GES DISC, SEDAC, JPL
ESDSWG-AnnualMtg-2012 Migrated Reuse WG to Coherent Web Portal • Content Reorganized and Updated with Information on RRLs, Packaging Document, Open Source • Updated and revised section on Open Source • Added RRL page with introduction and Packaging Page http://earthdata.nasa.gov/software-reuse
ESDSWG-AnnualMtg-2012 AGU Fall 2012 • Merged Oral and Poster Session with IN032 and IN037 • IN11D. IN11D. Open Source Technologies and Architectures Facilitating Science Data Center Collaboration and Management I Posters (8am-12pm): Monday December 3, 2012 • IN11F. IN11F. Open Source Technologies and Architectures Facilitating Science Data Center Collaboration and Management II (8am-10am): Monday December 3, 2012 • IN11F-01. Science Data Platforms: Informatics Architectures at the Forefront. (Invited) Peter A. Fox • IN11F-02. Towards an International Planetary Community Built on Open Source Software: the Evolution of the Planetary Data System Daniel J. Crichton; Paul Ramirez; Sean Hardman; John S. Hughes • IN11F-03. Combining data from multiple sources using the CUAHSI Hydrologic Information System (Invited) David G. Tarboton; Daniel P. Ames; Jeffery S. Horsburgh; Jonathan L. Goodall • IN11F-04. A Tour of Big Data, Open Source Data Management Technologies from the Apache Software Foundation (Invited) Chris A. Mattmann • IN11F-05. The ESGF Software Stack: a Configurable and Extensible Framework for Enabling Access to Geospatial Data Luca Cinquini; Gavin M. Bell; Dean Williams; John Harney • IN11F-06. A RESTful Service Oriented Architecture for Science Data Processing Brian Duggan; Curt Tilmes; Phillip Durbin; Ed Masuoka • IN11F-07. Developing a GIS for CO2 analysis using lightweight, open source components Rishi Verma; Cameron E. Goodale; Andrew F. Hart; Susan S. Kulawik; Emily Law; Gregory B. Osterman; Amy Braverman; Hai M. Nguyen; Chris A. Mattmann; Daniel J. Crichton; Annmarie Eldering; Rebecca Castano; Michael R. Gunson • IN11F-08. A Metadata Management Framework for Collaborative Review of Science Data Products Andrew F. Hart; Luca Cinquini; Chris A. Mattmann; David R. Thompson; Kiri Wagstaff; Paul A. Zimdars; Dayton L. Jones; Joseph Lazio; Robert A. Preston
ESDSWG-AnnualMtg-2012 Relevant Recommendations and Publications • Upcoming AGU session • Recent Papers • C. Mattmann, P. Zimdars, C. Goodale, A. Hart, J. Kim, D. Waliser, P. Lean. NASA Jet Propulsion Laboratory - The Regional Climate Model Evaluation System. In Programming Hive. E. Capriolo, D. Wampler, J. Rutherglen, eds. 1st edition. O'Reilly Media, Inc. pp. 287-291, October, 2012. • C. Mattmann, D. Crichton, A. Hart, S. Kelly, C. Goodale, R. R. Downs, P. Ramirez, J. S. Hughes, F. Lindsay. Understanding Open Source Software at NASA. IEEE IT Professional - Special Theme on NASA Contributions to IT, Vol. 14, No. 2, p. 29-35, March/April 2012. • D. Crichton, C. Mattmann, L. Cinquini, A. Braverman, D. Waliser, A. Hart, C. Goodale, P. Lean. Software and Architecture for Sharing Satellite Observations with the Climate Modeling Community. IEEE Software, Vol.29, No. 5., September/October 2012, pp.63-71.
ESDSWG-AnnualMtg-2012 Conclusions and Outcomes • Open Source is mission critical to NASA • Realizing this at other agencies as well (NSF, NIH, DARPA), and typically related to Big Data • ESDIS can be a leading player in setting NASA’s Open Source Strategy • Can build off the Reuse WG accomplishments and leadership • More Incubators between NASA centers; use Apache as DMZ • Geospatial Information Systems (GIS) is an important technological and architectural player in ESDIS next generation data systems • But GIS is not well integrated into DAACs, mission systems and proposal systems • Choice between open source and COTS components for GIS ought to be studied • ESDIS needs GIS architecture, especially in light of relevant remote sensing and GIS incompatibilities (formats, architecture, etc.) • Turnkey ESDIS data system GIS – how?
ESDSWG-AnnualMtg-2012 Web Sites and Contacts • Software Reuse Portal Web Site • http://earthdata.nasa.gov • http://earthdata.nasa.gov/software-reuse • Collaboration Web Site • Monthly Telecons • Third Wednesday of the month @ 2 pm Eastern time • Support Contact (including mailing list) • Chris Mattmann (chris.a.mattmann@nasa.gov) http://on.fb.me/eNUPcc http://twitter.com/esdswg_reuse http://lnkd.in/aQP8Kn