1 / 16

PPI Node Report

PPI Node Report. PDS Management Council August 28-29, 2012 R. J. Walker S. P. Joy T.A. King J. Mafi. PPI Overview . Activities Data deliveries running smoothly. PDS4 Testing Very productive and useful. PDS4 Data Migration Plan Progressing and nearly ready for first phase.

dudley
Download Presentation

PPI Node Report

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. PPI Node Report PDS Management CouncilAugust 28-29, 2012 R. J. Walker S. P. Joy T.A. King J. Mafi

  2. PPI Overview • Activities • Data deliveries running smoothly. • PDS4 Testing • Very productive and useful. • PDS4 Data Migration Plan • Progressing and nearly ready for first phase. • PDS4 Tools • Some ready , some needed. • PDS4 First Mission • MAVEN

  3. Activities Missions Active • Pipeline: Messenger, Cassini, LRO, MEX • SIS: Juno • Peer Review: Dawn, MSL • Cruise: New Horizons • Assist: Rosetta Baseline • PDS4 – Design and Tool Dev.(level of effort equal to an large mission) • Archive maintenance • Web enhancements Pre-Launch • SIS: MAVEN Restoration • Pipeline: MGS, Voyager • Prelim: Kaguya Issues • A few • Nothing higher than yellow • All manageable

  4. PDS4 Testing • Selected representative data from our PDS3 archive. • Cassini RPWS (calibrated) • Created • Product labels. • Collections. • Bundles. • Tested multiple versions of model • Testing pipeline • RFAs: Earlier tests (0700j): 9; Recent tests (0800k): 10. • Some RFAs "closed" with no action. • ??? How well are RFAs being addressed ???

  5. PDS4 Data Migration PlanStarted several years ago… • Refactor current archive as single Data Set per Volume. • Split volumes with multiple data sets. • Update to PDS 3.8 compliance. • Validate with Ames Validator tool. Progress: 720 volumes => 413 datasets Remaining: 27 PVO data sets, Cassini MAG (peer review) and errors in MEX (fixable by PDS?) • Transform PDS 3.8 volume to PDS4

  6. PDS4 Rollout • Switch current PPI interface from current volumes to new dataset volumes. • Same model as PDS4 • Convert and register as PDS4 resources. • Integrate PDS4 services as they become available. • Incremental and feature-by-feature.

  7. Tools We Use for PDS4 • Oxygen • Editing and validation • pds.docgen (PPI developed, open source) • Apache Velocity based template processor • Saxon Schema and Schematron validation • Command-line (java)

  8. Tools we use for PDS3 • Ames Volume Validator Note: Large volumes cause problems with validator. • Work around: Must divide dataset and check as smaller pieces. Something to consider with PDS4 validator. • Lbtool • Validate label • Tbtool • Validate label/data structure.

  9. PDS4 Tool Development Plans PPI Refine pds.docgen as needed. Create PDS4 harvester for Solr search engine. Schema driven, web based XML editor. (adapted from another project) We need: Data Registry services (EN to develop) Volume verifier (AMES?) tbtool (PPI - ????) Clear protocols (all)

  10. First Mission – MAVENMission Time Line NOW: SIS development has begun 2013-Nov-18 to 2013-Dec-17: Launch window 2014-Sep-22 or later: Mars Orbital Insertion 2014-Nov: start of science operations (5 weeks after MOI) 2015-Apr: first data delivery (6 months after start of science ops)

  11. First Mission - MAVEN • Instruments: 4 particle, MAG, Plasma wave. • Data types: ASCII tables and binary tables. • Forms of binary tables • CDF data to be treated as simple binary tables with a header. • Raw data will be archived as packets. Need bit field support in PDS4 – to be worked. • Delivery package • Description of package in SIS template.

  12. Summary • We are well positioned for a migration of our full archive to PDS4. • Things we need in PDS4 (to support MAVEN) • Delivery Package (full and incremental) • Association of Instrument and Instrument_Host. • Bit Fields • PDS4 information model issues are resolvable.

  13. Backup Slides

  14. PDS 2010/PDS 4 Participation • Participate in DDWG (Steve, Joe, Debra) • Reviews, discussion, studies, white papers • Unsustainable demands • Participation is impacting archive maintenance and migration activities. • Participate in SDWG (Todd) • Reviews, discussions, testing • Manageable demands • Advisory and Review (Todd) • Manageable demands (to a point).

  15. Missions • Active Missions • MESSENGER PPI Lead Mature Pipeline M. Sharlow • Cassini Mature Pipeline D. Kazden, J. Mafi • MEX Mature Pipeline M. Sharlow • LRO Mature Pipeline M. Sharlow • Dawn Peer review J. Mafi • Rosetta Assist SBN S. Joy, J. Mafi • Juno SIS's in review J. Mafi • MSL Peer Review M. Sharlow • New Horizons Cruise S. Joy, J. Mafi • Pre-launch Missions • MAVEN PPI Lead SIS development J. Mafi, S. Joy • Restorations • MGS Mature Pipeline M. Sharlow • Kaguya Labels designed M. Sharlow • Voyager New data sets J. Mafi, S. Joy • China/Foreign Missions • PDS Standards Seminar All • IPDA S. Joy, T. King

  16. Issues by Mission- all manageable - • MAVEN • Requires PDS4 support for SIS development and product design • Cassini • Multiple re-submissions; some user’s guides and high order data behind schedule, but progressing; • Dawn • Data in review – trying to meet PMDAP deadline (9/12/12) • MESSENGER • Higher order data sets under review • Rosetta • PDS not included in ESA/ESTEC review of data sets • Kaguya • Data available online at http://darts.jaxa.jp with minimal PDS labels

More Related