1 / 19

AIM Data Accessibility

AIM Data Accessibility. John McNabb, AIM Project Data Center Manager Hampton University. AIM Science Data System (SDS) AIM Project Data Center (PDC) Data Availability and Access Statistics Lessons Learned. AIM Data Accessibility. Distributed Data Processing and Delivery

pepin
Download Presentation

AIM Data Accessibility

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. AIM Data Accessibility John McNabb, AIM Project Data Center Manager Hampton University

  2. AIM Science Data System (SDS) AIM Project Data Center (PDC) Data Availability and Access Statistics Lessons Learned AIM Data Accessibility

  3. Distributed Data Processing and Delivery Instrument Data Processing Centers (DPC): Process, store and disseminate data products for their instrument Centralized Meta-data, Search, and Archiving Project Data Center (PDC): Provide search capability for instrument data products Interfaces to: Affiliated Systems(Co-Investigators, NSSDC, E/PO K-14) Non-affiliated Systems (Science community, Public) AIM Science Data System

  4. Data Distribution MOC LASP Raw Data Raw Data DPC CIPS/CDE DPC SOFIE Meta-Data Meta-Data PDC HU LASP FTP GATS FTP Search Queries Data Products Data Products Data Users

  5. Data Archiving MOC LASP Raw Data Raw Data DPC CIPS/CDE DPC SOFIE Data Products Data Products PDC HU LASP GATS Final Archive NSSDC

  6. Primary source of information to outside groups Online Data Search tools Preliminary Archive Orbital Predictions aim.hamptonu.edu AIM Project Data Center

  7. Online data search tool

  8. Provides ongoing development and testing platform for final archive procedures. Collect all publicly available data as soon as it is published. Collect all data products and documentation in preparation for final archive. Preliminary Archive

  9. Have provided regular orbital predictions for ground based sensors, sounding rocket launches, and Space Shuttle missions Online on-demand predictions available Orbital Predictions

  10. CDE has released two levels of science products: Level 1: Charge Amount of charge generated by PVDF upon particles impact Level 2: Mass Calculated mass of impacting particle All data available on Hampton Univ. AIM website Currently at final version, V5 Data available from June 1, 2007 to June 1, 2009 Data Availability: CDE

  11. Preliminary data is available within 24 hours to Science Team and others by special request. After 5 days definitive revision of current version of data is created and published. Data Availability: CIPS

  12. Preliminary data is available within 24 hours to Science Team After review (typically 2-3 days) definitive revision of current version of data is published. Online tools provide powerful plotting options Data Availability: SOFIE

  13. SOFIE Online Plotting Tools http://sofie.gats-inc.com/sofie

  14. Average unique IP addresses per month based on Fall 2009 (excluding bots and local users) ~1500 to AIM web site ~700 to AIM homepage ~260 to outreach web pages ~75 to Data Search Tool Data Access Statistics: PDC

  15. Based on Google Analytics 175 Unique visitors over 3 months 41% new visitors Referrers: 50% direct access 25% google.com 12% aim.hamptonu.edu Data Access Statistics: CIPS/CDE

  16. Based on Google Analytics and Webalizer data 25% new visitors Referrers: 86% direct access. 11% referred by aim.hamptonu.edu ~50 daily average visits Data Access Statistics: SOFIE

  17. Data Access Statistics: SOFIE

  18. Product Availability Notices (PANs) sent by email can fall prey to changing SPAM filters. Realistic test cases for sending PANs need to include large numbers of files in a short period of time representing reprocessing of the whole data set. In file naming, version numbering system should include at least two integer places, one decimal, and a two character revision:  "v02.1_rev03" NetCDF-3 is not well suited for storing CIPS data. Official file types should be chosen that works best for the type of data needing to be stored, and that might be different for different data sets on a project. A distributed data dissemination system that takes advantage of shared data servers can work, however decentralized anonymous FTP makes tracking data downloads difficult. People will not generally register for update notifications unless required to in order to get access to the data. Overlapping transition period is very helpful when personnel change Lessons Learned

More Related