1 / 9

Future

Future. Build and Maintain the Archive Content must get the data needed for scientific research participating in national and international projects staying in tune with our scientists nuturing data exchange relationships uncovers previously unavailable data reduces overall cost

dava
Download Presentation

Future

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Future • Build and Maintain the Archive Content • must get the data needed for scientific research • participating in national and international projects • staying in tune with our scientists • nuturing data exchange relationships • uncovers previously unavailable data • reduces overall cost “Very nuts and bolts kind of work, but absolutely essential”

  2. Future • Improve the Information Interface • more online documents that consolidate information about our archive • guide users to the appropriate information • Continue coordination with the UCAR committees • Data Management Working Group (2 particip.) • Web Advisory Group

  3. Future • Next technical key • following the development strategy of automatic creation of .html page develop methods to generate .xml catalog descriptions of our archive • these will be aligned with cross divisional understanding worked out by the DMWG • permit our archives to be “discovered”, along with other archives, by searches initiated at the UCAR level.

  4. Future • Data Access • simply put more data online • with all the appropriate and necessary metadata • generally moderate to small datasets • done so as to better serve our users and permit our staff to function efficiently

  5. Future • Help users with data format issues • more and easy to use software access the data • more turnkey operations to provide data is various formats • ascii, .xls, netCDF, GRiB, etc • caveat: even “standard” formats are not standard, internal metadata and attributes can vary widely across diciplines and working groups

  6. Future • Continue participation and experimentation with the Community Data Portal (CDP) concept. • Connect large popular datasets to 3-tier software • GUI spatial, temporal, variable selection • graphical data display, file download preparation • data analysis calculations at the server location

  7. Future • What we’ve learned so far • principle, the archive must stay in its original format. For us that means GrIB • why - easy to keep the CDP and MSS archive synchronized, always current with newest updates and corrections • It works • a combination of a GUI, NCL middleware, and DODS or local file access is a viable approach

  8. future • Strength is in NCL! We control the development. • Make necessary adjustments to accommodate our datasets • customize the analysis software to meet the needs or our scientists • Current experiments • The data access is too slow • about 30 minutes for a 4-D data extraction on 1 year of Reanalysis II data in GrIB format. • The system seems to be I/O bound • Experimenting with different disk access strategies

  9. Future • Take a look at the CDP

More Related