1 / 16

SX Status

SX Status. Overview Requirements How has SX met its original requirements? Bugs BRs closed BRs still open Usage stats Logins Queries Performance Objectivity performance issues Versions 2.1 and 2.2 features. Overview. Two main components:

andersonk
Download Presentation

SX Status

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. SX Status • Overview • Requirements • How has SX met its original requirements? • Bugs • BRs closed • BRs still open • Usage stats • Logins • Queries • Performance • Objectivity performance issues • Versions 2.1 and 2.2 features Ani Thakar, JHU

  2. Overview • Two main components: • Data repository - commercial OO DBMS – Objectivity • Persistence and data integrity • Binary compatibility across the major hardware platforms • Transparent and configurable data organization, • Superior data-mining performance for complex data models • Distributed database capability • Automated replication of the archive (maybe) • A client/server interface to the data warehouse layer • Tcl/Tk GUI client - the SX Query Tool or sxQT • enables users to formulate queries in SXQL • submit queries to SX server • multi-window environment allows multiple sessions, multiple queries • Multi-threaded and distributed server (sxServer) • creates and manages user sessions and executes user queries • routes query o/p in approp. format to the specified output targets • can handle multiple parallel user sessions • allows multiple parallel user queries per session • queries on distributed federation executed in distributed mode Ani Thakar, JHU

  3. Status of SX Requirements • Primary Requirements • All primary science archive requirements have been met, with the exception of the enhanced goals • Inputs to SX • All the basic requirements for Inputs have been met - the SX meets these requirements to the extent possible with the current inputs provided by the photoand spectro pipelines. The enhanced goals have not been met • Functional Goals • All the basic functional goals, with the exception of efficient repeated queries and the ability to make plots in the SX, have been met. One of the two enhanced goals has been met • Technical Goals • All the technical goals have been met Ani Thakar, JHU

  4. SX Bugs • BRs closed since 3/00 • Critical BRs closed • Serious BRs closed • Non-critical BRs closed • Critical BRs still open Ani Thakar, JHU

  5. SX Usage Mar – Jul 2000 Ani Thakar, JHU

  6. SX Usage Mar – Jul 2000 Ani Thakar, JHU

  7. SX Usage Mar – Jul 2000 Ani Thakar, JHU

  8. SX Usage Mar – Jul 2000 Ani Thakar, JHU

  9. Server Stability Ani Thakar, JHU

  10. Performance • Goal: scalable,primarily I/O-limited archival system • Problem: Objectivity performance did not deliver • Original versions (3.0 and 4.0) were fast • Multi-threaded versions (5.0 onwards) slow • opening individual objects takes several thousand cycles • should take few hundred cycles • Problem reported to Objy in Dec 1999 • Objy agreed to put this on their “warmlist” for v6.0 • By Spring 2000, still no movement on this • In May, Alex pressed this issue at Objy Worldview Conf • Finally, in June, Objy engineer Mats Persson looked at it • All of June spent in daily exchanges with Objy • Over one man-month spent on this effort • By end of June, speed increased by factor of ~ 15 (45 Mb/s) • With Objy improvements, 100Mb/s on Linux within reach • Max raw I/O speed 200 Mb/s on Linux cluster • SGI performance disappointing by comparison (< 17 Mb/s) Ani Thakar, JHU

  11. Ani Thakar, JHU

  12. Ani Thakar, JHU

  13. SX v2.1 and v2.2 • Version 2.1 release date now 8/00 • Objectivity performance improvements • Output corruption problem (SGI) • Spectro data model • Atlas images • Version 2.1 features • Distributed Server • To-many links • Binary output capability • Atlas images • Spectra (draft model) • Version 2.2 features • Objectivity performance enhancements • Replication utility • Parallel extraction Ani Thakar, JHU

  14. Ani Thakar, JHU

  15. Ani Thakar, JHU

  16. SX Usage Stats (3/00 – 7/00) Ani Thakar, JHU

More Related