1 / 12

JSOC Pipeline Processing System Components

Pipeline Program, “module”. JSOC Science Libraries. Utility Libraries. DRMS Library. Record Cache. Record Management. Keyword Access. Link Management. Data Access. JSOC Pipeline Processing System Components. Pipeline processing plan. Pipeline Operator. SUMS Disks.

lilac
Download Presentation

JSOC Pipeline Processing System Components

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Pipeline Program, “module” JSOC Science Libraries Utility Libraries DRMS Library Record Cache Record Management Keyword Access Link Management Data Access JSOC Pipeline Processing System Components Pipeline processing plan Pipeline Operator SUMS Disks Processing script, “mapfile” List of pipeline modules with needed datasets for input, output PUI Pipeline User Interface SUMS Storage Unit Management System DRMS Data Record Management System SUMS Tape Farm Processing History Log Database Server

  2. Storage Unit Management Sybsystem (SUMS) API • SUM *SUM_open(char *dbname) Start a session with the SUMS • int SUM_close(SUM *sum) End a session with the SUMS • int SUM_alloc(SUM *sum) Allocate a storage unit on the disks • int SUM_get(SUM *sum) Get the requested storage units • int SUM_put(SUM *sum) Put a previously allocated storage unit • int SUM_poll(SUM *sum) Check if a previous request is complete • int SUM_wait(SUM *sum) Wait until previous request is complete

  3. SUM_get() API Call Sequence

  4. HMI Dataset Sequence Ancillary Data tlm packets observables filtergrams 55Mbs HMI n:m camera n:1 & hk data 32MB 32MB ~1700 Image Image bytes HK tlm lev1 lev0 /home/jim/soffice/user/work/dataset_seq3.sxd

  5. Data Product Plan Table Data Query Map Building Scripts Map Execution pui_svc pipeline execution Oracle DB Pipeline User Interface (PUI) Block Diagram PUI GUI

  6. Pipeline User Interface (PUI)

  7. Pipeline User Interface (PUI)

  8. Pipeline User Interface (PUI)

  9. Pipeline User Interface (PUI)

  10. Pipeline User Interface (PUI)

  11. HK Data Flow WSC GSFC DDS MOC FDS/PLANNING daily LR APID ftp realtime LR APID socket ftp realtime HR APID realtime LR APID daily LR FDS/PLAN Stanford Lockheed Science SOC T & C SOC HK Definition Tables HK Keyword DB

  12. CM with CVS

More Related