1 / 4

Raymond Plante National Center for Supercomputing Applications

Coming DC3 Middleware Development. Raymond Plante National Center for Supercomputing Applications. Middleware Development in PT1.1. Data Butler-Job Office integration (rlp; 9/24) Consolidating Pipelines (ktl; Logging in service of performance analysis Production Stopping

sonyaclark
Download Presentation

Raymond Plante National Center for Supercomputing Applications

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Coming DC3 Middleware Development Raymond Plante National Center for Supercomputing Applications

  2. Middleware Development in PT1.1 Data Butler-Job Office integration (rlp; 9/24) Consolidating Pipelines (ktl; Logging in service of performance analysis Production Stopping Data movement automation Other stretch goals: Cleaning up configuration issues Realtime status

  3. Beyond PT1.1: R&D Replacing Job Office Prototype with an existing system (NHPPS, Condor X) Interslice communication: Basics are there, but unexercised Mechanisms for more logical access to shared data More Complex flow within the harness Looping over stage sequences, conditionals Can this be automated or otherwise made easier? Improved I/O techniques Multithreading for I/O: allow processing and I/O overlap Improving Fault tolerance Rescheduling failed iterations Techniques for looser coupling

  4. Beyond PT1.1: R&D Tools for validating pipeline construction Checking stage policies to check if stages fit together Desktop support Freeze-drying a clipboard for debugging purposes

More Related