1 / 10

WP8 Status

WP8 Status. Stephen Burke, PPARC/RAL. What is WP8?. HEP applications workpackage Link between experiment software and EDG middleware Works with WP9 (Earth Observation) and WP10 (Biomedical)

netis
Download Presentation

WP8 Status

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. WP8 Status Stephen Burke, PPARC/RAL

  2. What is WP8? • HEP applications workpackage • Link between experiment software and EDG middleware • Works with WP9 (Earth Observation) and WP10 (Biomedical) • Applications Technical Working Group (ATWG) is a forum to define application requirements for the EDG middleware: “Loose Cannons” + experiment reps + WP9 + WP10

  3. Testing the Testbed • LCs have continued to be active in testing the functionality of the testbed • Automated test software under development, with publication of the results on the web • Ongoing feedback to middleware developers • Some application tests, but still limited because the job broker at CERN is unstable • Stability is our highest priority!

  4. Current Problems • Job submission works, but has been unstable, with jobs failing for various reasons much of the time • It isn’t yet fully defined how to set up an application environment (where to find compilers, experiment software etc) at each site, but this is improving • There are work-arounds for the initial problems with data storage, but the solutions are awkward and insecure • Documentation is improving but still not perfect!

  5. Near Future • Release 1.1.5 is still not stable, development has now stopped and applications will wait for 1.2 • Move to 1.2 in ~ 2 weeks subject to testing • Should have new functionality, particularly from WP2 (Replica Manager, new GDMP) which should make data access easier • Should also resolve problems with access to Castor • Hope to have a stable “production” testbed soon • Hope to see a rollout to more sites soon

  6. Common Use Cases • ATWG is trying to define common needs of all applications, with the long-term aim of having a common software layer between the experiment software and the Grid middleware • Discussions held with the four LHC experiments to clarify their approaches and extract common themes • Various kinds of information: use cases, implementation/architecture ideas, requirements, scenarios, …

  7. Common Use Cases (2) • Preliminary “Common Use Case” document produced • Some overlap with LCG, RTAG will produce an updated use case document, work will continue in WP8 • Working with computer scientists at Annecy to produce UML diagrams

  8. UML Diagram

  9. Administrivia • WP8 plenary on 14th June at CERN (3 per year) • Application Technical Working Group (ATWG) has been meeting once a month, in future will alternate WP8-only and WP8+9+10 meetings to separate HEP-specific issues from general ones • Architecture Task Force has been re-activated, Jeff Templon (NIKHEF) is the WP8 representative

  10. WP8 Technical Requirements • 5. Portability • Demonstrable portability of middleware: a) use other resources, b) debugging • 6. Scratch Space • Job requests X amount of scratch space to be available during execution, system tells job where it is • 7. Output File Support • JDL support for output files: specify where output should go in JDL, not in job script • 1. Realistic Large-Scale Tests • Reliability! Need reliable dg-job-*command suite • 2. Data management • Reliability! Need reliable gdmp-* command suite, file-transfer commands • 3. Mass Storage Support • Working access to MSS (CASTOR and HPSS at CERN, Lyon) • 4. Lightweight User Interface • Put on a laptop or std. Desktop machine

More Related