1 / 15

PanDAMon Integration in CMS

PanDAMon Integration in CMS. Workshop on Analysis Tools Development May 16 th 2013 Nicolò Magini CERN IT-SDC-OL. Outline. Status after the prototype Current status of the testbed deployment Plans for the integration testbed Next steps.

mort
Download Presentation

PanDAMon Integration in CMS

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. PanDAMon Integration in CMS Workshop on Analysis Tools Development May 16th 2013 Nicolò Magini CERN IT-SDC-OL date

  2. Outline • Status after the prototype • Current status of the testbed deployment • Plans for the integration testbed • Next steps 2013-05-16 Workshop on Analysis Tools Nicolò Magini CERN IT-SDC-OL

  3. Monitoring of PanDA jobs • Reminder: “Monitoring of jobs in PanDA” is more than “PanDA Monitor” • ATLAS ops and users take advantage of Dashboard (populated from PanDA DB) to complement PanDA Monitor, especially for • Task monitoring • Historical view • Here I’m going to look only at the “PanDA Monitor” itself, in particular for job debugging 2013-05-16 Workshop on Analysis Tools Nicolò Magini CERN IT-SDC-OL

  4. PanDAMon for the prototype • Using ATLAS PanDA Monitor as-is, with minimal updates by V. Fine (ATLAS PanDAMon developer) to make it functional for CMS jobs • Already working successfully by CMS power users in proof of concept phase 2013-05-16 Workshop on Analysis Tools Nicolò Magini CERN IT-SDC-OL

  5. PanDAMon for the prototype • viewlogfiles: perform LFN2PFN conversion with PhEDEx datasvc to find log file location (instead of looking up in central ATLAS catalog) • Recently had an issue with logfile retrieval, now fixed by V. Fine 2013-05-16 Workshop on Analysis Tools Nicolò Magini CERN IT-SDC-OL

  6. Testbed deployment • Additional 2 core, 8 GB VM could be useful as PanDA Mon “development instance” to test deployment and new modules 2013-05-16 Workshop on Analysis Tools Nicolò Magini CERN IT-SDC-OL

  7. Testbed status • Basic quattor configuration performed by VOC on all machines following ATLAS templates • Now in contact with ATLAS Distributed Computing operators for software deployment and configuration procedures 2013-05-16 Workshop on Analysis Tools Nicolò Magini CERN IT-SDC-OL

  8. PanDAMon testbed goals • During testbed phase • Reproduce working PanDA Monitor setup from prototype phase in CMS instance • Identify “ATLAS” assumptions in monitoring, assess usability for CMS • Some examples found by developers in job debugging views reported in the following • More surely to be found by CMS ops and users, will gather feedback • Produce new PandaMon custom modules for CMS integration for items not covered by current PanDAMon or Dashboard 2013-05-16 Workshop on Analysis Tools Nicolò Magini CERN IT-SDC-OL

  9. Navigation • A lot of information on the website is aggregated by cloud • For CMS, more useful to look at sites rather than clouds? 2013-05-16 Workshop on Analysis Tools Nicolò Magini CERN IT-SDC-OL

  10. Dataset info • Dataset info linking to DQ2 2013-05-16 Workshop on Analysis Tools Nicolò Magini CERN IT-SDC-OL

  11. Dataset info • Need to update to link to DAS/DBS 2013-05-16 Workshop on Analysis Tools Nicolò Magini CERN IT-SDC-OL

  12. Task monitoring • Linked to ATLAS Task Monitoring • Integrate with CMS Task Monitoring 2013-05-16 Workshop on Analysis Tools Nicolò Magini CERN IT-SDC-OL

  13. Output file links • Links to log and output file locations working in “viewlogfile” page, need to fix in “findfile“ • (do we want to update output location in PanDA DB from /store/temp/user to /store/user after ASO?) 2013-05-16 Workshop on Analysis Tools Nicolò Magini CERN IT-SDC-OL

  14. Error reporting • ASO failures reported to DB and visible in monitoring but not in “Error details” • CMS transformation (job wrapper) exit code visible in PanDAMon, but not detailed error message - includes cmsRun messages • Update links to support mail… 2013-05-16 Workshop on Analysis Tools Nicolò Magini CERN IT-SDC-OL

  15. Next steps • Next week: deploy PanDAMon as-is on dev server in testbed setup • When testbed setup is ready, start looking into reported issues • Interact with PanDAMon developers to learn how to integrate new modules if needed by CMS • First session already done • Reproduce deployment on prod server 2013-05-16 Workshop on Analysis Tools Nicolò Magini CERN IT-SDC-OL

More Related