40 likes | 179 Views
Magda status and related work in PPDG year 2. Torre Wenaus, BNL/CERN US ATLAS Core/Grid Software Workshop, BNL May 6-7, 2002 CERN. Status. Full time developer/support since March 1: Wensheng Deng Development, support: ATLAS DC, US ATLAS testbed, LAr bench test DAQ, GDMP integration
E N D
Magda status and related workin PPDG year 2 Torre Wenaus, BNL/CERN US ATLAS Core/Grid Software Workshop, BNL May 6-7, 2002 CERN
Status • Full time developer/support since March 1: Wensheng Deng • Development, support: ATLAS DC, US ATLAS testbed, LAr bench test DAQ, GDMP integration • ATLAS DC production usage for cataloging (passive and active) and replication • Improved usability, doc for replication; dynamic replication; more replication modes • DC1 data replication from BNL to CERN to begin • To be used for data replication among the ~18 sites of DC1 phase 0 • 260k files, ~11TB cataloged at present • GDMP integration beginning • Issues given to GDMP in Jan re: Magda integration fixed in V3 • David Rebatto, a CS working for Laura Perini, is helping • GDMP3 being set up in Milan; will install Magda and do integration work there Torre Wenaus, BNL/CERN
PPDG Year 2 & Magda • GDMP integration • Use GDMP to support a ‘publish/subscribe’ replication mode within Magda, targeted at ‘conventional production’ usage (what GDMP is designed for) • Magda still ‘adds value’ with a more flexible approach to data management and replication • Application in demos • Build Magda outwards into distributed job management/analysis, building on Pavel’s work and ‘adding value’ to MOP? • Distributed job management is to be the ATLAS PPDG yr 2 focus • Together with distributed analysis? • Apply as replica manager in hybrid store common project • Build it outwards (or adapt it) to support more metadata? E.g. data history information; HES metadata (HEMP a teeny step in this direction) • To be eclipsed by Alien? Examine Alien and evaluate Torre Wenaus, BNL/CERN
Magda and Globus • Magda currently uses gsiftp for replication between grid-enabled sites • A Magda -> Globus replica catalog ‘loader’ exists, but untested • Globus RC V1 was too feature-weak to integrate • Feedback given to Globus team • Some potential Magda developments deliberately not done, anticipating functionality in next Globus RC version; eg scalability • Now, alpha Globus replica location service is out • We want to alpha test it by integrating it in Magda • Will provide scalability if it works well • Also, alpha Globus robust file transfer service is out • We want to alpha test it by integrating it in Magda • Will simplify Magda if it works well: less error handling Torre Wenaus, BNL/CERN