80 likes | 222 Views
Middleware Demo Roadmap. Workload Management (WP1). Data Management (WP2). Networking (WP7). Storage Element (WP5). Information Service (WP3). Fabric Management (WP4). Data Management Demo: Replica Selection and Replica Location Services. Kurt Stockinger and Peter Kunszt
E N D
Middleware Demo Roadmap Workload Management (WP1) Data Management (WP2) Networking (WP7) Storage Element (WP5) Information Service (WP3) Fabric Management (WP4)
Data Management Demo:Replica Selection and Replica Location Services Kurt Stockinger and Peter Kunszt WP2 – Data Management
Replica Management Services VO Membership Service Replica Management Services Replica Manager Client Optimization Information Service Replica Metadata File Transfer: GridFTP … Replica Location Service RLS
Testbed Sites & Replica Manager Commands edg-rm copyAndRegisterFile -l lfn:higgsCERN LYON edg-rm listReplicas -l lfn:higgs edg-rm replicateFile -l lfn:higgs NIKHEF edg-rm listBestFile -l lfn:higgs CERN edg-rm getAccessCost -l lfn:higgs CERN NIKHEF LYON edg-rm getBestFile -l lfn:higgs CERN edg-rm deleteFile -l lfn:higgs LYON edg-rm listBestFile -l lfn:higgs CERN
Replica Location Service RLS • Local Catalogs hold the actual name mappings • Remote Indices redirect inquiries to LRCs actually having the file • LRCs are configured to send index updates to any number of RLIs • Indexes are Bloom Filters
RLS Demo Topology Today CERN lxshare0342.cern.ch Glasgow grid01.ph.gla.ac.uk California dc-n2.isi.edu Melbourne koala.unimelb.edu.au LocalReplicaCatalog CERN lxshare0344.cern.ch Glasgow grid03.ph.gla.ac.uk California dc-n4.isi.edu Melbourne wombat.unimelb.edu.au Replica Location Index
SUMMARY • Replica Optimization • WP7 Network cost functions are integrated into the Replica Management functionality providing an essential functionality that was missing up to now. • This gives us the necessary framework to start work on high-level optimization algorithms. • Replica Location Service • Scalable distributed catalog as a much-needed replacement for the current Replica Catalog. • Addresses all issues brought up by the experiments. Tests have been conducted with very large catalogs • The lookup time for an entry is independent of the number of catalog. Tested for up to 108 entries. • The catalog withstands simultaneous user queries of over 1000 queries or inserts per second.