1 / 3

Raw Data Flows ...

Raw Data Flows. Archival Backend KEK Datastore won’t be ready until March 2009 Stopgap will be KEK neutrino group RAID array – inconvenient for UK Solution: UK Grid Storage Element Lancaster DPM fal-pygrid-30.lancs.ac.uk:8446

Download Presentation

Raw Data Flows ...

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Raw Data Flows ... • Archival Backend • KEK Datastore won’t be ready until March 2009 • Stopgap will be KEK neutrino group RAID array – inconvenient for UK • Solution: UK Grid Storage Element • Lancaster DPM fal-pygrid-30.lancs.ac.uk:8446 • Archive to: /home/t2k/raw/DsEcalCosmics/run_range (e.g. 0005000_00059000) • Recent Archiver extension • Support for GIRD Storage Elements • Have tested access to Lancaster using gLite lcg-utils • Requires GRID proxy that must renewed every few days (max lifetime is 1 week) • Preview Copier • Not an assured service (but should only fail in exceptional circumstances) • Make a copy within ISIS Hall to offline machine. T2KUK Meeting Liverpool

  2. ... Raw Data Flows ... Restricted Access (limited to immediate DAQ operational needs) Lancaster DPM SE fal-pygrid-30.lancs.ac.uk:8446 Lancaster WAN ISIS Hall Archive copy Offline disk Preview copy General Access (requires GRID certificate, but not VOMS extension) RAL WAN Archiver DAQ disk 100MBit/sec Limited connectivity to ISIS Hall Internal preview copy for DAQ operation External copy at Lancaster Both copies should be available in ~ 10 minutes of file closing T2KUK Meeting Liverpool

  3. ... Raw Data Flows • Data Rates • Melissa: estimate 10GB/week. Assume a very large error particularly for early running and assume 100GB/week • Have a 4 week buffer (for extended network/SE problems): so require 400GB DAQ disk • Access to Lancaster SE • Renee has reported problems • Have yet to get details • Does not require VOMS extension • Which is good as they have very limited lifetime and would require setting up a proxy server to renew. T2KUK Meeting Liverpool

More Related