1 / 7

New Kanga Export Scheme

New Kanga Export Scheme. Tim Adye Rutherford Appleton Laboratory BaBar Collaboration Meeting Data Distribution Session 15 th February 2001. Summary of new system Introduction at last meeting More details in next talk (Alvise) Experience Deployment. Kanga export procedures.

eileen
Download Presentation

New Kanga Export Scheme

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. New Kanga Export Scheme Tim Adye Rutherford Appleton Laboratory BaBar Collaboration Meeting Data Distribution Session 15th February 2001 Tim Adye

  2. Summary of new system • Introduction at last meeting • More details in next talk (Alvise) • Experience • Deployment Tim Adye

  3. Kanga export procedures Kanga export controlled by skimData database • David Kirkby, Alessandra Forti, Alvise Dorigo,TJA • skimSqlMirror makes local copy of skimData db • skimSqlSelectselects data for import • skimImportcopies the selected files • skimBackupbackup/archive to tape • skimDeleteremove files from local disk Documentation available from • /BFROOT/www/Computing/Offline/DataDist/KDDIBT.html • BaBar -> Computing -> Data Dist -> skimData remote Tim Adye

  4. Experience New system has been used at • RAL (TJA) • ~3 TB, many streams • Manchester (Alessandra Forti) • 350 GB • Rome (Alvise Dorego, Emanuele Leonardi) • All data, See next talk • Bristol (Fergus Wilson) • ~75 GB, Stream14 • Colorado State (Jinlong Zhang) • ~140 GB, TauQEDallevents • LBNL (Bob Jacobsen) • Just remote skimData Tim Adye

  5. Experience at RAL Now take the ‘OR’ of all UK requirements Fergus Wilson (Bristol) Priority 1: Stream14Kanga (data+SP) Phil Strother (QMW) Priority 2: Stream6Kanga (data+SP) Ulrik Egede (IC) Priority 1: Stream4Kanga + Stream7Kanga + Stream13Kanga (all data+SP) Priority 2: Stream14Kanga (data+SP) + SPKanga (signal only) Priority 3: AllEventsKanga Steve McMahon Priority 1: JpsitollKanga Gian Gopal (RAL) Priority 2: AllEventsKanga Stefania Xella (RAL) Priority 1: Stream8Kanga (data+SP) Akram Khan (Edinburgh) Priority 1: Stream7Kanga + Stream11Kanga + Stream14Kanga (data+SP) Paul Harrison (QMW) Priority 1: Stream14Kanga (data+SP) Others Priority 1: Stream17Kanga + JpsitollKanga + TauQEDalleventsKanga (all data+SP) Priority 2: DiLeptonKanga (data+SP) Priority 3: Skim880c (express Sin2Beta) + BPC*Kanga (PID) streams (See http://hepunx.rl.ac.uk/BaBar/kangaAtRal.html for details) Tim Adye

  6. Experience at RAL On disk To Import (high) To Import (low) Not Selected P Skim Release Stream Files GBytes Files GBytes Files GBytes Files GBytes = ============= ==================== ====== ====== ========= ====== ======== ====== ===== ====== 2 Skim880g AllEventsKanga 3671 940.4 Skim880g Stream1Kanga 2989 57.6 682 18.3 Skim880g Stream2Kanga 3434 25.8 237 4.7 Skim880g Stream3Kanga 2990 35.9 681 11.0 1 Skim880g Stream4Kanga 3671 48.1 Skim880g Stream5Kanga 2988 79.1 683 23.4 2 Skim880g Stream6Kanga 3333 267.9 338 36.0 1 Skim880g Stream7Kanga 3671 93.2 1 Skim880g Stream8Kanga 3671 47.3 Skim880g Stream9Kanga 2988 52.7 683 16.5 Skim880g Stream10Kanga 2989 28.2 682 8.7 1 Skim880g Stream11Kanga 3671 163.6 Skim880g Stream12Kanga 2990 122.2 681 38.6 1 Skim880g Stream13Kanga 3671 42.3 1 Skim880g Stream14Kanga 3671 46.8 Skim880g Stream15Kanga 2989 40.5 682 11.6 Skim880g Stream16Kanga 2988 17.6 683 5.6 1 Skim880g Stream17Kanga 3671 121.8 Skim880g Stream18Kanga 3131 23.0 540 14.5 1 Skim880g JpsitollKanga 341 2.5 2 Skim880g DiLeptonKanga 341 2.2 1 Skim880g TauQEDalleventsKanga 3671 109.7 2 K865aP1 SPKanga 42625 461.8 6955 92.2 Skim880gMC Stream1Kanga 1258 16.6 Skim880gMC Stream2Kanga 1258 0.0 Skim880gMC Stream3Kanga 1258 23.9 1 Skim880gMC Stream4Kanga 1257 27.9 1 0.0 Skim880gMC Stream5Kanga 1258 53.3 2 Skim880gMC Stream6Kanga 359 74.6 899 104.4 […] S8.6.[23]* DsToPhiPiKanga 1 0.0 S8.6.[23]* DstarAllKanga 1 0.0 ============= ==================== ====== ====== ========= ====== ======== ====== ===== ====== Totals 183735 3751.1 9 0.3 8864 237.7 17210 412.2 Tim Adye

  7. Deployment Now ready for general use (but, you can continue to use rsync if you prefer) Tim Adye

More Related