1 / 12

FroNTier at BNL

FroNTier at BNL. Implementation and testing of FroNTier database caching and data distribution. John DeStefano, Carlos Fernando Gamboa, Dantong Yu Grid Middleware Group RHIC/ATLAS Computing Facility Brookhaven National Laboratory April 16, 2009. What is FroNTier?.

ipo
Download Presentation

FroNTier at BNL

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. FroNTier at BNL Implementation and testing of FroNTier database caching and data distribution John DeStefano, Carlos Fernando Gamboa, Dantong YuGrid Middleware Group RHIC/ATLAS Computing Facility Brookhaven National Laboratory April 16, 2009

  2. What is FroNTier? A distribution system for centralized databases • Web service provides read access to database • Supports N-Tier data distribution layers • Developed by Fermilab for CDF data • Adapted by CMS at CERN • Used for distributing conditions data

  3. FroNTier architecture CMS: FroNTier server with tiered Squids to cache database data Image source: CERN Courier, http://cerncourier.com/cws/article/cnl/27615

  4. FroNTier prerequisites and components FroNTier: • Java • Tomcat • Ant (optional, for development) • Xerxes XML parser (optional, for development) • Oracle JDBC driver libraries • FroNTier servlet Cache: • Squid • Custom shared object libraries (deprecated) • HW prereqs/recommendations: 100+ GB, 2+ GB, 64-bit

  5. Initial test bed: single node Oracle Conditions database(one node) 2 active connections permitted Frontier servlet Squid cache BNL LHC-OPN Remote Squid/Frontier client requests WAN

  6. Initial test bed: two nodes Oracle Conditions database(one node) Frontier servlet "Launchpad" node Site server node Squid cache(accelerator mode) Squid cache Short expiration time increasedfrom 10 minute to 1 hour BNL LHC-OPN Remote Squid/Frontier client requests WAN

  7. AGLT2 Results:Dual-node configuration Feb. 27 – March 2, muon reconstruction, 3 cosmic data (89507, 91060 and 91639) used: 20266 cosmic data jobs, 600 maximum job submission rate from UofM 83 crashes (all from 91060 data) 11115 cosmic data jobs, 738 maximum job submission rate from UofM 35 crashes 37626 cosmic data jobs, 738 maximum job submission rate from UofM 82 crashes; test terminated by Squid log size crash Network glitches may have contributed to results

  8. Current test bed configuration Oracle Conditions database(one node) Frontier servlet Frontier servlet "Launchpad" node "Launchpad" node Squid cache(accelerator mode) Squid cache(accelerator mode) F5 Big-IP Load Balancer BNL LHC-OPN WAN Remote Squid/Frontier client requests

  9. Recent test activity from Great Lakes Tier 2 Two local Squid nodes at AGLT2 Connecting to load-balancing Frontier alias at BNL • 1-hour sample (4/7/09 6-7 AM): 414,000 load-balanced cache hits seen on Squids at BNL • Graph data courtesy of AGLT2 Cacti: Shawn McKee, University of Michigan

  10. Future plans • Additional scalability tests for Reconstruction and Analysis jobs • Possible addition of more cache nodes to BNL test bed • Aid to additional T2s and other sites interested in testing • Implement Oracle/Frontier triggers to guarantee cache freshness and coherency, based on Oracle data modification times (Dave Dykstra at Fermi, Tier 0 DBAs at CERN)

  11. References and resources • CERN Frontier sitehttp://frontier.cern.ch/ • CERN CMS TWiki: Squid for CMShttps://twiki.cern.ch/twiki/bin/view/CMS/SquidForCMS • Frontier at BNL:https://www.racf.bnl.gov/docs/services/frontier • US ATLAS Admins TWiki: Tier 2 Frontier configurationhttps://www.usatlas.bnl.gov/twiki/bin/view/Admins/SquidT2 • BNL Frontier Mailing List:https://lists.bnl.gov/pipermail/racf-frontier-l

  12. Acknowledgments • RACF GCERobert Petkus, James Pryor • RACF GridCarlos Gamboa, Xin Zhao, Dantong Yu • US ATLAS Physics Application SoftwareShuwei Ye, Torre Wenaus • SLACWei Yang, Douglas Smith • FermilabDave Dykstra • TRIUMFRod Walker

More Related