1 / 7

CDF Farms Transition

CDF Farms Transition. Old Production farm (fbs/dfarm/mysql) SAM-farm (Condor/CAF/SAM). CDF Old Production Farm. Headnode: cdffarm0 Dell 6650, 4-Way Xeon HT, 4GB RAM, 0.5TB usable RAID5+0, SLF303 2 Servers: fnpcc (FPS) – dual-Xeon 2U, IDEs, FL731 (cdffarm2) – duel-Athlon 4U, SCSI

eugeniac
Download Presentation

CDF Farms Transition

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. CDF Farms Transition • Old Production farm (fbs/dfarm/mysql) • SAM-farm (Condor/CAF/SAM) CSS/SCS/Farms and Clustered System

  2. CDF Old Production Farm • Headnode: cdffarm0Dell 6650, 4-Way Xeon HT, 4GB RAM, 0.5TB usable RAID5+0, SLF303 • 2 Servers:fnpcc (FPS) – dual-Xeon 2U, IDEs, FL731(cdffarm2) – duel-Athlon 4U, SCSI • 98 worker nodes: fncdf75-90,155-170,201-266where 8 readers and 8 concatenators CSS/SCS/Farms and Clustered System

  3. Experimental SAM-Farm • Condor/CAF headnode: fncdf171 (fncdf) • 2 SAM stations: fcdfdata057&055 (cdf-farm1&2) – Polywell 2TB/each, IDE RAID • 29 condor workers in FCC2: fncdf172-200 • 40 new workers in GCC: fncdf267-306 (testing SLF303) CSS/SCS/Farms and Clustered System

  4. SAM-Farm functional requirements • dCAF/Condor headnode(s) • Monitoring and Web services • Many Condor worker nodes • SAM:Station(s)Storage: cache and storeConcatenation CSS/SCS/Farms and Clustered System

  5. SAM-Farm hardware mapping • cdffarm0 will replace fncdf171 as headnode, also monitoring and web • All worker nodes will be converted to Condor and SLF303, using Rocks • SAM stations need new machines since 055 and 057 will be out of warranty soon • Add a 2nd headnode? CSS/SCS/Farms and Clustered System

  6. SAM-Farm SAM station requirements • >4TB/day (~50MB/s avg.) in/outnetwork: multi Gb ports/links • >2TB cache RAID usable, thus ~4TB raw • >2TB store RAID usable, ~4TB raw • Sufficient concatenation power • Single or multiple machines? • 24x7 or 8x5 support? CSS/SCS/Farms and Clustered System

  7. SAM station hardware options • SCSI RAID: 4xDell 2850 ($9k each) ~$36kDual-Xeon 3GHz, 4x300GB SCSIs (and mirrored system drives) • IDE RAID: 4xKoi ($5k each) ~$20kDual-Xeon 2.8GHz, 4x250GB IDEs (and mirrored system drives) • LSI or EMC: 2x2TB (~$40k each) ~$70k4WNs w/ Fibre Channel interfaces • Panasas: 4WNs + Panasas (5TB) ~$35k ** D0 will need similar hardware too….. ** CSS/SCS/Farms and Clustered System

More Related