1 / 19

Evaluation of the 2-way Opteron 1U system

Performance test of PCs based on AMD platforms. Evaluation of the 2-way Opteron 1U system. Klaus Schossmaier CERN EP-AID Computing Seminar 3 September 2003. Welcome. The EP-AID group constitutes the core team of the Data Acquisition (DAQ) System for the LHC Experiment ALICE

whogan
Download Presentation

Evaluation of the 2-way Opteron 1U system

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Performance test of PCs based on AMD platforms Evaluation of the 2-way Opteron 1U system Klaus Schossmaier CERN EP-AID Computing Seminar 3 September 2003

  2. Welcome • The EP-AID group constitutes the core team of the Data Acquisition (DAQ) System for the LHC Experiment ALICE • Development of the DAQ software called DATE • Deployment of the DAQ system • Computing fabric: ~500 nodes, GbE switches, ~400 optical links • Permanent recording during Pb-Pb run: 1.25 GB/s during 1 month/year • Selecting products  Evaluation of Linux platforms • Intel: Pentium II, Pentium III, Xeon • AMD: AthlonMP (32bit), Opteron (64 bit) Computing Seminar, 3 Sep 2003

  3. Overview • In March 2003 we received the Newisys 2100 evaluation system (“Beachhead”) • This 2-way 1U enterprise-class server is based on AMD Opteron processors (x86-64 architecture) • Our evaluation was done under NDA: • Hardware, chassis, BIOS • Linux operating systems • Development tools • Benchmarking • Applications Computing Seminar, 3 Sep 2003

  4. Chassis & Periphery • Rack mountable • Size: 42mm x 428mm x 725mm • Robust construction • Easy to mount the rack module • Easy to open the cover (no screws) • Solid connectors • Not very hot or noisy! • Good documentation • Labeling, e.g. MAC addresses • Newisys “Getting Started Guide” • Newisys support website Computing Seminar, 3 Sep 2003

  5. Power supply 465W 4x 1GB DIMM DDR266 SDRAM 4x 1GB DIMM DDR266 SDRAM 2x hard disk bays: - empty - 36.7GB SCSI hot swap CD-ROM drive Floppy drive Operator panel for the SP Hardware – Front View 2x Opteron 240, 1 MB L2 cache, 1388 MHz 2x Opteron 244, 1 MB L2 cache, 1793 MHz (March – May) (June – now) Computing Seminar, 3 Sep 2003

  6. Hardware – Rear View PCI-X slot 64/133 full-length PCI-X slot 64/100 half-length 2x 10/100BaseT for the SP 2x 100/1000BaseT BCM5703X chip SVGA video Trident Blade 3D 8 MB PS/2 mouse keyboard Service processor (SP) AMD-8131 PCI-X bridge AMD-8111 Southbridge Computing Seminar, 3 Sep 2003

  7. Booting & BIOS • Booting/Resetting/Shutdown is fast (~10 sec) • PhoenixBIOS 4.0 Release 6.0 • Easy to enter the BIOS setup • Well designed configuration menus • Upgrade via the phlash16 flash-utility or the SP • System BIOS Revision • 00.09.06  initial • 00.09.08  bug fix • 01.08.00  Opteron 1.8 GHz • 01.09.00  Opteron “C” step Computing Seminar, 3 Sep 2003

  8. Linux Operating Systems • CERN Red Hat 7.3.2 Linux (2.4.18 kernel) • Installation via boot floppy and NFS • Everything works without any change in 32-bit mode • UnitedLinux 1.0 (2.4.19 kernel) • Consortium of Conectiva, SCO, SuSE, Turbolinux • Installation via CD-ROM (4 disks) using YaST • Runs in 64-bit mode • Red Hat 8.0.95 = GinGin64 • Installation via CD-ROM (6 disks) failed Computing Seminar, 3 Sep 2003

  9. Development Tools • GNU 2.96 C/C++ compiler • default for Red Hat Linux installations • only for 32-bit executables • GNU 3.2.1 C/C++ compiler • default for UnitedLinux installations • for 64-bit executables, 32-bit compatibility libraries • Portland Group Compiler Technology (PGI) Workstation 5.0-beta Fortan/C/C++ compiler • commercial product • for 64-bit executables • Other development tools (e.g. numerical libraries, debuggers, code migration, performance analyzers) exist, but not tested. Computing Seminar, 3 Sep 2003

  10. Benchmarking • CPU benchmarking • Ubench 0.32, gcc 2.96, 32-bit mode • Ubench 0.32, gcc 3.2.1, 64-bit mode • bench/stress rootmarks, 64-bit mode • Memory bandwidth • Stream 4.0, gcc 2.96, 32-bit mode • Stream 4.0, gcc 3.2.1, 64-bit mode • Ethernet performance • Iperf 1.2, gcc 2.96, 32-bit mode • Disk performance • Bonnie, 64-bit mode Computing Seminar, 3 Sep 2003

  11. Benchmark - CPU (Ubench) 64-bit 97749 88064 79798 74955 66714 52122 1.4 GHz 1.8 GHz 2.4 GHz 1.0 GHz Computing Seminar, 3 Sep 2003

  12. Benchmark - CPU (ROOT) • Done by Fons Rademakers (EP-SFT) • Porting of ROOT and CINT was trivial • OO data analysis framework with ~900000 locs • Porting to x86-64 under United Linux 1.0 in one afternoon • Code was already 64-bit safe (no special x86-64 ifdef’s) • No problem with gcc 3.2.1 • Performance is very good Computing Seminar, 3 Sep 2003

  13. Benchmark - Memory 4x DIMM 1GB DDR266 Avent Techn. 4x DIMM 1GB DDR266 Avent Techn. 1x Stream:2x Stream:4x Stream: 2x Opteron, 1.8 GHz, HyperTransport: 1006 – 1671 MB/s 975 – 1178 MB/s 924 – 1133 MB/s 2x Xeon, 2.4 GHz, 400 MHz FSB: 1202 – 1404 MB/s 561 – 785 MB/s 365 – 753 MB/s Computing Seminar, 3 Sep 2003

  14. Benchmark - Ethernet, Disk • Network benchmarking • 2x Broadcom BCM5703X on motherboard • 10/100/1000 Mbps Ethernet, auto-negotiation • bcm5700 kernel module, 64-bit mode • up to 105 MB/s, stable traffic during 4 days • 20%+18% sys CPU as TCP/IP receiver • 20%+2% sys CPU as TCP/IP sender • Disk benchmarking • Seagate ST336753LC, 15kRPM • LSI53C1030 dual channel Ultra320 SCSI controller • 26.7 MB/s for writing a 6 GB file • 36.2 MB/s for reading a 6 GB file Computing Seminar, 3 Sep 2003

  15. Service Processor (SP) • Dedicated SP on-board • PowerPC based • Own IP name/address • Front panel • Command line interface • Web-server • Remote administration • System status • Boot/Reset/Shutdown • Flash the BIOS Computing Seminar, 3 Sep 2003

  16. Applications - DAQ • Front-end computer / Event-Builder • DATE v4.6 • Red Hat 7.3.2 • 32-bit mode, binary compatible! • Event-Building: 113 MB/s with 2 sources, 80% CPU • Porting to 64-bit mode needs to be done • DAQ services • NFS server • Run control, message logger, database • Online monitoring: performance, data quality Computing Seminar, 3 Sep 2003

  17. Applications – non DAQ • MySQL 4.0.13 for x86-64 • 64-bit mode, binary distribution • UnitedLinux 1.0 • ~3300 remote INSERT queries (80 chars) per sec • Web Servers • HEP computing • Data analysis • Simulation tools • Visualizations Computing Seminar, 3 Sep 2003

  18. Résumé • Merits • Design: chassis, hardware, BIOS • Execution: seamless 32-bit & 64-bit mode • Benchmarking: CPU, memory, Ethernet, disk • Applications: DAQ services, analysis, simulations • Improvements • Linux operating systems: more in 64-bit mode • Tool chain: more non-commercial tools • Questions • Cost: processor and whole system • Roadmap: AMD’s 64-bit processors • Thanks • AMD: Pierre-Yves Ferrard, Francesco Torricelli, Bill Zipoy • CERN ALICE: Pierre Vande Vyvre Computing Seminar, 3 Sep 2003

  19. References • Web pages • www.amd.com/opteron • www.x86-64.org • www.hypertransport.org • www.newisys.com • Technical Reports • “Performance tests of PCs based on the AMD AthlonMP”, ALICE-INT-2003-020 • A report about the 2-way Opteron system is forthcoming • Further Talks • 15 Sep 2003: “Linux platforms for the ALICE DAQ” • Access to our Opteron machine • Please ask me for an account Computing Seminar, 3 Sep 2003

More Related