1 / 14

XFEL

XFEL. The European X-Ray Laser Project. X-Ray Free-Electron Laser. Communication in ATCA-LLRF System. Presenter: Waldemar Koprek. XFEL-LLRF-ATCA Meeting, 3-4 December 2007. XFEL. The European X-Ray Laser Project. X-Ray Free-Electron Laser. Agenda. Agenda. Requirements Concept

salvador-gutierrez
Download Presentation

XFEL

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. XFEL The European X-Ray Laser Project X-Ray Free-Electron Laser Communication in ATCA-LLRF System Presenter:Waldemar Koprek XFEL-LLRF-ATCA Meeting, 3-4 December 2007

  2. XFEL The European X-Ray Laser Project X-Ray Free-Electron Laser Agenda Agenda • Requirements • Concept • Communication interfaces in ATCA standard • Channel definition on a fabric interface • Proposed backplane topology of an ATCA shelf • Schedule • Requirements • Concept • Communication interfaces in ATCA standard • Base Interface • Fabric Interface • Links on a Carrier Board • Links to RTM • Links to Other Systems • Schedule XFEL-LLRF-ATCA Meeting, 3-4 December 2007 2

  3. XFEL The European X-Ray Laser Project X-Ray Free-Electron Laser Agenda Requirements • Requirements • Concept • Communication interfaces in ATCA standard • Base Interface • Fabric Interface • Links on a Carrier Board • Links to RTM • Links to Other Systems • Schedule • Fast, low latency links for fast feedback loop, piezo control • High throughput between pulses for DAQ systems – sending a lot of data recorded during pulse • Boards management mechanism • Boards control in ATCA Shelf • Control of RTMs • Interfaces to other systems XFEL-LLRF-ATCA Meeting, 3-4 December 2007 3

  4. XFEL The European X-Ray Laser Project X-Ray Free-Electron Laser Communication interfaces offered by ATCA standard • PICMG3.0 – General Specification, ATCA Backplane Topology, • IPMI • E-Keying • Subsidiary Specifications: • PICMG3.1 Ethernet / Fibre Channel • PICMG3.2 Infiniband • PICMG3.3 PCI Express / Advanced Switching • PICMG3.4 Starfabric • PICMG3.5 RapidIO • PICMG3.6 PRS fabric XFEL-LLRF-ATCA Meeting, 3-4 December 2007 4

  5. XFEL The European X-Ray Laser Project X-Ray Free-Electron Laser Low Latency Link PCIe I2C Ethernet Other systems General concept RTM1 AMC1 Other systems AMC1 AMC1 RTM2 AMC1 AMC1 AMC1 HUB CPU Shelf Manager ATCA Shelf 5

  6. XFEL The European X-Ray Laser Project X-Ray Free-Electron Laser Latency in selected communication standards • Rocket IO • direct peer-to-peer connections • latency around 300 ns (Virtex 2 Pro) and 100 ns (Virtex 5)‏ • PCI Express • connections via switch • minimum latency 500-700 ns depending on payload size • up to 10 us with higher switch load • Gigabit Ethernet • 2.5 us • 10 Gigabit Ethernet • 250-600 ns XFEL-LLRF-ATCA Meeting, 3-4 December 2007 6

  7. XFEL XFEL The European X-Ray Laser Project The European X-Ray Laser Project X-Ray Free-Electron Laser X-Ray Free-Electron Laser Agenda ATCA-LLRF Channel Definition for Shelf Backplane Rx+ Rx- Tx+ Tx- Rx+ Rx- Tx+ Tx- + - + - + - + - Port 2 Port 3 Fabric Channel PICMG 3.0 + - + - + - + - Port 0 Port 1 Rx+ Rx- Tx+ Tx- Rx+ Rx- Tx+ Tx- ATCA-LLRF Channel Option 2 Option 1 Custom Link Custom Link Custom Link 1 Custom Link 2 Custom Link 1 Custom Link 2 Port 2 Port 3 Port 2 Port 3 Ethernet PCIe Link 1000BASE-BX 1000BASE-BX (Optional) Lane 1 Lane 2 (Optional) Port 0 Port 1 Port 0 Port 1 XFEL-LLRF-ATCA Meeting, 3-4 December 2007 7

  8. XFEL The European X-Ray Laser Project X-Ray Free-Electron Laser How many slots we need in one ATCA shelf? • 5 x Carrier Boards (2 slots each) – 10 slots • 4 cards for 4 cryo-modules • 1 card as a main controller • 1 HUB (or 2 for redundancy) – 1 or 2 slots • CPU – 0,1 or 2 slots • 1 CPU without redundancy • 2 CPUs with redundancy • 0 CPU in case of distributed control system (AMC-CPU cards) TOTAL: 12-14 slots ATCA shelf XFEL-LLRF-ATCA Meeting, 3-4 December 2007 8

  9. XFEL The European X-Ray Laser Project X-Ray Free-Electron Laser HUB Base Interface in 14 Slots Shelf 1 2 3 4 5 6 7 8 9 10 11 12 13 14 P20 Clock Update Fabric Interface 13 P21 12 11 10 9 8 7 P22 6 5 4 3 P23 2 1 To Shelf Manager Base Interface P24

  10. XFEL The European X-Ray Laser Project X-Ray Free-Electron Laser 1000BASE-T RocketIO 1000BASE-BX Optional PCIe or 1000BASE-BX C5 C4 C1 C2 HUB C3 CPU Utilization 10 of 91 channels 11% Maximum 16 of 91 channels 17% Utilization 8 of 14 channels 57% 100% with redundant HUB Backplane Links in the 14 Slots Full Mesh Shelf 1 2 3 4 5 6 7 8 9 10 11 12 13 14 P20 Clock Update Fabric Interface P21 P22 To Shelf Manager P23 Base Interface P24

  11. XFEL The European X-Ray Laser Project X-Ray Free-Electron Laser 1000BASE-T 1000BASE-BX RocketIO HUB C5 C4 C1 CPU C2 C3 Utilization 10 of 91 channels 24% Utilization 8 of 14 channels 57% Backplane Links in the 14 Slots Dual-Dual Star Shelf 1 2 3 4 5 6 7 8 9 10 11 12 13 14 P20 Clock Update Fabric Interface P21 P22 P23 To Shelf Manager Base Interface P24

  12. XFEL The European X-Ray Laser Project X-Ray Free-Electron Laser Derived Requirements for Carrier Card and E-Keying • One 1000BASE-T ethernet on base interace • Configurable RocketIO connection to any of 14 channels on fabric interface for low latency link – port 2 and 3 in the channel • Configurable 1000BASE-BX ethernet on any of 14 channels on fabric interface for DAQ • I2C connection from carrier board to RTM Other requirements • Universal AMC card with optical link to other systems XFEL-LLRF-ATCA Meeting, 3-4 December 2007 12

  13. XFEL The European X-Ray Laser Project X-Ray Free-Electron Laser Schedule • E-Keying definition for IPMI • Purchasing HUB card • Ethernet communication • 1Gb Ethernet on base interface tests using CPU • 1Gb Ethernet on fabric interface using CPU • HUB configuration • 4. PCIe tests • Communication between carrier cards on shelf backplane • Communication between AMC and carrier cards • 5. Low latency link tests on a carrier cards and on a shelf backplane • 6. Control link between carrier card and RTM • 7. System integration 7 6 RTM ready 5 Carrier ready 4 Carrier ready 3 2 1 time January March May February April June July August September November October December 03.12.2007 2008 XFEL-LLRF-ATCA Meeting, 3-4 December 2007 13

  14. XFEL The European X-Ray Laser Project X-Ray Free-Electron Laser Thank You XFEL-LLRF-ATCA Meeting, 3-4 December 2007 14

More Related