Synchronization over Ethernet

1. Synchronization over Ethernet Standard for a Precision Clock Synchronization Protocol according to IEEE 1588 Synchronous Ethernet according to ITU-T G.8261

2. Who is ZHAW – Zurich University of Applied Sciences? • The School of Engineering is a department of the Zurich University of Applied Sciences (ZHAW) • ZHAW‘s Institute of Embedded Systems has a strong commitment to industrial communications in general and to Ethernet in particular, e.g. • Real-time Ethernet (Ethernet Powerling, ProfiNet, etc.) • Synchronization (IEEE 1588) • High-availability Ethernet add-ons (MRP, PRP, etc.) • The related R&D activities and services include • Hardware assistance and off-load (IP) • Protocol stacks • Support • Engineering and consultancy

3. Preliminary remark • only Ethernet solutions are taken into account in this presentation (according to workshop planning) • this requires some compromises to be accepted • the big advantage to be exploited is that the same infrastructure can be used for both data transmission and synchronization

4. The Standard IEEE 1588

5. The Standard IEEE 1588PTP Message Exchange  Master Clock  Slave Clock PTP PTP Delay and Jitter ProtocolStack Delay and Jitter ProtocolStack UDP UDP optional IP IP MAC MAC MII MII Phy Phy Network PTP Precision Time Protocol (Application Layer) UDP User Datagram Protocol (Transport Layer) IP Internet Protocol (Network Layer) MAC Media Access Control Phy Physical Layer Delay and Jitter Network

6. 40 38 42 40 44 42 46 t0k 44 Sync(t0k) 48 46 50 48 52 50 Δ0 = t0k+1- t0 k Δ1= t1k+1- t1 k Drift = 54 52 56 54 58 56 60 58 Δ 1 - Δ 0 Δ 1 62 60 64 62 The Standard IEEE 1588Determination of Phase Change Rate (Drift) – one step Master Clock Slave Clock t1k Δ0 Δ1 t0k+1 Sync(t0k+1) t1k+1

7. 40 38 42 40 44 42 46 t0k 44 Sync() 48 46 50 Follow_up(t0k+1) Follow_up(t0k) 48 52 50 Δ0 = t0k+1- t0 k Δ1= t1k+1- t1 k Drift = 54 52 56 54 58 56 60 58 Δ 1 - Δ 0 Δ 1 62 60 64 62 The Standard IEEE 1588Determination of Phase Change Rate (Drift) – two step Master Clock Slave Clock t1k Δ0 Δ1 t0k+1 Sync() t1k+1

8. Master Clock Slave Clock 40 apparent concurrency 38 O = Offset = ClocksSlave – ClocksMaster 42 40 44 42 O 46 t0 44 Sync(t0) A measured values t0, t1, t2, t3 A = t1-t0 = D+O B = t3-t2 = D-O Delay D = Offset O = 48 D = Delay 46 50 Follow_up(t0) t1 = t0+D+O 48 52 50 54 52 t2 56 Delay_Req() B 54 58 56 t3 60 58 62 Delay_Resp(t3) A + B 2 A - B 2 60 64 62 t3 = t2-O+D The Standard IEEE 1588Determination ofDelay and Offset

9.  Slave Master PTP PTP UDP UDP IP IP The Standard IEEE 1588Boundary Clock copes with the Network‘s Delay Fluctuations Master Clock Switch with Boundary Clock Slave Clock   PTP PTP UDP UDP IP IP MAC MAC MAC MAC Phy Phy Phy Phy Switching Function

10. The Standard IEEE 1588Topology and „Best Master Clock“ Ordinary Clock, Grandmaster: clock selected as „best Master“ (selection basedon comparison of clock descriptors) M S Boundary Clock, e.g. Ethernet switch M M M S: Port in Slave State M: Port in Master State S S S S S M M M S Ordinary Clock

11. The Standard IEEE 1588 Version 2Transparent Clock Slave Clock Master Clock Transparent Clock t0 Sync(t0 , corr) Δs Sync(t0 , corr +Δs) t1 Follow_up(t0) t2 Delay_Req(corr) Δr Delay_Req(corr + Δr) t3 Time Stamping Delay_Resp(t3, ∑corr) Δ Residence Time t t

12. The Standard IEEE 1588 Version 2 Transparent Clock – End-to-End Delay Measurement S TC S M TC TC S TC S S Sync Stream e2e Delay Measurement

13. The Standard IEEE 1588 Version 2 Transparent Clock – Peer-to-Peer Delay Measurement S TC S M TC TC S TC S S Sync Stream p2p Delay Measurement

14. The Standard IEEE 1588Limits • Timestamp quantization effects • Accuracy of Start-of-Frame Detection • Unknown portion of data path asymmetries in cables and transceivers • Jitter in the data path (PHY chips, network elements) • Environmental conditions • Oscillator instabilities • Implementation specific effects (e.g. phase between different asynchronous clock domains of all involved functional building blocks) • Note: Uncertainty due to limited observation capabilities (e.g. the PPS output is subject of quantization effects as well) • Stochastic effects can be filtered out with statistical methods • Systematic errors remain

15. The Standard IEEE 1588Industry Relevance • PTP is or will be applied in application areas such as • Test and Measurement (LXI: LAN eXtensions for Instrumentation) • Automation and control systems (various flavors of real-time Ethernets) • Audio/Video Bridge (AVB according to IEEE 802.1as) • Telecommunications • Silicon vendors and IP providers offer • Protocol software • Hardware assistance IPs • PHYs with hardware assistance logic • IEEE-1588 enabled microcontrollers • Switching cores with IEEE-1588 support

16. Synchronous Ethernet

17. Synchronous EthernetPhysical Layer Timing in Legacy Ethernet • Ethernet works perfectly well with relatively inaccurate clocks • Each Ethernet link may use its own clock • nominal clock rate is the same, but deviations of ± 50 ppm are allowed (dimensioning such that physical layer buffers do not underflow or overflow) • Details differ according to transmission technology • where the two directions of a link use different media (i.e. separate wire pairs or separate fibers), both directions may have independent clocks • GBE over twisted pair uses all wire pairs simultaneously in both directions  signal processing (echo compensation technique) requires same clock on both directions of a link one PHY acts as the master, the other as slave

18. Synchronous EthernetTiming of a Fast Ethernet Link (100 Base-TX) 25 MHz ± 50 ppm MAC PHY PHY MAC TX_CLK RX_CLK Cable TX_CLK RX_CLK Symbol 25 MHz ± 50 ppm clk clk transmission line is driven by clk clk recovered from transmission line

19. X X X X Synchronous EthernetPhysical Layer Timing in Legacy Ethernet E X E E X X E X E E

20. Synchronous EthernetTiming of a Gigabit Ethernet Link (1000 Base-T) • 1000 Base-T transmission is split on 4 wire pairs operation simultaneously in both directions • transmitter and receiver are coupled via a hybrid • echo compensation is applied • both directions require the same clock • A 1000 Base-T PHY can operate as a master or slave. • Master/slave role selection is part of the auto-negotiation procedure. • A prioritization scheme determines which device will be the master and which will be slave. • The supplement to Std 802.3ab, 1999 Edition defines a resolution function to handle any conflicts: • multiport devices have higher priority to become master than single port devices. • if both devices are multiport devices, the one with higher seed bits becomes the master.

21. Synchronous Ethernet1000 Base-T uses 4 pairs simultaneously in both directions

22. Synchronous Ethernet1000 Base-T Pysical Layer Signalling with Echo Compensation

23. Synchronous EthernetTiming of a Gigabit Ethernet Link (1000Base-T) 25 MHz ± 50 ppm CLOCK_IN MAC PHY PHY MAC GTX_CLK Master RX_CLK Slave x5 Cable RX_CLK GTX_CLK 25 MHz ± 50 ppm • The Master PHY uses the internal 125 MHz clock generated from CLOCK_IN to transmit data on the 4 wire pairs. • The Slave PHY uses the clock recovered from the opposite PHY as the transmit clock.

24. Synchronous EthernetConcept - 1 • Concept has been proposed, elaborated, and standardized by the Telco community in ITU-T by transferring the traditional SDH clock distribution concept to Ethernet networks • The Primary Reference Clock (PRC) frequency is distributed on the physical layer • a receiver can lock to the transmitter‘s frequency • a switch selects the best available clock • this results in a hierarchical clock distribution tree • OAM messages (Synchronization Status Messages) are used to signal clock quality and sync failure conditions of the upstream switch • to allow selection of the best available timing source (stratum of upstream source) • to avoid timing loops

25. Synchronous EthernetConcept - 2 • Active layer 2 data forwarding topology (as established by spanning tree protocol) and clock distribution tree are independent (i.e. a blocked port can deliver the clock to its neighboring switch) • Design rules (topology restrictions, priorities for source selection) guarantee clock quality • Clocking of Ethernet devices is changed in a way that is fully conforming with IEEE 802.3 standards • Standard PHY chips can be used as long as a few conditions are met, e.g. • PHY provides the recovered receive clock to the external world • GBE PHY allows master/slave role to be set by software (no automatic selection)

26. Synchronous EthernetClock Sources for a Synchronous Ethernet Switch Ext-In Ext-Out Oscillator Clock Selection / Regeneration Port 1 Port 2 Port … Port n

27. PRC tracable clock (other links and directions are free running) Synchronous EthernetPhysical Layer Timing in Synchronous Ethernet E PRC X X E E X X X X E X X E E

28. Synchronous Ethernet Clock distribution based on Ethernet‘s physical layer Provides frequency only Performance is independent of data traffic IEEE 1588 Application layer protocol with hardware assistance Provides frequency and time of day May be susceptible to specific data traffic patterns Synchronous EthernetCompared with IEEE 1588 Complementary technologies, can be used in combination: Syncronous Ethernet delivers accurate and stable frequency to all nodes while IEEE 1588 can deliver time of day, where required.

29. Synchronous EthernetIndustry Relevance • Telco equipment manufacturers rely on both technologies • Synchronous Ethernet operation will certainly be an important feature in future carrier grade products • Synchronous Ethernet’s role in corporate and industrial communication application is not yet forseeable • Silicon vendors and IP providers offer • Synchronous Ethernet compatible PHYs • ICs for clock monitoring, selection, and processing

30. Many thanks for your attention!hans.weibel@zhaw.chZurich University of Applied SciencesInstitute of Embedded Systemshttp://ines.zhaw.ch/ieee1588