1 / 34

NVMe ™ in the Virtualized World

NVMe ™ in the Virtualized World. Sponsored by NVM Express™ organization, the owner of NVMe™, NVMe-oF ™ and NVMe-MI™ standards. Speakers.

helki
Download Presentation

NVMe ™ in the Virtualized World

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. NVMe™ in the Virtualized World Sponsored by NVM Express™ organization, the owner of NVMe™, NVMe-oF™ and NVMe-MI™ standards

  2. Speakers Sudhanshu (Suds) Jain leads product management for core infrastructure in the area of computing, storage, and networking for vSphere Cloud Platform at VMware. He is also responsible for infrastructure innovations, new technology adaptions, and its use-case and solution development over virtualization environment. Prior to joining VMware, Suds was Director of Product Management at Alcatel-Lucent where he was leading the distributed data-center fabric solution in telco space. Sudhanshu (Suds) Jain

  3. Agenda Market Trends and Modern Infrastructure Storage Industry and NVMe™ NVMe Challenges to Software and It’s Evolution NVMe @VMware Key Takeaways

  4. Agenda Market Trends and Modern Infrastructure Storage Industry and NVMe™ NVMe Challenges to Software and It’s Evolution NVMe @VMware Key Takeaways

  5. vSphere Customer Survey Areas of opportunities & challenges Source: IDG Enterprise Research, 2017

  6. CONFIDENTIAL Rise of the Third Platform Transforming the World of Applications By 2020: “We will be creating 44 zetabytes of data annually” (IDC) Artificial Intelligence Business Intelligence By 2022: “The AI market is expected to be worth $16 billion” Markets Hyper-scale Datacenter Machine Learning Real-time analytics Datasphere to be 175 Zeta bytes by 2025, with 61% CAGR!* Deliver risk and opportunity for future Predictive Analytics Transactional Processing

  7. Key Infrastructure Challenges EXPLOSIVE GROWTH OF DATA NEAR REALTIME HIGHLY DISTRIBUTED “Efficient Delivery” of “Capacity” with “Consistency” “Capacity” with “Performance” Build “Capacity” Towards Data-centric Future!

  8. What Constitutes Modern Infrastructure? Ability to bring Hardware Innovation @Scale True convergence with datacenter as a computer Inherently secure Easy to scaleand manage Virtualization and Cloud Consumption is De-facto!

  9. The VMware Cloud Solution Modern and Consistent Infrastructure Across the Public Cloud, Data Center, and Edge VMware Delivers Across the Public Cloud, Data Center, and Edge Networking Management Compute Storage Data Center Public Cloud Edge

  10. Agenda Market Trends and Modern Infrastructure Storage Industry and NVMe™ NVMe Challenges to Software and It’s Evolution NVMe @VMware Key Takeaways

  11. Storage Industry Under Transformation Evolving space of compute, storage and interconnect High speed interconnect to keep up with fast storage Hi-Density Flash and NVDIMM will dominate Enterprise Storage CPU densities continues to increase Technology Trends • Higher CPU density, faster data access and high-speed interconnects, all are changing the paradigm of IT infrastructure designs • These trends are already changing how enterprise storage solutions designed and deployed; disrupting the complete ecosystem of SAN as well as DAS market Source: http://www.theregister.co.uk/2016/09/05/wikibon_server_san_takeover/

  12. NVMe™ : A New Drive Technology NVMe™ needs new controller and faster media to deliver on its promise! NVMe HDD SSD Getting multiple blocks of information all at once! It is fast Ah, no need to wait for the blocks to come to the right place – picking blocks when you need them, one at a time The head has to move to the right place and wait for the right block to come around Source: http://www.snia.org/sites/default/files/files2/files2/contrib_articles2014/S4-S7%20SNIA%20Europe%20v3%20Single%20Pages.pdf

  13. All Flash and HCI is the Key Driver NVMe™ Adaption and Drivers $11.8B ™ $16.2B Overall revenue of flash media has already exceeded HDD;NVMe is the main growth engine $7.3B Source: snia.org & IDC Source: https://www.flashmemorysummit.com/English/Collaterals/Proceedings/2017/20170809_S202A_Burgener.pdf

  14. NVMe™ : Architected for NVM A Device, A Controller Or A Protocol? • NVM Express™ defines a host controller interface and command set for use with non-volatile memory (NVM) • Key differentiators • Streamlined Commands; lighter weight I/O Stack • Direct access to CPU; lower latency • Massive parallelism; higher throughput • Faster media, simplified controller • Scalable performance, alternative to SCSI • Key Innovations • http://www.nvmexpress.org • http://www.snia.org • https://www.jedec.org/ • http://www.onfi.org Source: http://www.datacenterjournal.com/answer-nvme-questions/

  15. NVMe-MI 1.0 Nov’15 NVMe Cmd Set Spec(s) NVMe-oF 1.0 May’16 NVMe2.0* NVMeoF-1.1* NVMe 1.2.1 May’16 2015 NVMe Transport Spec(s) Q4 Q2 Q3 Q1 Q2 Q4 Q4 Q1 Q1 Q3 Q2 Q2 Q2 Q3 Q3 Q1 Q1 Q2 Q3 Q4 Q1 Q4 Q1 Q2 Q4 Q4 Q3 Q3 NVMe 1.3 May’17 2021 2020 2019 2017 2016 2018 NVMe-MI 1.1 May’19 NVMe 1.4 June’19 NVMe Base Spec NVMe™ Specification Roadmap • NVMe™ • Sanitize • Streams • Virtualization • Sanitize • Streams • Virtualization • Merged w/Fabrics • Namespace Types • Alternate Cmd Sets In 45-day Review • NVMe-oF™ • Transport and protocol • RDMA binding • Enhanced Discovery • In-band Authentication • TCP Transport Binding • Out-of-band management • Device discovery • Health & temp monitoring • Firmware Update • NVMe-MI™ • Enclosure Management • In-band Mechanism • Storage Device Extension Released NVMe specification Planned release

  16. NVMe™ is The New Language of Storage * Data provided by G2M Research

  17. Agenda Market Trends and Modern Infrastructure Storage Industry and NVMe™ NVMe Challenges to Software and It’s Evolution NVMe @VMware Key Takeaways

  18. #SER2413BU CONFIDENTIAL Innovations are Posing Big Challenges Let’s Look Closer on the Anatomy of Data Access How does various Technology perform? Various Delays? Focus for further optimization Source: https://www.snia.org/sites/default/files/SDC15_presentations/gen_sessions/JimHandy_The_Long-Term_Future_PrintVersion.pdf

  19. Key Challenges for NVMe™ Based Architecture NVMe™ Requires Fresh Approach for Software Stack Designs

  20. Typical Storage Stack Application Application Application File System Block storage IO Scheduler SSD Processing resources Implied serialization Driver 100 KIOPS Source: https://www.flashmemorysummit.com/English/Collaterals/Proceedings/2013/20130812_PreConfD_Marks.pdf

  21. Storage Evolutionary Path & Key Drivers Building the Stack for Future System Applications Flash evolution in cost, endurance and capacity NVMe™ as a replacement of SCSI Composable Infrastructure NVMe Over Fabric as primary way to access storage SAN Evolution towards Server Attached Storage File System Byte addressable Block storage NVDIMM Storage SCSI Storage Architecture NVMe Storage Architecture SCSI Driver NVMe/NVMeoF Driver

  22. Storage Stack Architecture Evolution ESXi Storage Stack ESXi Next Generation Storage Stack NVMe Transport Device Driver Framework RDMA Transport Driver (RoCEv1, RoCEv2, iWarp) Fibre Channel Transport Driver PCIe Transport Driver Stack Interface 1 Stack Interface 2 SCSI NVMe Translation CLI NVMe Core Functionality NVMe-oF Transport Abstraction Driver Interface

  23. NVMe-oF™ : Revolutionizing the SAN Architecture Scalability NVMf The value of data is based on how fast it can be accessed and processed Faster storage access enables cost reduction through consolidation Independently scale/life-cycle storage and compute infrastructures Data resilience – Mitigate the “server stranded storage” (with DAS storage) problem Optimized data delivery to applications Efficiency of shared storage with no compromise Unlocking the Reach of Data Bandwidth Latency NVMe IOPS

  24. Host Host Host ROCE Transport Driver TCP/IP Transport Driver Fibre Channel Transport Driver Host Storage Stack Host Storage Stack RDMA Fabric TCP/IP Fabric FC Fabric Host Storage Stack NVMe-oF™ : Multiple Transports The Future of External Storage NVM subsystem NVM subsystem NVM subsystem NVMe Driver NVMe Driver Single/Multipath Devices Single/Multipath Devices Single/Multipath Devices NVMe Driver • Overview • Multiple transport address varied customer needs • Address various use-cases • Access to high performance storage arrays • Efficient access to faster flash (JBoF) • Disaggregate compute and storage Host ROCE Transport Driver TCP/IP Transport Driver Host FC Transport Driver Storage Target Storage Target

  25. CONFIDENTIAL Reliability, Serviceability, and Availability (RAS) Get device information Administration CLI/UI/API Locate physical disk SMART Set disk LED state RAS Collection/Intelligent Action Manage disk write cache Hot-plug and un-plug Drives Get drive temperature OS/Stack compatibilities

  26. Agenda Market Trends and Modern Infrastructure Storage Industry and NVMe™ NVMe Challenges to Software and It’s Evolution NVMe @VMware Key Takeaways

  27. NVMe™ Focus @VMWare vSphere 6.7 Future Direction vSphere 6.5 • Performance enhancements • Extended CLI • Name space management • Async event error handling • Enhance diagnostic logs • PCIe Native Hot-plug • LED Management • NVMe Over Fabric • Multiple fabric option • Sanitize • Boot (UEFI) • Firmware Update • End-to-end protection • Deallocate/TRIM/Unmap • 4K • SMART, Planned hot-remove Driver • Reduced serialization • Locality improvements • vNVMe Adaption layer • Multiple completion worlds support in NVMe • Optimized stack - Highly parallel execution for single path local NVMe devices • Reach target of 90%+ performance of device spec • Next Generation Storage Stack with ultra-high IOPS • End-to-end NVMe Stack • NVMe Multi-pathing, ANA Core Stack • NVMe 1.0e spec • Hot-plug support • VM orchestration • Performance improvements • Async mode support • unmap support • Rev the specification • Parallel execution @backend • 4K Support • Scatter-gather support • Interrupt coalescing Virtual Devices

  28. NVMe Device Emulation vSphere Stack Offers Rich Set of I/O Services Including NVMe™ Para-Virtualized Device OS Stack Guest TCP/IP STACK SCSI STACK NVMe STACK NIC Driver Para Virtualized RDMA Native NVMe Driver PVSCSI Driver I/O Device Driver Direct Pass-through VF Monitor PVSCSI vNVMe vmxnet3 LSI vRDMA NVMe SSD PCIe VDS PF NIOC Virtual Volumes NFS VMFS Virtual SAN Scheduler I/O Driver NVMeOverFabric NVMe FCoE iSCSI SIOC Memory Allocator RDMA SAS/SCSI FC/SAS NIC ESXi PCI Physical Hardware Hardware Accelerations e.g. QAT Interconnect like IB and OPA PCI SSD NIC FPGA GPU/GPGPU HBA HDD

  29. VMware’s NVMe™ Driver Ecosystem • Available as part of base ESXi image from vSphere 6.0 onwards • Faster innovation with async release of VMware NVMe™ driver • VMware Opensource its NVMe Driver to encourage ecosystem to innovate • https://github.com/vmware/nvme • Broad VMware NVMe Driver Ecosystem https://www.vmware.com/resources/compatibility/search.php?deviceCategory=io • Close to 300 third party NVMe devices certified on VMware NVMe driver • Beyond NVMe PCI Driver (Future) • Actively working with broad I/O controller and storage array partners to bring NVMe-oF solutions

  30. Agenda Market Trends and Modern Infrastructure Storage Industry and NVMe™ NVMe Challenges to Software and It’s Evolution NVMe @VMware Key Takeaways

  31. Key Takeaways NVMe™ future is now! NVMe is challenging the existing OS, DAS and SAN Model! This time around software has to play the catch-up! Ultimate winners are customers and applications eco-system!

  32. Questions?

More Related