1 / 22

Using Samba with a Commercial Clustered File System

Using Samba with a Commercial Clustered File System. Agenda. Isilon Clustered Storage Overview Developing OneFS Samba and OneFS Clustering Samba Future Requirements. Isilon OneFS Cluster. Work. Vert-Specific. Single file system (1.6 PB) Fully symmetric peers 3 to 96+ nodes

felton
Download Presentation

Using Samba with a Commercial Clustered File System

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Using Samba with a Commercial Clustered File System

  2. Agenda • Isilon Clustered Storage Overview • Developing OneFS • Samba and OneFS • Clustering Samba • Future Requirements

  3. Isilon OneFS Cluster Work Vert-Specific • Single file system (1.6 PB) • Fully symmetric peers • 3 to 96+ nodes • Fast intra-cluster network • InfiniBand • Multi-protocol access • CIFS • NFS • FTP • HTTP/WebDAV • Local userspace Vertical-Specific Imagery for this sequence 3

  4. What Makes Isilon OneFS Special? • Single pool of storage • Granular data protection • Down to the file level • 8x mirroring or +4 recovery • Easy to manage and grow • Add additional nodes in 60 seconds • Automated data balancing • Extreme performance for concurrent access • POSIX and Windows semantics supported 4

  5. Isilon IQ Network Architecture Servers NFS, CIFS, FTP, HTTP Servers (optional 2nd switch) (optional 2nd switch) Servers Client/Application Layer Standard Gigabit Ethernet Layer Isilon IQ Storage Layer Intracluster Communication Infiniband or GigE Layer 5

  6. Writing a File with Isilon IQ Servers NFS, CIFS, FTP, HTTP Servers (optional 2nd switch) (optional 2nd switch) (optional 2nd switch) Servers Work Vert-Specific 6

  7. Writing a File with Isilon IQ (optional 2nd switch) Work Vert-Specific 7

  8. Writing a File with Isilon IQ Servers NFS, CIFS, FTP, HTTP Servers (optional 2nd switch) (optional 2nd switch) (optional 2nd switch) Servers Reading a File with Isilon IQ Work Vert-Specific 8

  9. Servers NFS, CIFS, FTP, HTTP Servers (optional 2nd switch) (optional 2nd switch) Servers Reading a File with Isilon IQ Work Vert-Specific 9

  10. Developer Perspective No Control Full Control • File system • Kernel • Node’s userspace applications • Customer environment • Domain topology • Domain policy • CIFS client • NFS client 10

  11. Samba in OneFS 2.2 3.0.24 Used over 4 years – through Isilon Kernel Supported Samba Requirements • Native Windows ACL storage & enforcement • Native createfile() syscall implementation • Alternate Data Streams • Snapshots with Volume Shadow Copy Service (VSS) • Zero-copy writes and other performance improvements 11

  12. Samba in OneFS Continued… • Cluster coherent share-mode locking • Cluster coherent oplocks • Cluster coherent byte-range locks (in development) • Per-share case-sensitivity • Unicode normalization insensitive • Site locator support • Change notify • And more… 12

  13. IFS Clustering Protocols smbd nfsd httpd ftpd bash IFS Distributed Lock Manager (DLM) Group Management Protocol (GMP) 13

  14. OneFS Distributed Locking [under Samba] Distributed Lock Manager • Expressive • Arbitrary contention tables • Two-tier model • Each node responsible for subset of cluster locks • Local lock caching • Properly Models • Share mode locks • Oplocks • Multi-protocol support without customized applications 14

  15. OneFS Group Membership [under Samba] Group Management Protocol • Rich predicates • More than just node “available” / “unavailable” • Operations based off health of node • Individual I/O directions: Readable / Writeable • Predicates dependent on full cluster state • Degraded read as last resort • Group changes integrate with other modules • I/O automatically routed to available nodes • DLM can renegotiate 15

  16. CTDB on Clustered File Systems Leverage Existing Technology • CTDB is a promising solution for POSIX clustered file systems • Some file systems extend capabilities • Native distributed locking mechanism • Native cluster membership tracking • Native ACLs and other feature obviate need for specific TDBs • Native solutions benefit from • Performance tuning • Build on existing testing and deployment • Samba should benefit from these capabilities when available 16

  17. Samba 3 Wish List Moving forward… • Abstract interface for TDB based solutions • Kernel based solutions and CTDB coexisting • Existing examples • iNotify for Linux • NTFS VFS layer in Samba 4 • Beneficial to other vendors 17

  18. Samba 3 Wish List Moving forward… • Increase communication • Share our features and bug fixes • Minimize parallel development • Vendor specific branches? • Ease merge burden 18

  19. What We Give Back to the Community Enterprise Testing and Deployment • Dedicated Windows enterprise QA team • Hundreds of bugs found • Integration in complex domain topologies • Real world deployment in large production environments • 50,000+ Users • 300+ Domain Controllers • Feature development • Windows 2008 Server Authentication 19

  20. Isilon Customers and Leadership Select Customers Recognition "Isilon's clustered storage products will play a critical role in meeting the capacity and throughput requirements of leading applications.” Richard Villars, Vice President of Storage Systems Research, IDC

  21. Future 2008 and Beyond • CIFS/Samba improvements • Many interesting challenges ahead • Clustered performance • Closer integration with world-leading clustered storage solution • Customer Focus • Our customers continue to push the envelope of Samba development • Growth • Continue to get more involved with Samba community • We need more protocols developers! (Come join us!) 21

  22. Questions? • Steven Danneman • steven.danneman@isilon.com • Tim Prouty • tim.prouty@isilon.com Contact

More Related