1 / 7

Direct Access File System (DAFS): Duke University Demo

Direct Access File System (DAFS): Duke University Demo. Source-release reference implementation of DAFS Broader research goal: Enabling efficient and transparently scalable Internet-based storage and content services Example applications built on TPIE framework Merge TerraFlow – GIS

lloyd
Download Presentation

Direct Access File System (DAFS): Duke University Demo

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Direct Access File System (DAFS): Duke University Demo • Source-release reference implementation of DAFS • Broader research goal: Enabling efficient and transparently scalable Internet-based storage and content services • Example applications built on TPIE framework • Merge • TerraFlow – GIS • DAFS vs. NFS Participants: Jeff Chase, Richard Kisley, Andrew Gallatin,Rajiv Wickremesinghe, Darrell Anderson, Ken Yocum. Collaborators: Margo Seltzer, Norm Hutchinson. Funding provided by Network Appliance and bythe National Science Foundation under grant EIA-9870724 (ESS),with infrastructure support from EIA-9972879 (RI).

  2. DAFS Demo Testbed DAFS / NFS Client 256MB SDRAM DAFS / NFS Server 512MB SDRAM cLAN 86 MB/s GigEther Testbed allows direct comparison of DAFSand NFS applications

  3. User Space OS Kernel PCI Bus NIC TPIE: One Application–Two File Systems DAFS Client NFS Client User Applications User Applications TPIE Library TPIE Library DAFS Client Library cLAN VIPL Library copyin/out DMA VFS/VM Buffercache NFS TCP/IP Stack cLAN Device Driver Ethernet Device Driver DMA cLAN VIA Adapter Alteon Gigabit Ethernet Adapter cLAN VIA Ethernet

  4. Benefits of DAFS • Low I/O overhead • Copy-avoidance with RDMA • Improves application performance up to 2x depending on the I/O demands of the application • Benefits may be much higher since the NFS in our experiments is highly optimized • User-level networking • Enabled by the Emulex/Giganet clan VI network • Reduced protocol overhead on the host • Reduced context switching on the host

  5. TPIE Merge Application • Key component of external sort algorithm • Basic primitive of many external memory applications • Sequential I/O: reads and writes • Merge parameters control compute-I/O ratio • Merge order increases complexity of merge computation • Record density (records / MB) increases the number of merge computations that must be done between I/O’s

More Related