1 / 12

Internet 2 Distributed Storage Infrastructure Update

Explore advancements in Internet2 Distributed Storage Infrastructure, such as replication mechanisms, proximity resolution, and modelings. Learn about server deployment, infrastructure expansion, and application workshops for better data storage and access solutions.

jonij
Download Presentation

Internet 2 Distributed Storage Infrastructure Update

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Internet2 Distributed Storage Infrastructure Update Micah Beck andTerry Moore Univ. of Tennessee, Knoxville Bert Dempsey Univ. of North Carolina, Chapel Hill Coalition for Networked Information 26 & 27 April 1999, Washington, DC http://dsi.internet2.edu

  2. UT Knoxville / ICL Micah Beck Terry Moore Martin Swany Judi Talley UNC Chapel Hill /SILS Bert Dempsey Paul Jones (MetaLab) Debra Weiss Zhiwei Xiao GigaPOP and Campus Site Managers UCAID/Internet2 Network Storage Working Group Ted HanssApplications Director Ann O’BeayCorp. Relations Director NC Networking Initiative Digital Library Federation I2-DSI Participants

  3. I2-DSI Model: Replicated Services • Clients access nearby server • Everyone gets performance • Local resources implement a global service

  4. replicated core delegated server local users I2-DSI Service Architecture • Replication • Rsynch, Omnicast, AFS/DFSNovell Replication • Resolution • Sonar DNS, Distributed Director • Delegation • Cache prefetch general users

  5. Current Server Deployment

  6. Infrastructure Expansion • StorageTek • 3-4 PC/Linux Servers • 700GB disk, tape backup (hot!) • Novell • 6 PC/NetWare Servers • 100GB disk • Smaller institutions or departments

  7. InfrastructureDevelopment Efforts • Proximity Resolution • Martin Swany: SonarDNS • Geoff Carpenter, German Goldszmidt: Narwhal (IBM) • Replication Mechanisms and Modeling • Bert Dempsey & students: • Debra Weiss: Batch rsync + multicast • Zhiwei Xiao: Network metrics and modeling • Channel Representation and Server • Leif Abrahamsson, Christophe Achouiantz, Patrik Johansson (Ellemtel)

  8. 10 applications Indiana: Digital music and media library UNC-CH: Instructional Management System San Jose State: Art history images Vanderbilt: zoomable medical images Viagenie: Network docs database Columbia: Earth sciences environment UNC-CH: Virtual Laboratories Ohio Supercomputer Center: High Volume Datasets CalTech: Globally Interconnected Databases Univ. of Kent: National Software Archive Red Hat: pan-Linux source distribution I2-DSI Applications WorkshopChapel Hill, NCMarch 4 &5, 1999

  9. I2-DSI Applications WorkshopChapel Hill, NCMarch 4 &5, 1999 • 4 technologies • Minnesota: Scalable Video • IBM Research: Multicast, Filter and Store • Moscow Ctr. for New Info. Tech. in Med. Ed.: Semantic Text Analysis • IBM Research: Service Resolution Proxy • http://dsi.internet2.edu/apps99.html • Special issue of the Journal of Network and Computer Applications (Academic Press)

  10. Application Management Partner MetaLab.unc.edu • The site formerly known as SunSITE.unc.edu • Fearless Leader Paul Jones • “A cool, tall glass of sweet tea on a hot day.” • 2 M HTTP & 1/3 M FTP file transfers daily • Collections policy • teaching, research, or public service • use technology in innovative and unique ways • non-commercial or not-for-profit

  11. The Need for Channel Representation Standards locally interpreted files replicated files Origin Server Replicated Server Replicated Server proxy Web clients Standard-based Web traffic Replication of source files

  12. Conclusions • A server platform is in place • Infrastructure development • Service abstractions (search, computation) • Publication and replication protocols • Portable representation and API • Heterogeneous servers • Six months to show results from initial application development efforts

More Related