1 / 17

Logically Centralized, Physically Distributed

Logically Centralized, Physically Distributed. Mark Stuart Day Cisco Systems. Standard disclaimer. No matter what I say in this talk, I’m not making any Lotus product commitments. Cisco. Outline. What people want What people can have An ancient example: Replicated mail repository

violet-best
Download Presentation

Logically Centralized, Physically Distributed

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Logically Centralized, Physically Distributed Mark Stuart Day Cisco Systems

  2. Standard disclaimer No matter what I say in this talk, I’m not making any Lotus product commitments. Cisco

  3. Outline • What people want • What people can have • An ancient example: • Replicated mail repository • A recent example: • Content distribution network • Conclusions

  4. What people want • Single name/location for single logical service • Service never goes down • Service grows/shrinks smoothly

  5. What people can have • Single name/location for single logical service • Service never goes down • Service grows/shrinks smoothly • Occasional weird errors that violate user expectations

  6. Some ancient history MIT-LCS-TR-376, Date: May 1987 REPLICATION AND RECONFIGURATION IN A DISTRIBUTED MAIL REPOSITORY Author(s): Day, M.S. Pages: 110 Price: $18.00AD Number: A186967 Keywords: data replication, software reconfiguration, availability, reliability, scalable systems, distributed programs, electronic mail repositories, programming languages

  7. Mailbox 1 Mailbox 3 Mailbox 2 Mailbox 4 Mail system architecture(think of Grapevine) Client Directory

  8. Mailbox 1 Mailbox 1 Mailbox 1 Mailbox 2 Mailbox 2 Mailbox 2 Highly available email Client Directory

  9. How did it work? • Systems success • Nice capability for quorum adjustment • New directory algorithm for deletions • Cool dynamic reconfiguration • User failure • “What do you mean I can’t delete that message?” • “Where’s that message gone?”

  10. A recent example:Content distribution networks • Akamai, Digital Island, Mirror Image, Adero, … • $Millions in revenue • $Billions in market capitalization • Might be worth knowing something about

  11. GET some/piece/o/content The bad old days (without content distribution) Client Origin Server

  12. Delivery Node Content Router Request Router GET GET Delivery Node Content Router Request Router Delivery Node New and improved (with content distribution) Origin Server Client

  13. Virtues • Client unchanged • Origin server mostly unchanged • Content URLs may be modified • Add delivery nodes transparently • Move content around transparently

  14. Caveats • Lots of detail missing • Request routing: HTTP redirection, DNS interception, IP hijacking • Content routing: application-level multicast, IP multicast • Both request routing and content routing are nontrivial problems

  15. Weird user-visible errors • Routed to failed box • Content fails to appear • Depending on routing/caching, maybe no content from that domain ever appears again for that client

  16. Making weird errors into not-so-weird errors • Deploy “next-click failover” • Delivery nodes clustered into “supernodes” with switch • Supernode monitors failures • IP addresses of failed nodes remapped onto live nodes • Result is similar to common Web behavior • “What the hey?” [click] “Oh, OK.”

  17. Conclusion • People want something that’s logically centralized, physically distributed • But they don’t want the weird errors that come with distribution • A great thing about the Web: • People are already used to some weird errors

More Related