170 likes | 266 Views
Dealing with Internet Connectivity in Distributed Computing. Firewalls & Private Networks. Firewalls cheap and good way to protect networks headquarters of integrated security systems Private networks A solution to IPv4 address shortage problem
E N D
Firewalls & Private Networks • Firewalls • cheap and good way to protect networks • headquarters of integrated security systems • Private networks • A solution to IPv4 address shortage problem • Easy network management & easy address planning • Connections are blocked!
Ad Central Manager Ad match match negotiation startd shadow sched starter Connectivity Problem Submit Machine Exec Machine Job Xfer
Ad Central Manager Ad match match negotiation startd shadow sched starter Connectivity Problem X Submit Machine Exec Machine X Job Xfer
Ad Central Manager Ad match match negotiation startd shadow sched starter Connectivity Problem X Submit Machine Exec Machine X Job Xfer
Connectivity Problem • Collaboration becomes difficult or impossible • Resources are wasted
Agenda • Introduction • DPF (Dynamic Port Forwarding) • GCB (Generic Connection Brokering) • Future Work • Conclusion
B A X BIND (B) X X A X A B Dynamic Port Forwarding B = socket(); bind(B, ANY); getsockname(B, X); A = socket(); DPF agent Server connect(A, X); NAT Client DPF lib X B
DPF • Basic Idea: On-demand open/close • Supports Linux NAT box • Can support any firewall with APIs such that open, close, list • Fast & scalable
X Server Client BIND (B) B A X X GCB: socket registration B = socket(); bind(B, ANY); getsockname(B, X) GCB lib GCB lib Broker
X Server Client B A CONNECT (X) PASSIVE GCB: passive connection connect(A, X) GCB lib GCB lib CONTACT (A) Broker
X Y Server Client B A CONNECT (X) ACTIVE (X) GCB: relay connection connect(A, X) GCB lib GCB lib CONTACT (Y) Broker
GCB • Basic Idea: reversing the direction underneath the application • Supporting Environments • No requirement to firewalls • Outbound connections are allowed • GCB requires no control on your firewall
Future Works • Support for multiple connection mechanisms • Security • Dynamic open/close for outbound • eGCB (extended GCB)
4) connection setup 3) negotiation F/W F/W 2) open for outbound outagent 1) registration Connection Setup client server inagent
Conclusions • DPF is fast and scalable • GCB requires no control on headnodes • eGCB provides wide coverage • GCB and eGCB can be used by other applications