70 likes | 215 Views
Development of a Distributed Decentralized Cloud Cluster. Navid Golpayegani Timothy Blattner Tyler Simon Dr. Milton Halem. Design. Object Based Storage System Decentralized Distributed MapReduce programming Paradigm Decentralized. DISHAS. Fully Decentralized Distributed Object-Store
E N D
Development of a Distributed Decentralized Cloud Cluster • Navid Golpayegani • Timothy Blattner • Tyler Simon • Dr. Milton Halem
Design • Object Based Storage System • Decentralized • Distributed • MapReduce programming Paradigm • Decentralized
DISHAS • Fully Decentralized Distributed Object-Store • Hash based distribution • Global lookup table • HTTP communication protocol
DISHAS v2 • Map Reduce on top of DISHAS • Decentralized • Coordination issues with no master node • Distributed Sort • Assignment of Map and Reduce nodes
Performance • Play with various algorithms to find optimal solution for • Evenly distributing data • Quickly re-distributing • Quickly locating data
Testing • Using IaaS cloud services at UMBC • Eucalyptus • Quickly deploy new system • Fully control over system • No interference between experiments
Testing • Sample Installation • 6 Pentium 4 PCs - Hypterthreaded • No hardware virtualization support • Production installation • Two Intel Nehalems with two 4-Core CPUs