100 likes | 109 Views
AReNA: Adaptive Distributed Catalog Infrastructure Based On Relevance Networks. Vladimir Zadorozhny , University of Pittsburgh, Pittsburgh, PA Avigdor Gal, Technion, Haifa Louiqa Raschid, University of Maryland, College Park, MD Quiang Ye, University of Pittsburgh, Pittsburgh, PA.
E N D
AReNA: Adaptive Distributed Catalog Infrastructure Based On Relevance Networks Vladimir Zadorozhny, University of Pittsburgh, Pittsburgh, PA Avigdor Gal, Technion, Haifa Louiqa Raschid, University of Maryland, College Park, MD Quiang Ye, University of Pittsburgh, Pittsburgh, PA Nebula Project: http://db.sis.pitt.edu/projects/Nebula
Networked Query Processing query output optimization Network is not (well) predictable Statistics is not reliable evaluation data Relevant statistics:response time, network delay, data transfer rate, etc. Statistics about data Data sources are remote, distributed, heterogeneous
Networked Queries with Distributed Catalog query output optimization evaluation Statistics about data data Scalability ?
LEGEND: performance monitor content server client performance profile-based cluster Profile-Based Performance Monitoring PM Aggregation ?
0.8 iLP1 iLP2 iLP1 = iLP2 = 0.2 0.2 iLP3 = iLP3 Similar non-randomly associated iLPs are aggregated in Relevance Networks iLP similarity measures: Correlation and Mutual Information Aggregated Latency Profiles A client/server pair is characterized by Individual Latency Profiles (iLP). iLPs capture latency distributions experienced by clients when connecting to a server.
Discovering Non-random Associationswith Relevance Networks (RNs) Threshold=0.4 0.75 0.75 LP1 LP1 LP3 LP3 0.45 0.5 0.9 0.9 Threshold=0.7 LP2 LP2 LP4 LP4 0.8 0.8 We adopt RNs as a management tool, to manage large numbers of iLPs.
V I Z U A L I Z E R Performance Prediction RN Generation and Analysis Data Preparation Data Collection AReNA: Architecture AReNA dynamically analyzes and visualizes meaningful relationships among client/ server pairs using Relevance Networks (RNs). Relationships are evaluated using passive measurements made by client applications and gathered on a continuous basis. RNs allow AReNA managing thousands of constantly changing iLPs • Large-Scale Experimental Testbeds • CNRI Handle System • PlanetLab Overlay • Around 50 000 Latency Profiles
DemoTuesday:16:00-17:30Friday: 09:00-10:30