150 likes | 279 Views
MR 2 - COSMOS Data Collection Architecture. July 2007 MR 2 Team. MR 2 - COSMOS DC. Architecture Components Data and Meta Data Demo. Data Manager. MR 2 Simplified Architecture. COSMOS DC Runtime. Data Broker. Client Application. Data Manager. MR 2 Distributed Configuration.
E N D
MR 2 - COSMOS Data Collection Architecture July 2007 MR 2 Team
MR 2 - COSMOS DC • Architecture • Components • Data and Meta Data • Demo
Data Manager MR 2 Simplified Architecture COSMOS DC Runtime Data Broker Client Application
Data Manager MR 2 Distributed Configuration COSMOS DC Runtime Data Broker COSMOS DC Runtime COSMOS DC Runtime Client Application COSMOS DC Runtime Data Manager
MR 2 Data Broker COSMOS DC Runtime Data Broker Query Assembly DataBroker.xml Data Broker interface WSDM EP DataBrokerCapability getDataManagers( String classification ) registerDataManager( String hostName, int port, String classification ) unregisterDataManager( String hostName, int port, String classification ) implements
COSMOS DC Runtime Data Manager Datastore * Query Assembly * DataManager.xml Data Adapter * interface DataManagerCapability getAllKeyFamilyNames() getKeyFamilyByName(String kfName) queryKeyFamilyData(String kfName, String query ) WSDM EP implements MR 2 Data Manager * Corporate component
DC Runtime WSDM EP WSDM EP Data Broker Query Assembly Data Manager Query Assembly WSDM EP Data Manager Query Assembly MR 2 Client Client Client API UtilityClient getContextClient( String hostAddress, String contextName, int port ) Client Application * DataBrokerClient getDataBroker( String hostAddress, int runtimePort ) getDataManagers( WsResourceClient dataBrokerClient, String classification ) DataManagerClient getDataManager( String hostAddress, int runtimePort, String dataManagerName ) getAllKeyFamilyNames( WsResourceClient dataManagerClient ) getKeyFamily( WsResourceClient dataManagerClient, String keyFamilyName ) * Corporate component
DC Runtime Datastore Datastore WSDM EP WSDM EP Data Broker Query Assembly Data Manager Query Assembly WSDM EP Data Manager Query Assembly MR 2 Architecture DC Runtime Client API Client Application
MR 2 - COSMOS DC • Architecture • Components • Data and Meta Data • Demo
MR 2 Data Format • SDMX • Data (e.g. performance data) • Meta Data (e.g. resource types) • Reference Meta Data (e.g. system types) • SDMX Key Family • Contains meta data that describes multi-dimensional data • Used to construct queries
MR 2 Data Manager interface • SDMX key family information • getAllKeyFamilyNames() • getKeyFamilyByName(String kfName) • queryKeyFamilyData(String kfName, String query )
Device System NT Unix Router Cisco NT Disk # Reads Resource tree # Writes Memory Page Faults SDMX Model in the Client and the Data Managers System type tree the System Type tree is modeled in the SDMX Reference Meta Data (as an SDMX category tree) the Resource tree is modeled in the SDMXMeta Data (as an SDMX key family with dimensions from a concept tree)
Device System System type tree NT Unix Router Cisco NT Disk # Reads Resource tree # Writes Memory Page Faults SDMX Performance Data Query • Query of Performance Data: • Query machine names from the SDMX category tree (of system types) • Query Key Family dimensions (of the resource tree) Example: graph the Page Faults, # Reads, and # Writes for NT device “usilbs01”
MR 2 - COSMOS DC • Architecture • Components • Data and Meta Data • Demo