CUTS UNITE DSML for Dataflow Modeling

1. CUTS UNITE DSML forDataflow Modeling By Pooja Varshneya

2. Component Workload Emulator (Coworker) 
Utilization Test Suite (CUTS) • CUTS is a framework comprising of various system execution modeling (SEM) and system trace analysis tools. • Enable system developers and tester to conduct system integration testing during the early stages of the software lifecycle. • Assists in locating and rectifying quality-of-service problems during development phase of DRE systems. • Facilitates continuous system integration testing throughout the software lifecycle.

3. CUTS

4. UNITE • UNITE is a system execution trace analysis tool. • Uses a dataflow model that is used to extract metrics of interest based for QoS evaluation. • Log messages are used to capture metrics of interests, such as time an event was sent or values of elements in an event. • Metrics of interest within the log messages are identified using message constructs. • QoS evaluation equation to applied to a dataflow model to evaluate QoS attributes, such as end-to-end response time, latency, and scalability.

5. EXAMPLE Evaluation Function LF2.replytime – LF1.recvtime LF1: {STRING owner} receive request{INT reqid} at {INT recvtime} LF2: granting access at {INT replytime} to request{INT reqid} Relation activating Login Component. . . Login Component receive request6 at 9567349456 Validating username and password for request6 Username and password is valid granting access at 9567349459 to request6 . . . Deactivating the Login Component LF1.reqid = LF2.reqid Log Format SQLite DB

6. Need for DSML • As dataflow models increase in size in terms of number of log formats and relations amongst them, it becomes difficult for DRE developers to manage the complexity. • DSML provides an easy to use visual interface for creating dataflows. • Preserves the semantics of the language. • Enforces creation of valid relations between log formats by constraint checking. • Prevents duplication of dataflows.

8. CUTS UNITE DSML CUTS UNITE DSML Datagraphs can be defined as DM = (LF, CR, f) • A set LF of log formats that have variables V identifying what data to extract from log messages. • A set CR of causal relations that specify the order of occurrence for each log format such that C Ri,j means LFi → LFj , or LFi occurs before LFj • A user-defined evaluation function f based on the variables in LF.

9. CUTS UNITE DSML CUTS UNITE DSML Unit Test can be defined as UT = (fa , fe ,G, S) • fais an aggregation function used to convert a data set to a single value. • Examples : AVERAGE, MIN, MAX, and SUM. • feis an evaluation function used to evaluate log-format attributes. • For a given aggregation function fa, grouping G is used to identify data sets that should be treated independent of each other. • A Service S defines any external utility that can process the results generated by UNITE. • Examples : gnuplot

10. CUTS DSML Meta-Model

11. CUTS DSML Constraints View Connection.src (“Type”) == Connection.dst(“Type”)

12. DaDatagraph Example Relation Log Format Key

13. CUTS UNITE Interpreter • UDM based interpreter • Validates the models against XML schema definition. • Parses the datagraphs and unit tests to generate XML based configuration files • <datagraph_name>.datagraph • <UnitTest_name>.unite • Uses Xerces DOM parser to create XML Document.

14. Interpreter Output UnitTest_Login.unite Datagraph_Login.datagraph

15. Project Website http://www.dre.vanderbilt.edu/CUTS/

16. DEMO