1 / 38

Atropos Latency Diagnostics Tool

Atropos Latency Diagnostics Tool. COMP 415, Spring 2008. Table of Contents. Problem Formulation Solution Features Solution Architecture Major Systems Project Timeline Conclusion. Problem Formulation. Problem Formulation Solution Features Solution Architecture Major Systems

robert
Download Presentation

Atropos Latency Diagnostics Tool

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. AtroposLatency Diagnostics Tool COMP 415, Spring 2008

  2. Table of Contents • Problem Formulation • Solution Features • Solution Architecture • Major Systems • Project Timeline • Conclusion

  3. Problem Formulation Problem Formulation Solution Features Solution Architecture Major Systems Project Timeline Conclusion

  4. Problem Formulation • Messages Take Time To Travel Across a Network • How Can We Find Bottlenecks? • When Should We Cancel a Message?

  5. Problem Formulation | basic Solution • Catch Messages • Correlate • Store Associations • Retrieve Latencies • Display System Map

  6. Solution Features Problem Formulation Solution Features Solution Architecture Major Systems Project Timeline Conclusion

  7. Solution Features • Relocate-Ready Components • Process Abstraction • Encapsulated Optimization Points • Variable Correlation • Multiple Visualizations

  8. Solution Architecture Problem Formulation Solution Features Solution Architecture Major Systems Project Timeline Conclusion

  9. Solution Architecture • Data Flow • Scalability • Data Recipient • Correlation Engine

  10. JPM Service Controller Database Manipulation View Client Data Flow Diagram

  11. Data Mining Correlation Database Scalability Diagram

  12. Possibilities Parsing API Calls Batching Destinations Data Recipient Diagram

  13. Data Reader Data Writer Correlation Engine Diagram

  14. Major Systems Problem Formulation Solution Features Solution Architecture Major Systems Project Timeline Conclusion

  15. Major Systems • Correlation • Messaging • View

  16. Correlation • A correlation engine holds sets of messages and performs matching between the sets. Correlation Engine Input Messages Server Log Data Reader Output Messages Association Store Correlation Rules Input Messages Server Log Data Reader Output Messages

  17. Association Graph Server B • Xml Configuration File • Stores configuration of association graph • Information about correlation rules to use • Formats of data logs In Out Server A In Out Server C In Out

  18. Design Choices • In-memory correlation • Correlation Rules can create their own data structures to expedite their matching • Sliding Time Window • Features • Scalability • Flexibility • Efficiency

  19. Messaging • Components not colocated • Ensure recoverability • Handle large volumes of data

  20. View • Eclipse RCP framework • External graphing package • Wireframes

  21. View | Eclipse RCP Framework • Integration with JPMorganChase • Modular design • Standardized system

  22. View | External Graphing Package

  23. Multiple Server View View | Wireframes

  24. Single Server View View | Wireframes

  25. Project Timeline Problem Formulation Solution Features Solution Architecture Major Systems Project Timeline Conclusion

  26. Project Timeline • Five Phases • Phase 1: Due February 1st • Phase 2: Due February 15th • Phase 3: Due March 1st • Phase 4: Due April 1st • Phase 5: Due May 1st • Front-Loaded • Early Integration

  27. Project Timeline • Phase I • Full Interface Skeleton • Stub Modules • Admin API (Control) • AddMessageAPI • Correlation (Default Rules) • View Path Latency • Phase II • Phase III • Phase IV • Phase V

  28. Project Timeline • Phase I • Phase II • Phase III • Phase IV • Phase V

  29. Project Timeline • Phase I • Admin Client (Control) • Correlation (Arbitrary) • Message Batching • Message Datastore • Association Datastore • Real-Time View • Phase II • Phase III • Phase IV • Phase V

  30. Project Timeline • Phase I • Phase II • Phase III • Phase IV • Phase V

  31. Project Timeline • Phase I • Engine Scheduling • Correlation Strength • Data Client Admin API • Graph Node Datastore • View Graph Latency • Phase II • Phase III • Phase IV • Phase V

  32. Project Timeline • Phase I • Phase II • Phase III • Phase IV • Phase V

  33. Project Timeline • Phase I • Zero & Many Correlation • Parsing Module • Single Message View • Phase II • Phase III • Phase IV • Phase V

  34. Project Timeline • Phase I • Phase II • Phase III • Phase IV • Phase V

  35. Project Timeline • Phase I • Re-Correlation • Recoverability Control • Path Datastore • Collapse Nodes (View) • Phase II • Phase III • Phase IV • Phase V

  36. Conclusion Problem Formulation Solution Features Solution Architecture Major Systems Project Timeline Conclusion

  37. Conclusion • What to Solve • How to Solve It • Architecture • Concepts • When to Solve It

  38. AtroposCut through the tangled web… Thank You For Listening!

More Related