100 likes | 289 Views
EDA Symposium 14-16 March 2006 Draft IBM Research Gartner Stanford University. Event Processing in Complex Real-Time Applications Break Out Group. Panellist. Noah Ed Loy - Brigadier General (Ret) USAF (MITRE) Josh Collens - MITRE Corp Roger Loeb - MarTech Group Elan Oren - LeanWay
E N D
EDA Symposium 14-16 March 2006 Draft IBM Research Gartner Stanford University Event Processing in Complex Real-Time Applications Break Out Group
Panellist Noah Ed Loy - Brigadier General (Ret) USAF (MITRE) Josh Collens - MITRE Corp Roger Loeb - MarTech Group Elan Oren - LeanWay Ronen Perlmuter - LeanWay
Application's Types • DoD Command and Control • Telecom • Finance
What is Real-time? • Is a property: • Guaranteed deterministic completion of an operation • Is not necessarily: • Fast (low latency) • But often appears in conjunction with latency requirements. • The key is recognizing that the deadline is guaranteed. • And if not achieved, requires some other action be taken, some exception be raised
Value of Using RT Event Processing • In specific Domain Spaces i.e. DoD can not meet 2010 Mission Requirements without RT CEP • Address the latency Gap • Become more proactive to predict future events • Modelling based on historical data and current understanding of event cloud to predict near term outcomes with updating for continuous learning • Real-time is relative term depending on required predicted outcome • Extract to higher levels of abstraction for inference
Problem Space • Inability to manage Latency and Determinism • Lack of tools • Large Data ingest • High message traffic • Large Legacy Domain • Lack of temporal interlock • Complexity or perception • Ability to abstract • Domains for determinism is a relative term • Reactive versus proactive • Take RT Event and compare against massive amount of history • Simple patterns • Making incremental change based on incremental pieces of data • Must think of the problem at different levels of the stack (Vertical versus Horizontal)
Examining the Layers Human Model Optimization Events Persistent Queries • Simple Patterns • SQL • XPath • Filters Real-time data Peta-Bytes (History)
Market Drivers, Motivators, Challenges and Entry Points • Drivers • Predictability • Adaptability • Dynamic • Latency and Determinism management • Motivators • Tactical as well as strategic information advantage • Get inside competitive decision loop • Challenges • Legacy Integration • Cost • Complexity • Entry Points • Start small
Market Segment : Real-Time Event Processing • Federal (DoD, DHS, Intelligence) • Financial • Industrial Automation • Gaming • Health Care
Where do we go from Here ? • Better understanding of respective Domain space requirements and constraints • Standards • Tools • Modelling • Development • Trace and Monitoring