110 likes | 337 Views
Complex Event Processing. Kenny Inthirath. Event-Driven Applications. Event-Driven Applications High numbers of events Low latency Real-time Opposed to program-driven applications Fairly Linear Batch Jobs Taking in a stream of inputs Processing a conclusion.
E N D
Complex Event Processing Kenny Inthirath
Event-Driven Applications • Event-Driven Applications • High numbers of events • Low latency • Real-time • Opposed to program-driven applications • Fairly Linear • Batch Jobs • Taking in a stream of inputs • Processing a conclusion
Complex Events • Complex Event • Represents a set of other events • That could lead to an opportunity or threat • Complex Event Processing • Combining multiple data sources • Trying to determine meaningful patterns/workflow • Analyze in (near) real-time streaming • Goal of Complex Event Processing • Identifying opportunities or threats quickly • Responding to minimize or maximize outcomes
Complex event Processing techniques • Pattern detection • Abstraction • Filtering • Aggregation and transformation • Modeling hierarchies • Detecting relationships
Aggregation + detection processing • Aggregation • Continually collect data and process results • Example • Continuously process some average • Detection • Detecting combination of events • Looking for specific sequences • Most apps use a hybrid approach of both.
Roots • Discrete event simulation • Active databases • Research projects in the 90’s • Related Concepts • Operational Intelligence • Query analysis to provide live, processed data feeds • Inference Engines • Rule-based reasoning • Artificial Intelligence
Business awareness + technological • Business Process Management • Complex Event Processing exists at two levels • Business Awareness • Users understand pros/cons of individual processes • Technological • Technical analysis • Results fed to business • Helps business make appropriate choices • Online Advertising Example • Determine the stream of clicks/interactions of ads • Relay information to business • Decide which ads works
Commercial products • For application development • Microsoft StreamInsight • High-throughput • Oracle Complex Event Processing • Filter, correlate, process • ESPER • Filter, analyze in real-time • TibcoStreamBase • Identify opportunities and remediate threats