Complex Event Processing (CEP) is a defined set of tools and techniques for analyzing and controlling the complex series of interrelated events that drive modern distributed information systems. This emerging technology helps IS and IT professionals understand what is happening within the system, quickly identify and solve problems, and more effectively utilize events for enhanced operation, performance, and security. CEP can be applied to a broad spectrum of information system challenges, including business process automation, schedule and control processes, network monitoring and performance prediction, and intrusion detection.
The Power of Events introduces CEP and shows specifically how this innovative technology can be utilized to enhance the quality of large-scale, distributed enterprise systems. The book describes the challenges faced by today's information systems, explains fundamental CEP concepts, and highlights CEP's role within a complex and evolving contemporary context. After thoroughly introducing the concept, the book moves on to a more detailed, technical explanation of CEP, featuring the Rapide™ event pattern language, reactive event pattern rules, event pattern constraints, and event processing agents. It offers practical advice on building CEP-based solutions that solve real world IS/IT problems.
Readers will learn about such essential topics as:
Several comprehensive case studies illustrate the benefits of CEP, as well as key strategies for applying the technology. Examples include the real-time monitoring of events flowing between the business processes of collaborating enterprises, and a hierarchically organized set of event-driven views of a financial trading system. One of the case studies shows how to apply CEP to network viewing and intrusion detection.
The book concludes with a look at building an infrastructure for CEP, showing how the technology can provide a significant competitive advantage amidst the myriad of event-driven, Internet-based applications now coming onto the market.
I. A SIMPLE INTRODUCTION TO COMPLEX EVENT PROCESSING.1. The Global Information Society and the Need for New Technology.
Distributed Information Systems Everywhere.
The Global Communication Spaghetti Pot.
Electronic Archeology: Layers upon Layers.
A Layered Enterprise System.
Vertical Causality: Tracking Events up and down the Layers.
Event Aggregation: Making High-Level Sense out of Low-Level Events.
The Gathering Storm of New Activities on the Web.
Global Electronic Trade.
Cyber Warfare and the Open Electronic Society.
Summary: Staying ahead of Chaos.2. Managing the Electronic Enterprise in the Global Event Cloud.
How the Global Event Cloud Forms.
The Open Enterprise.
The Global Event Cloud.
The Electronic Enterprise.
Operating in the Global Event Cloud.
Going Beyond Workflow.
Parallel and Asynchronous Processes.
On-the-Fly Process Evolution.
Exceptions Must Be First-Class Citizens in Process Design.
Summary: Managing the Electronic Enterprise.3. Viewing the Electronic Enterprise-Keeping the Human in Control.
Today's Event Monitoring Is Too Primitive.
System Monitoring Focuses on the Network Layer.
Network-Level Monitoring Doesn't Even Solve Network Problems.
An Example of Causal Tracking.
Examples of Information Gaps.
Viewing Enterprise Systems.
Creating and Coordinating Multiple Views.
An Example of Hierarchical Viewing.
Summary: Viewing the Electronic Enterprise.4. Designing the Electronic Enterprise.
Roles of Architecture in the Process Lifecycle.
Constituents of Process Architectures.
Interface Communication Architectures.
Examples of Informal Annotations.
Dynamic Process Architectures.
Diagrams for Dynamic Architectures?
Layered Architectures and Plug-and-Play.
Summary: Technology to Support Process Architecture.5. Events, Timing, and Causality.
What Events Are.
How Events Are Created.
Time, Causality, and Aggregation.
The Cause-Time Axiom.
Genetic Parameters in Events.
Causality and Posets.
Causal Event Executions-Real-Time Posets.
Observation and Uncertainty.
Summary.6. Event Patterns, Rules, and Constraints.
Common Kinds of Pattern Searching.
A Strawman Pattern Language.
Writing Patterns in STRAW-EPL.
Event Pattern Rules.
Summary.7. Complex Events and Event Hierarchies.
Aggregation and Complex Events.
Creating Complex Events.
Event Abstraction Hierarchies.
Viewing a Fabrication Line.
Building Personalized Concept Abstraction Hierarchies.
Viewing Network Activity.
Viewing Stock-Trading Activity.
II. BUILDING SOLUTIONS WITH CEP.8. The RAPIDE Pattern Language.
Event Pattern Languages-Basic Requirements.
Features of Rapide.
Subtyping of Executions.
Attributes of Events.
Basic Event Patterns.
Placeholders and Pattern Matching.
Matching Basic Event Patterns.
Notation to Aid in Writing Patterns.
Relational Operators and Complex Patterns.
Content-Based Pattern Matching.
Context-Based Pattern Matching.
Summary.9. CEP Rules and Agents.
Event Pattern Rules.
Definition of Event Pattern Rules.
Context and Visibility Laws.
Semantics of Event Pattern Rules.
Examples of Rules.
Event Processing Agents.
Definition of EPAs.
Semantics of EPAs.
Event Pattern Filters.
Definition of Filters.
Semantics of Filters.
Action Name Filters.
Event Pattern Maps.
Definition of Maps.
Semantics of Maps.
Event Pattern Constraints.
Definition of Constraints.
Semantics of Constraints.
Examples of Constraints.
Other Classes of EPAs.
Summary.10. Event Processing Networks.
Common Structures of EPNs.
Flexibility of Event Processing Networks.
Connecting Event Processing Agents.
Multiple Basic Connections.
Dynamic Event Processing Networks.
Creation and Termination Rules.
Architectures and Event Processing Networks.
Semantics of Architecture Classes.
Examples of EPNs and Architectures.
Case Study: EPNs for Network Viewing.
Visual Tools for Constructing EPNs.
Summary.11. Causal Models and Causal Maps.
Causality between Events, Revisited.
Why We Need Causal Models.
What Causal Models Are.
Defining a Causal Model and a Causal Map.
Using Pattern Pairs to Specify Causal Models.
Using Causal Rules.
A Small Example of a Causal Map.
A Second Example of a Causal Map.
Developing Accurate Causal Models.
Summary.12. Case Study: Viewing Collaboration between Business Processes.
A Collaborative Business Agreement.
An Interface Communication Architecture.
Examples of Causal Rules.
Examples of Constraints.
Analysis of Examples of Posets.
Constraint Checking Becomes Part of the Collaboration.13. Implementing Event Abstraction Hierarchies.
The Accessible Information Gap.
Event Abstraction Hierarchies, Revisited.
Abstraction Effect on Constraints.
Bridging the Information Gaps.
Steps to Apply a Hierarchy to a Target System.
A Hierarchy for a Fabrication Process.
Diagnostics.14. Case Study: Viewing a Financial Trading System.
A Small Stock-Trading System.
The Information Gap for STS.
An Event Abstraction Hierarchy for STS.
Building the Event Abstraction Hierarchy.
Implementing Hierarchical Viewing for STS.
Three Steps toward Human Control.
Detecting Constraint Violations.
The Abstraction Effect.
Summary.15. Infrastructure for Complex Event Processing.
Examples of Forms of Observed Events.
Interfacing CEP Infrastructure to Target Systems.
CEP Runtime Infrastructure.
Infrastructure Interfaces and Components.
Functionality of the Interface.
Event Pattern Languages.
Complex Event Pattern Matchers.
Quest for Scalability.
The Naive View of Pattern Matchers.
What Pattern Matchers Really Do.