Events define our world – designing a system that rapidly adapts and incorporates many diverse events into relevant, dynamic models produces rich, timely situational analysis. Additionally, events happen at a defined time allowing analysis to move backward and forward in time, even imaginary time with “what if” events.
Accumulo allows the assembly of extremely large event sets to form a high resolution, dynamic event fabric. Key Accumulo design constructs enable high velocity, disparate events to form complex models. They include establishing a high performance flexible event data model and vocabulary with efficient indexing and complex event contexts, dynamic event versioning, managing event race conditions, event security, incorporating event confidence, and correcting event errors. Processing involves high speed messaging and flexible rule tables. Complementing this is an elastic architecture that handles unpredictable event surges and timely analysis demands across multiple nodes.
Accumulo makes high event resolution possible; event-driven makes it immediately actionable. Our findings detail the ingestion and processing of billions of actual events that transform into dynamic decision models instantly available at big-data scale. Additionally, the changes over time of the events and decision models provide a rich strategic base for analytics. A working demonstration using Amazon EC2 VMs, Elastic MapReduce, and Accumulo stores summarizes the event-driven approach. VMs are available to all conference participants for future investigations.