What is an Event Stream?

Where is the Gold?

Most of the events that a system processes will be of limited value, for example a stock price that has not changed or goods in a warehouse that are in the right place at the right time. However within each real time stream of events there are pieces of information that are highly valuable, if they can be discovered. The growing problem we face is that these events are not processed in real time as the flow of events is both too wide and too fast. Current solutions simply store the events for later data mining so losing the valuable advantages of real time processing.

Imagine the difference between discovering after data mining that 10 Plasma TVs were moved from your warehouse without authorization, 3 days ago and discovering that 10 Plasma TVs are being moved without authorization, now. Imagine the difference between discovering after data mining that it was a faulty motor that caused the battery on your Moon Rover to drain and discovering that your Moon Rovers battery is being excessively drained, right now.

How does it work?