005·75

stream processing

/striːm ˈprəʊ.sɛs.ɪŋ/ - n.

1 [colloq.] Real-time delivery of a number no downstream meeting is scheduled to act on for another quarter.Keep. Punchy.This is the problem.

Working definition

2. Processing data continuously as unbounded events arrive, optimizing for low latency over batch throughput.

Filed

See also

batch processingRunning it overnight, so the data is ready by morning and wrong by lunch.
data freshness slaA promise about how recent the data is, signed by no one and measured by whoever is annoyed first.
dead-letter queueWhere the records that could not be processed go to be inspected, in the same sense that a junk drawer is a filing system.
late-arriving dataData that shows up after the meeting that needed it, with a perfectly good explanation no one waited to hear.