Skip to content
Vol. I · No. 251
Mon · 8 Jun
A Daily Lexicon of Trustworthy Data
The Lexicon

005·75

batch processing

/bætʃ ˈprəʊ.sɛs.ɪŋ/ - n.

1 [colloq.] Running it overnight, so the data is ready by morning and wrong by lunch.Keep. Punchy.This is the problem.

Working definition

2. Processing data in bounded, scheduled groups rather than continuously, typically optimizing throughput over latency.

Filed
See also
  • backfillRe-running history to match the present, and discovering history had a different opinion about what 'customer' meant.
  • data freshness slaA promise about how recent the data is, signed by no one and measured by whoever is annoyed first.
  • schedulerThe component that decides when work happens, currently outvoted by a cron entry no one will admit to writing.
  • stream processingReal-time delivery of a number no downstream meeting is scheduled to act on for another quarter.