005·75

data freshness sla

/ˈdeɪ.tə ˈfrɛʃ.nəs ˌɛs.ɛl.ˈeɪ/ - n.

1 [colloq.] A promise about how recent the data is, signed by no one and measured by whoever is annoyed first.Keep. Punchy.This is the problem.

Working definition

2. A committed bound on how stale data may be, stating the maximum acceptable lag between an event in the source and its availability downstream.

Promoted

See also

batch processingRunning it overnight, so the data is ready by morning and wrong by lunch.
freshness checkA test that confirms the data is old, then emails someone who has muted the channel.
late-arriving dataData that shows up after the meeting that needed it, with a perfectly good explanation no one waited to hear.
pipeline ownershipA field in the catalog set to the name of someone who left in March.