Skip to content

A Daily Lexicon of Trustworthy Data

005·75

pipeline monitoring

/ˈpaɪp.laɪn ˈmɒn.ɪ.tər.ɪŋ/ - n.

1 [colloq.] A wall of green panels confirming the job ran, and silent on whether it was right.Keep. Punchy.This is the problem.

Working definition

2. The instrumentation that tracks pipeline runs, durations, failures, and data volumes, surfacing problems before consumers report them.

Filed

See also

alert fatigueA channel so loud it has achieved the silence it was built to prevent.
freshness checkA test that confirms the data is old, then emails someone who has muted the channel.
on-call rotationThe one place the org reliably assigns pipeline ownership: at 3 a.m., to whoever is holding the pager.