006·320

label drift

/ˈleɪbəl drɪft/ - n.

1 [colloq.] Definition drift, now with a confidence interval.Keep. Punchy.This is the problem.

Working definition

2. Change over time in how a target category is defined or applied, degrading models trained on the older meaning.

Filed

See also

concept driftThe thing being measured moved; the dashboard, helpfully, stayed green.
data labelingThe step where the team discovers it never agreed on the categories.
ground truthOne analyst's spreadsheet, promoted to truth because no one else volunteered.
model driftThe model did not change. The world did, and no one was watching the gap.