006·323

model monitoring

/ˈmɒdəl ˈmɒnɪtərɪŋ/ - n.

1 [colloq.] A panel that shows the model is healthy by reporting every signal except whether it is still right.Keep. Punchy.This is the problem.

Working definition

2. Ongoing measurement of a deployed model's inputs, outputs, and accuracy against expected behavior.

Evidence

See also

concept driftThe thing being measured moved; the dashboard, helpfully, stayed green.
inferenceThe part priced per call, unlike the definitions it relies on, which are free and missing.
model driftThe model did not change. The world did, and no one was watching the gap.
model evaluationThe benchmark the model passes, chosen after seeing which benchmark it passes.