Skip to content
Vol. I · No. 251
Mon · 8 Jun
A Daily Lexicon of Trustworthy Data
The Lexicon

006·33

ai gateway

/ˌeɪ ˈaɪ ˈɡeɪtweɪ/ - n.

1 [colloq.] A toll booth on the model traffic that three teams are already routing around.Keep. Punchy.This is the problem.

Working definition

2. A control point that routes, logs, and rate-limits requests to language models across an organization.

Filed
See also
  • guardrailsRules that enforce a policy, written for the policy the org has not yet enforced anywhere else.
  • shadow aiThe actual deployment, running one floor below the AI strategy describing it.
  • tool sprawlForty tools the agent may call, eleven that do the same thing, none that anyone will deprecate.