Pattern

AI gateway (LLM proxy)

Put one service in front of every model provider so that provider abstraction, fallback, rate limits, per-key budgets, caching and cost tracking are configured once, outside agent code, instead of being rebuilt in each agent.

Classification A proxy between agents and model providers that centralizes routing, fallback, spend limits, caching and logging.