What changed
On August 3, 2026 Google Cloud added managed model routing to API Gateway (Public Preview). It accepts OpenAI-compatible chat requests, transcodes them in-flight, and dispatches them to Gemini, Anthropic Claude, or OpenAI models hosted in Vertex AI Model Garden. Google positions it as a managed replacement for self-hosted proxies like LiteLLM — no proxy server to host, scale, or maintain.
How the savings work
Routing is driven by the model name in each request payload. You define a router with a default model plus rules mapping client model strings to cheaper backends — unmatched traffic falls back to the default. Example: send all traffic to Flash, set the default to Flash-Lite, and route only complex/agentic requests to Flash. Google's own examples use google/gemini-3.5-flash-lite, google/gemini-2.5-pro, anthropic/claude-opus-4-7, and openai/gpt-oss-120b-maas.
Illustrative scenarios (directional)
Using Google's published list prices: a content agency sending 50M input + 10M output tokens/mo to Flash at $165/mo could route 80% to Flash-Lite and drop to ~$65/mo — ≈ $100/mo (~61%) saved. A multi-tier client setup on 2.5 Pro at $212.50/mo with 70% budget-tier traffic could drop to ~$100.85/mo — ≈ $111.65/mo (~53%) saved. A 5% fallback-traffic leak onto Flash-Lite instead of Flash saves ~$16/mo on that slice alone. Token volumes and split percentages are assumptions; substitute your own usage.
Caveats before you build on it
- Public Preview: text-only, name-based routing to MaaS models in Model Garden; request-side streaming, gRPC, WebSockets, Gemini Live, VPC-SC, and Private Service Connect unsupported.
- One-way mode: you cannot retrofit routing onto an existing gateway or remove it — switching requires a new API config + gateway.
- Single-host constraint: all models in one router must share the same hostname (global or one regional endpoint).
- Pricing gap: no model-routing-specific fee was found in the reviewed sources; confirm your exact model versions and region before quoting a client.
- No per-request observability yet: routing decisions aren't attributed per request in logs during preview.
Sources
Changelog
2026-09-14: Claude Code weekly-limit FAQ rebased on the permanent 125 index (kanban t_e03f5d47) — the temporary +50% weekly boost ended Sept 13, 2026 at 11:59 PM PT and the permanent +25% over the pre-promotion baseline took effect Sept 14, 2026. The FAQ answer that presented the promotion as still running now reports that it ended on Sept 13, 2026 at 11:59 PM PT (visible item + its FAQPage entry, question rephrased), and the assumptions footer no longer presents an Aug 31 end date as current. Canonical index 100 150 125; 125/150 = 83.3%; 150/125 = 1.2 (+20% headroom). 2026-09-01: Updated the Claude Fable 5 model strategy Claude Fable 5.1 (Anthropic GA Sept 1, 2026; API id claude-fable-5-1): same $10/$50 per 1M list but cache reads cut 75% to $0.25/1M, 1M-token context, 128K max output. Added Claude Mythos 5.1 context: same underlying model, cyber/bio-tuned safeguards, trusted access only (CVP/LSVP) — not GA. Cache-gap FAQ updated: the 276x headline compared Fable 5's $1.00 to DeepSeek launch pricing; current gap vs Fable 5.1 is ~11x off-peak / ~6x peak. FAQ item + FAQPage schema entry, meta description/keywords, changelog entry. Source: Anthropic — Claude Fable 5.1 and Mythos 5.1 (Sept 1, 2026) + platform pricing docs (verified Sept 1, 2026).
2026-08-25: Added a Meta Hatch consumer AI agent comparison row — new Consumer AI Agent Pricing section with an 8-field comparison table (provider, product, price, billing, availability, model, category, source). Meta Hatch: $199.99/mo premium tier — REPORTED, pending confirmation (The Information Jun 4 + Aug 24, 2026, via PYMNTS/RuntimeWire; final pricing NOT set; not shipped as of Aug 25, 2026), monthly billing, launching in coming weeks (late Aug–early Sep 2026 target), Watermelon model targeted for October 2026, consumer AI agent category — compared against ChatGPT Plus ($20/mo), ChatGPT Pro ($100–$200/mo) and Claude Max (up to $200/mo). Price-update mechanism documented in an HTML comment + site CHANGELOG; analytics task t_ecfe7f64 monitors sources for official pricing. FAQ item + FAQPage schema entry, meta description/keywords, assumptions footer note, changelog entry. Full explainer: Meta Hatch AI Agent Price: What Consumer AI Agents Cost (verified via parent research t_b6570320).
2026-08-25: Added the ChatGPT Business Seat Cost Estimator — a new section modeling Standard vs Premium seats with OpenAI's verified list prices (Premium $125/user/mo monthly / $100 annual (20% discount); Standard $25/$20), billing cadence (monthly vs annual), seat count (2-seat min / 200-seat cap), and the usage-multiplier assumptions (Premium = 5x more usage than Standard, no five-hour limit, weekly resets). Example: 10 Premium seats billed annually = $1,000/month ($12,000/yr); billed monthly = $1,250/month. Premium seats are now a calculator input — the Aug 10/12 "budget separately" note is superseded. Verified via parent research brief t_642ada39 (7 sources, 34 evidence quotes; announced August 2026, official launch Aug 25, 2026). FAQ item + FAQPage schema entry, meta tags, assumptions footer, changelog entry. New explainer: ChatGPT Business Premium Seats Pricing (2026).
2026-08-23: Added a Codex 20M users / banked reset note + FAQ entry: Codex and ChatGPT Work crossed 20 million active users the week of Aug 21, 2026 (up from 15M a week earlier), and OpenAI credited every paid user a banked reset (saved usage-limit credit that resets both 5-hour and weekly windows when redeemed). The reset rollout missed its Aug 21 deadline; OpenAI set a firmer 8pm PST same-evening deadline that also passed for many users, then announced a new reset for 2026-08-24T21:00:00Z (2pm PST) after finding usage inefficiencies. No calculator-logic change and no price change — plan list prices stand (Plus $20, Pro 5x $100, Pro 20x $200, Business per seat, API usage-based); the milestone is a capacity/billing-clarity story, not a price input. FAQ item + FAQPage schema entry, meta description/keywords, changelog entry. New explainer: Codex Pricing 2026: Plans, Limits & Banked Reset for Agencies (companion: Codex Just Hit 20 Million Users — Find AI Agency; verified via research brief t_72fe5cf1).
2026-08-22: Added a ChatGPT Ads (EU) pricing preset — new Service Type option " ChatGPT Ads Management (EU)" with labeled inputs (monthly ad spend, management fee %) shown when selected, plus a sourced assumptions box. OpenAI expands ChatGPT Ads to 31 European markets Aug 24, 2026 (40 total); ads run on Free + Go tiers only (Go ≈ €8/mo); buying is agency-led first (OpenAI Ads Solutions + agency/tech partners; self-serve Ads Manager later this summer). Pricing model: setup $1,500–$5,000 + management fee 15–25% of ad spend, floored at $2,000/mo and capped at $7,500/mo (ad spend is pass-through — client pays OpenAI; the fee is the agency's revenue). Margin 62% base. FAQ item + FAQPage schema entry, meta description/keywords, Pricing Reference Table row, assumptions footer (date Aug 22), changelog entry. Sources: OpenAI (Aug 18, 2026) · Search Engine Land · Dataconomy · Euronews (verified via research brief t_ff98639f).
2026-08-21: New explainer AI Client Communication Workflow: What It Costs to Automate Client Texts — OpenAI's Apple Messages plugin (Aug 20, 2026) lets ChatGPT read, search, summarize, draft, and send iMessage/SMS/RCS on Apple silicon Macs in ChatGPT Work/Codex. The plugin itself is plan-inclusive; the real cost line items are hardware (Apple silicon per seat), Work/Codex seats priced into retainer math, and compliance review (OpenAI has not documented exactly which message content leaves the machine or published managed-Mac admin guidance). No calculator-logic change — this is a client-communication workflow cost lens, not a token-price input. Sources: OpenAI release notes (Aug 20, 2026) + OpenAI Codex plugin docs + 9to5Mac/Engadget/MacRumors/TechCrunch/TNW/Unite.AI/Yahoo (verified via research brief t_c7d9dc7e).
2026-08-20: Added a Claude Code 50% weekly usage-limit boost note + FAQ entry: Anthropic extended the promo through August 31, 2026 (11:59 PM PT) — the third extension since the May 13, 2026 launch — and for the first time said it hopes to make the boost permanent while warning capacity may be tight (announced Aug 18, 2026 via @ClaudeDevs; widely reported Aug 19). Boost applies automatically to Pro, Max (5x/20x), Team, and legacy seat-based Enterprise; excludes Free and consumption-based Enterprise seats; Claude Code only (CLI, IDE, desktop, web) — 5-hour session limits, Claude chat, Claude Cowork unchanged; weekly limits "return to their standard levels" after Aug 31. No calculator-logic change — the boost is a seat-plan weekly-quota layer, and this calculator models API/token and project pricing, not seat-based subscriptions. (Superseded 2026-09-14 — see the 2026-09-14 entry above: the promotion ran May 13 through Sept 13, 2026 and the permanent +25%-over-baseline level took effect Sept 14, 2026.) FAQ item + FAQPage schema entry, changelog entry. Example math: Max 5x at $100/mo delivers 1.5× weekly quota through Aug 31 ≈ $150/mo equivalent at standard limits. Sources: Anthropic Help Center — Claude Code May–August 2026 weekly limits promotion · @ClaudeDevs (Aug 18, 2026) (verified via research brief t_4e969eaa).
2026-08-20: Added the OpenAI safety-monitoring overhead stress-test toggle — a visible checkbox in the Model Strategy section (OFF by default) that applies a +20% multiplier to OpenAI-based strategies (GPT-5.6 Sol, Paid frontier). Basis (verified via research brief t_b34197c5): OpenAI's official post (Aug 18, 2026) estimates its expanded chain-of-thought safety monitoring adds roughly 20% overhead to the inference compute it monitors — required for all RL training/eval involving tools for models of Sol capability or higher, plus all Astra inference with tools after the Aug 7 Critical-cyber determination; OpenAI is NOT currently billing customers for this overhead (spokesperson via The Register, Aug 19, 2026; corroborated TNW — not stated in the official post), and Anthropic says its safeguards make a similar slowdown unnecessary (Axios, Aug 19, 2026). The toggle is a what-if cost stress, not a price change: no default outputs change (OFF by default); the output note explains when it applies vs. not; FAQ item + FAQPage schema entry, meta description/keywords, assumptions footer (date Aug 20), changelog entry. Sources: OpenAI (Aug 18, 2026) · The Register (Aug 19, 2026) · TNW (Aug 19, 2026) · Axios (Aug 19, 2026).
2026-08-19: Added an AI supplier risk note + FAQ entry: on Aug 18, 2026 OpenAI announced a two-week pause in RL training on its latest deployment-bound models and held its largest planned frontier RL run on hold after internal evaluations flagged its upcoming Astra model at the "Critical" cyber-capability threshold under its Preparedness Framework (core training continued; no model cancelled; no API price changes — calculator math unchanged). Guidance: include fallback AI models and review provider tooling roadmaps when evaluating AI costs/risks. FAQ item + FAQPage schema entry, assumptions footer, changelog entry. Source: OpenAI (Aug 18, 2026) (verified via research brief t_bb45d771). Updated Aug 19 (eve): supplier-risk FAQ now also notes OpenAI's committed 2027 public listing (CFO Sarah Friar, CNBC Aug 19) de-risks vendor longevity on a known timeline; new explainer OpenAI's 2027 IPO Window: Re-Baseline Your Cost Assumptions. Updated Aug 20: Anthropic now expects to match or top SpaceX's record IPO (~$75B outset / $86.2B w/ overallotment) and could file by end of August at a valuation just under $1T (Bloomberg Aug 20) — the pre-IPO window is the Claude pricing-risk zone; new explainer Anthropic's Record IPO: Stress-Test Your Claude Cost Assumptions.
2026-08-16: Added the DeepSeek V4 Pro vs Claude Fable 5 cache-read comparison — DeepSeek's official peak/off-peak pricing landed 16:00 UTC Aug 16 (off-peak V4 Pro: $0.022 cache read / $0.66 miss / $1.98 output per 1M; peak: $0.044/$1.32/$3.96), superseding the pre-hike schedule. Fable 5 (Anthropic): $10/$50 per 1M with $1.00 cache reads. The ~276x cache-read gap from @JulianGoldieSEO was correct on DeepSeek launch pricing ($1.00/$0.003625) but is stale after the increase — current gap ~45x off-peak / ~23x peak; the 92% cache hit rate is an assumption, not a published OpenRouter statistic. Full interactive scenario on the main calculator page (verified via research brief t_40deadfe).
2026-08-06: Added Qwen 3.8 Max to the open-weight model strategy (GA Aug 2–3, 2026; 2.4T-param MoE, ~95B active; $2/$6 per 1M tokens; 1M context; open weights promised ~Aug 10). Real-world usage section added with the Aug 6, 2026 45-project field report — self-reported, no artifacts; the "destroyed Fable 5" claim was walked back by the tester (Qwen strong on fast/multimodal builds; Fable 5 on huge long-running projects). Transparent cost-variability note added: API list prices are public, but self-hosted cost is hardware/quantization-dependent and not yet knowable until weights drop.
2026-08-06: Added GPT-5.6 Sol as a selectable model strategy (frontier, Instant + deep reasoning) with a clearly marked estimate and link to OpenAI's pricing page — OpenAI announced Sol now powers both Instant and deep reasoning for Plus/Pro, and GPT-5.6 Luna becomes the default for Free/Go users (unlimited text chats rolling out this week/next week). No official per-token API pricing published for either model; assumptions date/source now included in calculator output.
2026-08-05: Added Gemini API cost & model routing savings estimator and explainer (Google Cloud managed model routing, Public Preview Aug 3, 2026). Pricing sourced from Google's published Vertex AI / API Gateway list prices; scenario figures are illustrative (directional).