v2.4 Prompt caching for Claude is now generally available

The control layer for how your company uses AI.

MonsterCloud routes and governs every model call, turns it into on-brand content, and connects the result to search performance — in one auditable platform.

Avg. model cost reduction
38%
Added gateway latency (p95)
12 ms
Uptime, trailing 90 days
99.98%
Data used for training
None
acme / production gateway.monstercloud.ai
TimeSourceModelPolicyTokensLatencyCost
11:42:08content-studioclaude-sonnetpass3,8121.9s$0.021
11:42:07support-botclaude-haikucache hit64038ms$0.000
11:42:05crm-syncclaude-sonnetpii redacted (2)1,2040.8s$0.007
11:42:04seo-engineclaude-haikupass2,2900.6s$0.003
11:42:01internal-agentclaude-opusblocked: budget—4ms$0.000

Used in production by teams at

NorthwindLumoraVectraKinetiqBlueHarborNovaPay

How teams roll it out

Most customers start with the Gateway in week one and connect Content and SEO once policies are in place.

  1. 1

    Point your SDK at the Gateway

    Change the base URL. Existing Anthropic and OpenAI-compatible code keeps working.

  2. 2

    Define policies and budgets

    PII redaction, allowed models, per-team spend limits and retention settings.

  3. 3

    Connect your site and Search Console

    SEO Engine maps topic gaps; Content Studio drafts against your knowledge base.

  4. 4

    Review, publish, measure

    Human approval before publishing, then cost-per-article and clicks in one report.

A one-line change for engineers.

No new SDK to learn. Policies are set per request via headers or centrally in the dashboard.

  • —Automatic retries and provider fallback
  • —Exact and semantic response caching
  • —Streaming, tool use and batch support
  • —Logs exportable to Datadog, S3 or your SIEM
Read the quickstart
app.py
from anthropic import Anthropic

client = Anthropic(
    base_url="https://gateway.monstercloud.ai/v1",
    api_key=os.environ["MONSTERCLOUD_KEY"],
    default_headers={
        "mc-policy": "pii-redact",
        "mc-fallback": "claude-haiku",
    },
)

client.messages.create(
    model="claude-sonnet",
    max_tokens=1024,
    messages=[{"role": "user", "content": prompt}],
)

Security reviewed, not just claimed.

We publish our controls, subprocessors and incident history. Your prompts and outputs are never used to train models — ours or anyone else’s.

Visit the trust center
SOC 2 Type II
Annual audit by an independent firm. Report available under NDA.
GDPR and KVKK
EU (Frankfurt) data residency and a standard DPA.
Encryption
AES-256 at rest, TLS 1.3 in transit, customer-managed keys on Enterprise.
Zero data retention
Optional mode where request bodies are never written to disk.
“We moved four AI vendors behind MonsterCloud and cut our model spend by 46% in the first month. More importantly, our security team finally signed off on using LLMs with customer data.”
Elif Kaya

Elif Kaya

CTO, Vectra

Read customer stories

Start with the Gateway. Free for 14 days.

No credit card. Bring your own model keys. See pricing.