Inference for the calls that repeat

You built the core.
We built the afterburner.

Most of what your product sends to frontier models is the same few jobs, thousands of times a day. Afterburner finds those calls in your code, trains a small model for each one, and proves the swap in a live A/B. You pay 10% of what you save, and nothing until it's proven.

The core · your frontier calls
The afterburner · small models
Cost per successful task
−93.4%
measured · case study A/B
Quality bar
Agreed margin
95% confidence
To start
One env var
fails open
If we miss
Frontier answers
automatic rollback

Measured on a bank's support inbox: 93% cheaper, within 3.4 points of the frontier. Then it held itself back until it could prove that. Read why that's the point →

The problem

Your bill is sorted by model. Your costs come from lines of code.

Provider dashboards show tokens per model. They can't tell you that one triage prompt is a quarter of the bill, or that it only ever answers one of five words.

Agent loops and hard reasoning should stay on the frontier. The repeated jobs around them, like classifying, extracting, routing and summarizing, are where a small trained model does the same work for a fraction of the cost.

TODAY · FRONTIER$0.0032 / callAFTERBURNER$0.0005 / call−85%■ OUR MODEL + CHECKS ■ FRONTIER FALLBACK · 10%

Same task, a sixth of the cost.

Both bars are to the same scale. Most of what's left is the 10% of calls that still go to the frontier.

Modeled · 800 tokens in, 50 out, $3 / $15 per million tokens

agent_step
agent/loop.py:203 · agent
frontier only$22.6K
classify_ticket
support/triage.py:19 · classify
migrate$18.4K
extract_invoice
billing/ingest.py:88 · extract
migrate$11.2K
summarize_thread
inbox/summary.py:41 · summarize
quick win$7.9K
route_lead
crm/router.py:12 · route
migrate$4.1K
$33.7K of $64.2K a month can move to small modelsIllustrative
How it works

Five stages. One loop.

call sitesadapterlive trafficretrainANALYZETRACEOPTIMIZEPROVE

Every miss becomes training data, so each model starts from the last one's mistakes.

01 · Analyze

Point your SDK's base URL at our proxy. It runs in your VPC, logs every call, fails open, and ranks your call sites by what they cost.

OPENAI_BASE_URL=https://proxy.internal/v1

The same proxy that logs each call later decides who answers it. If our side fails, calls go straight to the frontier.

YOUR VPCYOUR APPPROXYCALL LOGevery call, copiedFRONTIERSMALL MODELrouted

Watch all five stages run on a bank's support inbox →

Case study · measured, not modeled

We ran it on a bank's support inbox. Then we tried to break it.

2,084 real customer messages to a bank, routed by an LLM into 12 look-alike intents. Afterburner traced the routing call to line 21 of the bank's code, trained a 135M model on an 8-core M2 CPU, and put it in front of half the customers.

It cut cost per successful task by 93%, answered faster, and on messages it had never seen came within 3.4 points of the frontier, inside the agreed margin. But 962 messages weren't enough to prove that with 95% confidence, so the system held it back before any ramp. Nothing ships on a maybe. That is the product working.

Cost per successful task
−93.4%
p95 latency
692 vs 887 ms
Quality on unseen messages
−3.4 pts
Outcome
Rolled back
Read the case study

53-minute run in 80 seconds · recorded from the live dashboard

Proof

Nothing ramps without a signed proof report.

The proxy splits real traffic between your frontier model and ours, by user, so each person sees one arm. Success is your downstream outcome, such as a ticket that stayed in the queue it was routed to, not our own grade.

Before the test starts, you agree how much worse our arm may be and still count as no worse: two points in a typical pilot. Our arm's cost includes every attempt that fell back to the frontier. If the test can't show we're within the margin, nothing changes.

Proof report · support/triage.py:19
Non-inferiorSample · modeled
Cost per success
−85%
Quality diff
+0.3 pts
95% interval
−1.1 to +1.7
ArmTasksSuccessCost / successp95
Frontier1,32095.9%$0.00330812 ms
Afterburner1,30696.2%$0.00049240 ms
Owner sign-off ________________Required: 1,187 per arm
MARGIN −2NON-INFERIOR-4-20+2+4OURS − FRONTIER, TASK SUCCESS (PTS)

What a pass looks like.

The interval sits near zero, and the one-sided bound (▲) is right of the two-point margin. The owner signs, and traffic ramps.

Sample numbers · modeled

MARGIN −5NOT SHOWN-9-4.50+4.5+9OURS − FRONTIER, TASK SUCCESS (PTS)

What “not proven yet” looks like.

In the bank case study our model was 93% cheaper and 3.4 points behind on average, inside the five-point margin. With only 962 unseen messages the interval stayed too wide to rule out more, so nothing ramped until more traffic proves it.

Measured · bank's support inbox

Pricing

You pay 10% of what you save.

01 · Scan
Free

Read-only billing access and a repo scan. You get spend estimated per call site, and a saving estimate for each one.

02 · Prove
Free until you sign

A pilot on your biggest call site that can move: train, shadow, A/B. It ends with a proof report your team signs, or with nothing changed and nothing owed.

03 · Serve
10% of the saving

Each month: what the call site would cost today on your current model, minus what it costs now, net of every fallback to the frontier. You keep the other 90%.

No saving, no fee. The saving is measured against the frontier arm of the A/B, then against a 5% holdback that stays on your current model. Example: a call site that cost $10,000 a month now costs $1,500. You save $8,500 and pay $850.

Your weights. Each adapter is trained only on your traffic, serves only you, and can be exported if you leave.

Your data. The proxy runs in your VPC. Prompt bodies can stay in your own storage bucket.

SUCCESS · FRONTIER LINECOST / TASKwk 0wk 4wk 8wk 12A/BRAMPSHADOW

What the first quarter looks like.

Nothing changes during shadow. Cost drops at the A/B and again at the ramp, while the success rate stays at the frontier's line.

Illustrative trajectory

Why it lasts

Cheaper tokens don't make this obsolete.

Price falls at the bottom.

Tokens and GPUs get cheaper every year. Our fee is a share of your saving, so it shrinks with your costs, and you always keep 90%.

Value builds at the top.

Every correction your team makes becomes a labelled edge case. Those checks and fixes keep adding up, whatever the token price.

You keep what it learns.

The adapters, datasets and verdict history are yours, and leave with you.

MEMORYwhat your company learnedcompoundsWORKFLOWwhich model, which checkdecidesCOMPUTEtokens and GPUsdeflatesvalueprice›
Questions

What buyers ask us first.

Free spend scan

Find out which of your calls can burn cleaner.

Thirty days of billing data and a read-only scan of your repo are enough to estimate spend per call site and size the saving. It takes about a day and needs no code change.

  • ^Spend estimated per call site
  • ^Which calls can move, and which stay on the frontier
  • ^A saving estimate for each one
Monthly LLM API spend

We use your email only to send the scan. The scan reads billing data and your code, never your users' messages.