Logistics — 8,000 AI-drafted replies a month

"Your package is in transit" costs the same tokens as a full dispute investigation. That's the problem.

A freight and last-mile logistics company drafts customer replies with AI: shipment status, delay explanations, and damage disputes. Every reply — including the one-line status update that makes up 60% of volume — loads the full shipment history, carrier terms, and dispute precedents into the model. The monthly AI bill is roughly four times what the workload justifies.

The situation

How the spend got here

The reply workflow was built in a sprint: one prompt template, one premium model, one retrieval call that fetches everything about the shipment — full tracking event history, the carrier contract excerpt, prior tickets from the same customer, and the dispute-precedent library. It produced good replies, so nobody touched it. Volume tripled; the template didn't change.

Now a "where is my order?" query — answerable from the latest tracking event and the ETA — consumes 30,000+ input tokens on the most expensive model available. So does an actual damage dispute, which genuinely needs that context. The invoice can't tell the difference, and neither can the team, because nothing logs cost per query type.

The obvious fix — "use a cheaper model" — is exactly what the ops lead is afraid of: dispute replies carry liability language that cheaper drafting has botched before. The company needs to know which replies need the expensive path, not a blanket downgrade.

The work

What Taz does with this workflow

Taz works from exported usage logs, the prompt templates, and a sample of real replies across every query type. No access to live customer accounts is needed.

  • Token-spend map: Every reply type — status, ETA change, delay apology, delivery exception, damage dispute, billing dispute — gets a measured profile: volume share, average input/output tokens, model used, and cost per reply. The map shows exactly where the waste concentrates.
  • Context audit: For each reply type, Taz traces what the retrieval call fetches versus what the reply actually uses. Status replies using 2% of fetched context get a minimal context template; disputes that genuinely draw on precedent keep the full pipeline.
  • Routing policy: A written decision table: which query types route to a small model with a tight template, which need the premium model, and which trigger human review regardless of model. Includes the escalation rule for when a "simple" status query mentions damage or a refund.
  • Prompt rewrites: The one-size-fits-all template becomes per-type templates with the boilerplate stripped, liability language locked as fixed text rather than regenerated each time, and context slots that only load what the type needs.
  • Governance pack: Approval gates for high-cost or externally-risky actions, a monthly spend-review checklist, and a lightweight tracker spec so cost per reply type stays visible after Taz leaves.

The deliverable

What the company receives

  • Cost leak map — one spreadsheet: reply types by volume, current cost, projected cost under the new routing, and the assumptions behind each projection.
  • Model-routing decision table — the per-type policy with escalation triggers, written so an engineer can implement it and an ops lead can audit it.
  • Rewritten prompt templates — per reply type, with fixed liability language, minimal context slots, and inline notes on what was removed and why.
  • Context-diet spec — what the retrieval layer should fetch per query type, replacing the fetch-everything call.
  • Governance and tracking pack — approval gates, the monthly review checklist, and a tracker template that makes next quarter's invoice explainable line by line.

What changes after

Spend follows need, not habit

High-volume simple replies run on a small model with a minimal template; the premium path is reserved for the disputes that need it. The liability language stops being regenerated — it's fixed text a lawyer approved once.

The team can see cost per reply type monthly, so the next volume spike shows up as a routing question, not an invoice surprise.

What to measure

Evidence after a real baseline

  • Cost per reply, by reply type, before and after routing
  • Share of replies on the premium model path
  • Reply quality on the downgraded types (spot-check rubric)
  • Escalation accuracy: risky queries correctly caught by triggers

Boundary

What stays human-owned

Taz does not guarantee a specific savings figure — projections are stated with their assumptions. Implementation inside the company's systems is done by their engineers or scoped separately. Liability language is approved by the company's counsel; dispute settlements and refunds remain human decisions with human sends.