Token saving
Compress tool results before they reach the model, so agents use fewer tokens on each MCP call.
Configure it on the server
The Strategies card reads: "Rewrites tool results on the way back to the client to cut model token usage." New servers have every strategy off.
Strategies
Turn on the strategies that match what the server returns, then click Save settings in the footer. The Active strategies bar and the section list (for example 2 of 4 strategies on) show how many are on.
Token saving runs after guardrails, so detections are made on the full tool result. The four strategies are the same methods the LLM Gateway applies to requests; see LLM Gateway token saving for a before-and-after example of each.
Where savings show
OneMCP saves tokens too
OneMCP reduces the tokens agents use to discover tools. With dynamic tool calling on, an agent receives a small set of tools instead of every server's full tool list:
Set it with the OneMCP endpoint button in the MCP Gateway header, under Dynamic tool calling (User preference, Always on or Always off).
Going further with the Policy Engine
When the Policy Engine is on for the MCP Gateway, this section turns read-only and the Token Savings card (stage 4, Response) in Govern > Policy Engine > MCP Gateway applies instead. Edit anyway changes the stored values, which are used only if the Policy Engine is disabled (see What happens to classic settings). The card has one effect per strategy: smart JSON compression, HTML to text, Markdown to text and text compression.
Scenarios the card supports that server settings cannot:
- Compress by tool, not by server. Match tool name or tags, so only the tools that return large payloads are compressed.
- Compress for some callers or agents. Match smart groups or agent name, for example compress results only for an agent with a small context window.
- Compress on one route. Match route kind to treat OneMCP traffic differently from direct connections.
runs on responsepriority 400
The OneMCP side has its own card. OneMCP Features (stage 1, Session) sets OneMCP dynamic tools and memory per caller, for example turning dynamic tools off for one smart group.
Related
- Group and user rules - turn strategies on or off for a smart group or user.
- Security guardrails - scan tool results before they are shortened.
- OneMCP - one endpoint with dynamic tool calling.
- LLM Gateway token saving - the shared compression methods.
- Policy Engine overview - how cards, stages and priorities work.