Curtly
Generation Token Governor

Output generation efficiency and brevity governor

Eliminate conversational preamble, apologies, and formatting fluff from LLM responses to slash expensive generation token invoices.

Output Token Savings
30% - 50%

Eliminates conversational fluff across all responses.

Invoice Impact
Up to 5x ROI

Targeted directly at the most expensive tier of LLM rate cards.

Response Latency
Faster TTFT

Fewer generation tokens directly accelerate end-user streaming.

The production engineering challenge

Frontier model output tokens cost 300% to 500% more per million than input tokens. LLMs by default produce conversational padding ("Sure, I would be happy to help with that!"), repeated questions, and verbose sign-offs that bloat bills without adding technical value.

Technical architecture & mechanics

1

Zero-overhead directive injection

Injects concise behavioral constraints into prompt framing during proxy dispatch, commanding the LLM to deliver direct, unpadded answers.

2

Multi-tier efficiency controls

Offers selectable brevity levels (Lite -20%, Balanced -35%, Ultra -50%) tailored to conversational assistants, coding agents, or automated pipelines.

3

Format integrity preservation

Guarantees that requested structured formats (JSON, YAML, Markdown tables) maintain clean syntax without truncation.

Python OpenAI Client with Efficiency Header

from openai import OpenAI client = OpenAI( api_key="your-openai-key", base_url="https://proxy.curtly.dev/v1", default_headers={ "x-curtly-key": "your-curtly-key", "x-curtly-efficiency": "ultra" # lite | balanced | ultra } ) response = client.chat.completions.create( model="gpt-6-astra", messages=[{"role": "user", "content": "Explain binary search implementation."}] )

Architecture comparison

Evaluation metricCurtly.dev gatewayTraditional / naive approach
Fluff EliminationAutomated injection calibrated per model familyManual system prompt tweaking per project
Output Rate Multiplier DefenseActive defense on 3x-6x generation pricingUnchecked spending on redundant output tokens
Response SpeedFaster completion due to fewer tokens generatedSlow token streaming due to unnecessary pleasantries

Frequently asked questions

No. The directives explicitly command the model to provide complete, working code implementations while stripping only the conversational commentary surrounding the code.

Ready to optimize your AI infrastructure?

Start optimizing in 60 seconds with a 1-line baseURL change. Free tier available with zero credit card required.