Benchmark: LLM Gateway ~35% faster TTFT than OpenRouter on Claude Haiku 4.5

Short summary

A detailed benchmark comparing TTFT (time to first token) between LLM Gateway and OpenRouter using Claude Haiku 4.5 across 75 cold and 75 warm interleaved runs. LLM Gateway was ~35% faster in both cold (906ms vs 1392ms) and warm (814ms vs 1232ms) conditions with zero errors across 450 requests. The authors transparently note architectural differences, including that LLM Gateway streams headers early and each gateway used different upstream providers by default.

• •LLM Gateway achieved ~35% faster TTFT than OpenRouter across 150 interleaved benchmark runs
• •Zero errors across 450 HTTP requests on both gateways using Claude Haiku 4.5
• •Authors disclose caveats: different upstreams, LLM Gateway streams headers early inflating TTFB advantage

Generated with AI, which can make mistakes.