A head-to-head comparison of Langfuse, Arize, Braintrust, LangSmith, Portkey, and Grepture, updated for the 2026 consolidation wave that took out Helicone and Humanloop.
Ben @ Grepture
Read moreWhat an AI gateway is, how the proxy architecture works, and the five capabilities that matter — routing, cost tracking, security, observability, prompts.
EngineeringA look inside Grepture's PII detection — deterministic validators, multilingual NER models, and why all of it runs in-process at the proxy.
EngineeringLLM-as-a-judge bias is real — order, length, and self-preference can flip verdicts. Here's how to measure judge reliability and build evals you can trust.
Engineering