Notes from building production LLM systems

July 12, 2026 · 8 min read

I built an LLM that writes dashboards. Here's how I stopped trusting it.

A validated JSON contract, a two-attempt retry loop, a three-layer eval harness, and the deploy bug that took down every query in production for three hours.