#ai-in-production
4 posts tagged “ai-in-production”.
-
Sixty lines, no framework: a loop with a step budget, an approval gate before anything irreversible, and its reasoning printed each turn. Then the ways it actually went wrong at step four, and which of them the budget and the gate caught.
-
Tests where the assertion is not equality but good enough. A twenty-case eval harness that fails the build on a real regression, why retrieval and generation have to be scored separately, and where a model judging a model quietly lies.
-
A real fine-tune on a small local model, with the same ten prompts before and after. Why it teaches a manner rather than facts, what the attempt to teach it a fact actually produced, and the local-versus-API decision on privacy and cost.
-
An ordinary service with one non-deterministic dependency. Streaming and perceived latency, the two cost levers that actually matter, retries and logging, a cost ceiling that trips, prompt injection against a service rather than an editor, and what you may legally send to an API.