2 posts
Posts tagged spec-driven
-
I measured whether a spec file makes the model more accurate. It doesn't.
In July I argued that structured spec changes the outcome. I measured in October: 360 generations, 3 local models, 3 ways of asking for the same thing. What pays off is the written information, not the file format.
-
The PRD comes first: the spec that prevents the agent from writing incorrect code
The model doesn't make mistakes due to ignorance: it makes mistakes because it filled the gap the prompt left, and filled it in a plausible way. What changes in the code when the contract comes before the request.