Showcify Team·Engineering Patterns
The eval was grading a prompt we had deleted
Our record/replay eval could not run for two days and reported green throughout, because the scorer kept grading cached results from a prompt we had deleted.
Sep 02, 20269 min readAi