#

Ci

1 post

The eval was grading a prompt we had deleted

Our record/replay eval could not run for two days and reported green throughout, because the scorer kept grading cached results from a prompt we had deleted.

Sep 02, 20269 min readAi
Eval grading deleted prompt