Showcify Team·Engineering Patterns
The eval graded the answer key, not the document
An extraction eval stayed green for weeks while users watched their data get mangled. The cause: it graded output against our labels, not against the source.
Sep 02, 20269 min readAi
