Two eval scorers passed a wrong answer because it mentioned the right one - DEV Community
The reply was "No. The passage does not support Yes." Target: Yes. Two of Inspect AI's three deterministic scorers marked it correct. Ten BoolQ rows, one material.
Ähnliche Seiten
Postmortem: An Empty Log File Passed the Release Gate - DEV Community