Signal Drift

An eval set is quietly mislabeled. Choose how deep to audit before you ship.

1. Pick the suspicion level

400 candidate rows. The suspected contamination rate sets what auditing is worth. This round: .

More mislabel-audit arithmetic and eval teardowns on eval audits and serving math. Background reading: data leakage, Goodhart's law.