The eval set has production data — you are tuning on real customers

To make eval questions look real, someone copied production Q&A into the set. Ticket ids, reimbursement caps, customer wording from retrieved chunks entered the repo and the share drive. Fifty real questions are for recall. Once they carry real customer identifiers, you are tuning on production. Same accounts as prod and ACL is tested through.