Hugging Face's Irene Solaiman says embedded AI evaluators won't be easy

Irene Solaiman, Hugging Face's chief policy officer, says AI model benchmarks are still immature and hard to compare or reproduce. She says embedded third-party evaluators need more standardization, and that agentic evaluations are hard and expensive, with harnesses receiving fewer evaluations than models.