Jennifer Neville on learning from surprising AI failures and evaluation beyond benchmarks

Microsoft Research podcast host Chad Atalla interviews Jennifer Neville, a partner research manager at Microsoft, about her path into AI and her work on how evaluation exposes surprising failures in models tested beyond traditional benchmarks.

The conversation also covers practical guidance for working with current AI systems and why examining underlying data matters when results defy expectations.