We built a haunted house for doc parsers 🎃
Boo Bench is 179 pages that push parsers into repetition loops. One model saw 246 redaction x’s on a page and wrote 23,004 of them.
Results in thread!
Leaderboard + paper: https://llamaindex.ai/benchmarks/boobench
Dataset: https://huggingface.co/datasets/llamaindex/BooBench