Skip to content
View original post on X: Jerry LiuX· 30/100AI score30/100

Jerry Liu benchmarks Gemini 4 Argon, Muse Wonder, and Muse Spark on document OCR

AISummary

LlamaIndex's Jerry Liu says Muse Spark and Gemini 4 Argon are state of the art at their respective price points for table understanding among frontier models. He reports Muse Wonder and Gemini 4 Argon also perform well on chart understanding, reading order, and formatting recognition. The benchmarks were run on hard document OCR tasks and the models are available on OpenDocRouter.

Post on XView on X
Jerry LiuVerified on X
@jerryjliu0

We benchmarked Gemini 4 Argon, Muse Wonder, and Muse Spark comprehensively on hard document OCR tasks.

They're all pretty good!
- Muse Spark and Gemini 4 Argon* are SOTA at their respective price points for table understanding among frontier models.
- Wonder and Argon are also quite good at chart understanding, reading order, and formatting recognition

It's exciting that frontier models are starting to ramp up on visual understanding capabillities.

We're committed to open benchmarking of all available models even as we aim to build the best specialized models for document parsing and extraction.

You can check out the full set of models on OpenDocRouter: https://www.opendocrouter.ai/

If you want a dedicated OCR solution without choosing, come check out LlamaParse: https://cloud.llamaindex.ai/

Logan Markewich@LoganMarkewich
Added a few new models to OpenDocRouter (gemini-4-argon, Muse Spark/Wonder). Interesting to see the latency for Muse Wonder so low. Gemini's costs are low but their introductory rates mean the price will double later this year.
View quoted post on X

Source: Jerry Liu · x.comPublished · added here

Topics

Google / GeminiMultimodal AIData & trainingEvals & benchmarks