Skip to content
View original post on X: Ai2Official· 38/100AI score38/100

Ai2 adapts Molmo 2 to track salmon in sonar video

AISummary

Kai Van Brunt adapted Ai2's open video model Molmo 2 to sonar footage of salmon, producing a prototype called Molmo2Fish. The prototype tracks fish and can correct some of its mistakes through natural-language guidance.

Post on XView on X
Ai2
@allen_ai

Kai Van Brunt adapted Molmo 2, our open model for video understanding, to a domain far outside its training data: sonar video of salmon.

Meet Molmo2Fish, a prototype that tracks fish + can correct some of its mistakes through natural-language guidance. 🧵

https://allenai.org/blog/molmo2fish

Source: Ai2 · x.comPublished

Topics

Multimodal AIAI videoOpen-source ecosystemPapers & research