🐱 Who’s been drinking from the water bowl? MiniCPM-V helps keep track.
Our ambassador @emwstudio built esp32-eye, an open-source monitor that recognizes individual cats and logs their daily drinking events, using MiniCPM-V 4.7, two ESP32-S3 boards, and a MacBook. 💧
From camera feed to daily counts, here’s how it works:
📷 Capture: An ESP32-S3 camera streams video from beside the water bowl to the MacBook.
⚡ Detect: MiniCPM-V 4.7 1B runs locally on the MacBook to check whether a cat is in view, filtering frames before calling the larger model.
🔍 Identify: MiniCPM-V 4.7 35B-A3B checks the scene and compares reference photos to identify the cat.
📊 Track: A separate ESP32-S3 AMOLED display shows live video and each cat’s daily count. The system also saves event clips with audio.
🐾 In a home setup with four cats, @emwstudio reports 89 manually checked drinking events over three days, with all cat identities correctly recognized.
A practical example of complementary models at work: an intelligent model handles frequent detection, while a larger model handles identity confirmation.
We love seeing our community turn MiniCPM’s visual understanding into creative tools for everyday life. What would you build? 💙
🎬 Watch @emwstudio’s demo on Instagram:
http://instagram.com/reel/De9kUrooQlR
🛠️ Explore @emwstudio’s project:
http://github.com/emwstudio/esp32-eye
🚀 Build with MiniCPM-V:
GitHub: http://github.com/OpenBMB/MiniCPM-V
🤗 Hugging Face: http://huggingface.co/openbmb/MiniCPM-V-4.7-35B-A3B