Skip to contentSkip to stories

Updated

#Multimodal

Showing low-relevance items too. Hide low-relevance items

Mar 13

Mar 13Fri
  1. Berkeley AI ResearchAI score34

    SPEX and ProxySPEX Identify Influential LLM Interactions at Scale with Fewer Ablations

    AIBerkeley AI Research introduces SPEX, a signal-processing framework that identifies influential interactions in LLMs using far fewer ablations than exhaustive analysis. A hierarchy-based extension, ProxySPEX, matches SPEX performance with around 10x fewer ablations. The methods apply to feature, data, and model component attribution.

Mar 12

Mar 12Thu
  1. Intern Large ModelsAI score47

    InternVL-U: Open-Source 4B Unified Model for Reasoning, Generation, and Editing

    AIInternVL-U is a lightweight 4B unified multimodal model that combines reasoning, generation, and editing in one framework, according to Intern Large Models. The post says it uses unified contextual modeling, modality-specific modular design, and decoupled visual representations to balance performance and efficiency. It reportedly outperforms unified baselines more than 3× its size on text rendering, scientific reasoning, and spatially grounded generation and editing, and is open-source on GitHub and Hugging Face.

    Image from @intern_lm's post

Mar 11

Mar 11Wed

Mar 4

Mar 4Wed
  1. Mistral AI · new models on Hugging FaceAI score67

    Mistral Small 4 unifies instruct, reasoning, and coding in one open model

    AIMistral Small 4 combines instruct, reasoning, and Devstral capabilities in one multimodal model with 119B total parameters, 6.5B active per token, and a 256k context window. The source reports a 40% reduction in latency-optimized end-to-end completion time and 3x more requests per second in throughput-optimized setups versus Mistral Small 3. It is released under Apache 2.0 and supports reasoning mode toggling per request.

    Why it matters: The source lists architecture, context length, and mode-switching controls, letting readers compare this release's design with earlier Mistral Small models.

Mar 2

Mar 2Mon

Feb 24

Feb 24Tue

Feb 19

Feb 19Thu
  1. Guillaume Lample @ NeurIPS 2024AI score40

    Mistral releases Voxtral Realtime paper, Apache 2.0 speech model

    AIMistral has published the technical report for Voxtral Realtime, a speech transcription model released under the Apache 2.0 license. The model reportedly achieves state-of-the-art transcription performance at sub-500ms latency. Mistral also launched a Realtime playground in Mistral Studio and made the model available in Hugging Face Transformers.

    Image from @GuillaumeLample's post

Feb 17

Feb 17Tue
  1. Eugene YanAI score72

    Claude Sonnet 4.6 released with upgrades and 1M token context window

    AIAnthropic's Claude Sonnet 4.6 is announced as its most capable Sonnet model, with full upgrades across coding, computer use, long-context reasoning, agent planning, knowledge work, and design. It also features a 1M token context window in beta. The author notes that the model is versatile across classification, coding, computer use, and autonomous agents by adjusting effort and thinking modes.

Feb 11

Feb 11Wed
  1. Z.ai Release NotesAI score49

    Z.ai Releases GLM-5.3-Flash, GLM-5.3 and a Series of Updated GLM Models

    AIZ.ai's release notes list GLM-5.3-Flash, a hybrid-architecture model with 320B total parameters and 18B activated, and GLM-5.3, which the company says achieves a 50% gain over GLM-5.2 on Z.ai Code Bench. Other entries in the notes include GLM-5.2 with 1M lossless context and GLM-5.1, which Z.ai says can work independently for up to 8 hours in a single run.

Feb 4

Feb 4Wed

Feb 2

Feb 2Mon
  1. Z.ai Release NotesAI score40

    GLM-OCR: Z.ai launches compact OCR model with CogViT and GLM-0.5B encoder-decoder

    AIZ.ai has launched GLM-OCR, a compact, high-performance optical character recognition model built on its self-developed CogViT and GLM-0.5B encoder-decoder architecture. The model uses a dedicated connection layer for cross-modal alignment and CLIP pre-training on billions of image-text pairs for visual semantic understanding and key token extraction. It is designed to stay lightweight for fast inference.

  2. BAAIAI score43

    BAAI's Emu3 published in Nature, first Chinese-led large model paper there

    AIThe Beijing Academy of Artificial Intelligence (BAAI) published its Emu3 multimodal large model research in Nature, which the post describes as the first large-model achievement led by a Chinese research institution in that journal. Emu3 learns from text, image, and video at scale using next-token prediction alone, reaching generation and perception performance comparable to task-specific methods. The authors frame this as a step toward scalable, unified multimodal intelligence systems.

    Video from @BAAIBeijing's post

Jan 23

Jan 23Fri
  1. Mistral AI · new models on Hugging FaceAI score67

    Mistral Small 4 unifies instruct, reasoning, and coding in one open model

    AIMistral Small 4 is a 119B-parameter MoE model with 6.5B active per token and a 256k context window, combining instruct, reasoning, and Devstral-style coding in one model. It accepts text and image input, lets users set reasoning_effort per request, and is released under Apache 2.0. The model card reports a 40% latency reduction and 3x throughput versus Mistral Small 3 in its tested setups, and its benchmark chart shows reasoning scores on GPQA Diamond, MMLU Pro, AIME-style text tasks, and MMMU-Pro.

    Why it matters: The model card names concrete architecture, context, and licensing details, letting readers compare its reasoning toggle and efficiency claims against other open models.

Jan 14

Jan 14Wed
  1. Chip HuyenAI score14

    Agentic Hackathon projects tackle long-running tasks, retrieval, and multimodal agents

    AIChip Huyen praised projects at last weekend's Agentic Hackathon, which hosted by MongoDB and Cerebral Valley, where she served as a judge. Teams tackled long-running tasks such as memory management, recovery from mid-task failures, and consistency across steps and sub-agents, along with adaptive retrieval across databases, search indices, and websites. Finalist demos are scheduled in San Francisco tomorrow, with talks by Douglas Eck.

    Image from @chipro's post

Jan 13

Jan 13Tue

Jan 1

Jan 1Thu
  1. Moonshot AI (Kimi) · new models on Hugging FaceAI score75

    Moonshot AI releases open-source multimodal agent model Kimi K2.5

    AIMoonshot AI released Kimi K2.5, an open-source native multimodal agentic model built by continual pretraining on about 15 trillion mixed visual and text tokens. The model card reports a 1T-parameter Mixture-of-Experts architecture with 32B activated parameters and a 256K context length, and it lists benchmark results against GPT-5.2, Claude 4.5 Opus, Gemini 3 Pro, DeepSeek V3.2, and Qwen3-VL-235B-A22B-Thinking. Weights and code are released under a Modified MIT License, with API access on the Moonshot platform.

    Why it matters: The model card gives a full benchmark table against GPT-5.2, Claude 4.5 Opus, and Gemini 3 Pro, useful for comparing open multimodal agent models.

Dec 18, 2025

Dec 18, 2025Thu

Dec 16, 2025

Dec 16, 2025Tue
  1. MiniMax · new models on Hugging FaceAI score38

    MiniMax Releases VTP-Large-f16d64 Visual Tokenizer With Technical Report and Pretrained Weights

    AIMiniMax released the technical report and pretrained weights for VTP-Large-f16d64, a visual tokenizer that jointly optimizes contrastive, self-supervised, and reconstruction losses. The model scores 78.2 zero-shot accuracy, 85.7 linear probing, and 0.36 rFID, and its generation performance scales with pretraining compute, parameters, and data. Checkpoint weights were listed as "released very soon" in the source.

Dec 12, 2025

Dec 12, 2025Fri

Dec 11, 2025

Dec 11, 2025Thu
  1. Runway ResearchAI score62

    Runway Introduces GWM-1, a Real-Time General World Model Family

    AIRunway announced GWM-1, its first general world model family, built on Gen-4.5 and generating frames autoregressively in real time under interactive control. It comes in three variants: GWM Worlds for explorable environments, GWM Avatars for conversational characters, and GWM Robotics for robotic manipulation. Runway also says it is working toward unifying these domains under a single base world model, and GWM Robotics includes a Python SDK.

    Why it matters: The post separates three GWM-1 variants and ties each to a concrete use, which clarifies where a general world model would fit compared with a single model.