#Multimodal

AI🚀 The main post is just a rocket emoji with no text beyond the quoted teaser. Quoted from @vllm_project: Day-0 support for Intern-S2-397B is now available in vLLM. Built for long-horizon scientific research, Intern-S2 brings strong multimodal, reasoning, coding, and scientific agent capabilities. Run it with vLLM today:

AIIntern Large Models introduces Intern-S2-397B, a multimodal foundation model built for long-horizon scientific research and scientific agents. The post reports leading open-source results on IMO-Proof and AdvancedMathBench, and says the model reaches the level of Gemini 3.1 Pro on those tasks. It is now supported by vLLM and SGLang, with weights on Hugging Face and ModelScope and a chat demo available.

AIAt Guotai Junan Securities' 2026 Autumn Conference, SenseTime's Head of Capital Markets Philip Wong laid out three shifts reshaping AI: from single-modal to native multimodal, from token consumption to task delivery, and from single-point models to system-level full-stack capabilities. The post presents SenseTime's "One Model + One Token Factory + One Agent Harness" framework as built for these shifts.

AIQwen has open-sourced Qwen-Image-2.1, a unified text-to-image generation and image editing model with 7B parameters in its visual generation component. The model can generate regular or transparent RGBA images, supports up to 10 reference images for editing, and is licensed under the Qwen Research License Agreement.

Why it matters: The source specifies the 7B visual component, transparent RGBA output, and up to 10 reference images, which helps readers judge its fit for generation and editing workflows.

AIShanghai AI Lab's InternLM team released Intern-S2-397B, a multimodal foundation model for scientific intelligence and long-horizon agents. The model uses visual pre-training on raw scientific literature pages, multi-task reinforcement learning across more than 20 scientific domains, and agentic reinforcement learning in sandboxed environments.

AIDeepSeek released open weights for V4.1-Flash, which Baseten now offers through its Model APIs. The model has 552B total parameters, 8B active for prefill and 16B for decode, a 1M token context window, and text plus image input. Its Causal Encoder-Decoder design runs only the encoder during prefill and reuses a projected KV cache, and the source reports the global KV cache at a quarter of V4-Flash's memory.

Why it matters: The post explains how the CED architecture splits prefill and decode compute and cuts KV cache memory, which matters for coding agent costs.

AIMiniMax Design has released a major upgrade that adds GPT-6 Astra, new MCP integrations for Blender, Photoshop, and After Effects, and collaborative projects for teamwork. The post says users can create 3D models from a single prompt and turn AI clips directly into editable After Effects projects.

AISGLang and Miles ship day-0 inference and RL support for DeepSeek V4.1 Flash, with weights now available. The model is natively multimodal with 552B backbone parameters, 16B active during decode and 8B during prefill, and supports up to 1M context. V4.1 adds shared compressed KV across layers, a two-stage sparse indexer, and a 196B Engram lookup memory.

AIDeepSeek says V4.1-Flash is now live on its API with native multimodal support, accessed through the model name deepseek-flash. The older V4-Flash and V4-Flash-Vision-Exp are retired, while deepseek-v4-flash and deepseek-v4-flash-vision-exp temporarily route to V4.1-Flash. Requests to deepseek-v4-pro will route to V4.1-Flash at V4.1-Flash rates starting 04:00 UTC on Sept 14, 2026, until V4.1-Pro launches.

AIDeepSeek officially released DeepSeek-V4.1-Flash, the smallest model in its new architecture family, with native multimodal visual understanding. The API now serves it under the model name deepseek-flash, while V4 Flash and V4 Flash Vision Exp were retired and routed to V4.1 Flash. API prices were reduced with the release, and V4 Pro remains available after September 14, 2026.

Why it matters: The release lists benchmark results alongside API model-name changes and retirements, so developers can check both capability claims and migration steps.

AIDeepSeek released DeepSeek-V4.1-Flash, a multimodal Mixture-of-Experts model with 552B backbone parameters and support for contexts up to one million tokens. The technical report says its global KV cache footprint is 890 bytes per token, roughly one quarter of DeepSeek-V4-Flash, and reports 8B activated parameters per token during prefill and 16B during decode.

Why it matters: The report shows KV cache per token falling to about one quarter of DeepSeek-V4-Flash, a concrete tradeoff between long-context serving cost and benchmark results.

AIThe main post only says "Astra for medical education:" with no details, so the source offers little beyond that label. The quoted post claims a GPT-6 Astra service links anatomical diagrams, CT cross-sections, and 3D relationships in one spatial tool for medical students.

AICohere Labs has released Tiny Aya Base 32K, an open-weights pretrained model with 3.35 billion parameters and a 32K context window. The model covers 70+ languages, including many lower-resourced ones, and is designed for downstream adaptation and long-context research. It is a base model that has not been instruction-tuned, and it is licensed under CC-BY-NC.

AIXiaomi MiMo has launched MiMo Desktop in invite-only beta, a desktop agent that turns Office files, images, video, audio, and zips into finished, editable output. Invitees also get limited access to next-gen MiMo models, and the post lists features including live previews, region-based editing with versioned rollback, automatic model routing, and browser and computer use with record and replay.

AINVIDIA's NV-Reason-CT is a 3D vision-language model for CT image analysis that combines a native 3D vision encoder with a language model. It is designed for radiology report generation, question answering, and multi-step reasoning across chest and abdominal CT volumes. The model converts a 384×384×384-mm input into 13,824 visual tokens without spatial downsampling and is available on Hugging Face under the OpenMDW-1.1 License.

AIWorld Labs co-founders discuss Atlas, a world model for spatial intelligence, as the key to unifying pixel-level generation and reconstruction. The source says Atlas can digitally capture a 3D representation of a space from three photos, where previously 100 to 300 were needed.

AIGoogle has made Lyria 3.5, its best-sounding music generation model, available in AI Studio, through the Gemini API, and in the Gemini app. The model produces more expressive vocals and richer musical arrangements, enabling higher-fidelity tracks.

AIBAAI and Peking University researchers released official weights for ConsiSpace, a geometry-consistent multimodal framework for spatial reasoning in long-form visual observations. The model is described in the paper "ConsiSpace: Learning Geometric Consistency Matters for Video Spatial Reasoning" (arXiv:2607.17599).

AITencent released EVIE-4.5B, a 4.5B-parameter visual document retrieval model, with weights, training pipelines, HAC token compression, and evaluation suites open-sourced on Hugging Face. It scores 66.02 on ViDoRe V3 and ranks second on that leaderboard behind the 8.4B EVIE-8B, which scores 66.24. Its Prefix-MRL head lets a single 2048D projection be truncated to 64–2048 dimensions at runtime without separate models.

AIMidjourney's alpha site now runs the new v8.2 edit model, with an editor built into the lightbox. Users can edit images with plain-text instructions, attach up to 4 reference images, and view all session edits in one place. The update also adds an early Change Style feature, and the team says speed and error messaging have improved, while drag and drop and the prompt bar are still in progress.

AIGoogle is rolling out new Gemini voice capabilities that let Google AI subscribers search their Gmail inbox, organize thoughts and tasks in Keep, and create new Docs conversationally. The company highlights Docs Live as especially helpful, with a demo included in the post.

AIBAAI released Recon2Reason-Reasoning-4B, a 4,437,815,808-parameter vision-language model fine-tuned from Qwen3-VL-4B-Instruct for indoor spatial reasoning. The model handles metric distance, relative position, and object-relation questions from single or multiple images, and loads with the standard Qwen3VLForConditionalGeneration interface without trust_remote_code. The checkpoint is released under Apache-2.0 with BF16 Safetensors weights, and the retrieval-augmented scene-reconstruction extension ships separately.

AIGoogle's RT-2 model, announced in July 2023, trained a multimodal LLM to output robot actions directly, and the article argues this approach launched the current robotics boom. The author follows later work from Physical Intelligence, including action chunking with flow matching, reinforcement learning on real robots, and visual subgoal generation, and notes that the field is debating whether vision-language-action models will give way to world models.

AIGoogle AI Developers says Gemini 3.8 Flash, built for complex reasoning, generated an interactive 3D visualizer using Three.js in Google AI Studio. The visualizer produces physically proportioned teardowns of hardware devices, automatically splitting each device into layers that users can explode and inspect with a deconstruction slider.

AIAnthropic's Alex Albert says Fable 5.1 is strong at generating videos through code. Given a photo of a property lot, the model designed a house for it, rendered the design, and produced a cinematic walkthrough.

AIGoogle AI Studio says agentic video understanding is now available across Gemini 3.7 Flash, 3.6 Flash and 3.5 Flash-Lite via the Gemini API. The company reports cost reductions of up to 66%, token consumption reductions of up to 88% and accuracy gains of up to 7% on standard video benchmarks. Developers enable it by setting processing to "agentic" in the API configuration, at standard token pricing.

Why it matters: The source gives concrete cost and token figures and explains how the agentic loop replaces fixed-rate frame ingestion, helping developers weigh it against their current video pipelines.

AIGoogle's Gemini 3.7 Flash accurately counts every clap in a video by using a new agentic video understanding capability that automatically adapts its processing speed. Static video processing defaults to 1 FPS, which can miss split-second movements or confuse claps with snaps and clicks.

AIin which the model decides what to watch, at what speed, and through which modality. It fetches only the moments and signals it needs instead of ingesting media at a fixed frame rate. The post says this cuts costs by up to 66% and token consumption by up to 88% while boosting accuracy, and it is available now via the Gemini API and in AI Studio.

AIWorld Labs has introduced Atlas, a multimodal world model it describes as trained from scratch. The post says Atlas generates frames with pixel-perfect camera control, reconstructs large scenes from as few as one input image, and outputs 3D spaces from one or more images. The author cites use cases including VFX and robotics.

AIGoogle has released GNM v3.0, a parametric 3D statistical model of the human head, with weights published on Hugging Face and Kaggle under the Apache 2.0 license. The model gives controllable identity, expression, head pose, and internal anatomy including eyeballs, teeth, and tongue, and supports NumPy, JAX, PyTorch, and TensorFlow backends.

AIShanghai AI Lab's InternLM has published Intern Lumina U2, a 16B-parameter MoE model with 1B active parameters that handles text QA, image generation and editing, and image, video, and 3D understanding. The model uses an 8-codebook fully-discrete visual representation built on AToken. Checkpoints are provided for Huawei Ascend NPUs and NVIDIA GPUs under Apache 2.0, with the technical report still listed as coming soon.

Why it matters: The model unifies text, image, video, and 3D understanding with image generation in one framework, a broader scope than single-modality releases.

AIMicrosoft Research released GigaPath-Flash and GigaTIME-Flash, efficient pathology foundation models built on a distilled ViT-S backbone and released under the Apache 2.0 license. GigaPath-Flash, with 22M-parameter tile and 21M-parameter slide encoders, reportedly scores within 3% of the original GigaPath on PANDA and EBRAINS benchmarks at roughly 50 times less compute. The models are research tools, not validated for clinical use.

AIDeepSeek introduces DeepSeek-V4-Flash-Vision-Exp, its first experimental multimodal model in the DeepSeek-V4 family, built on V4-Flash with visual modules. It reports substantial gains over DeepSeek-V4-Flash-0731 on multimodal agent benchmarks, such as ApexBench at 36.5 versus 26.2, while keeping text agent performance comparable. The repository provides tokenizer files, prompt encoding, vLLM and SGLang serving instructions, and is licensed under MIT.

Why it matters: The source compares the model with its text-only predecessor and Opus-4.8 on agent benchmarks, showing where vision gains occur and where text performance holds.

AIAlibaba NLP has released core-emb-8b, an MLLM-based multimodal embedding model that distills a reranker's compositional judgments to distinguish attribute-object bindings such as "a white plate and a black chair" versus "a black plate and a white chair." The 8B dense embedding model, built on the Qwen3-VL-based VL-Emb backbone, scores 0.666 total average on compositional benchmarks, 5.7 points above its backbone. It is part of a family that also includes 2B embedding and reranker models.

AIAlibaba-NLP has published Core-Reranker-8B on Hugging Face, an 8B-parameter multimodal reranker fine-tuned from Qwen3-VL-Reranker to better distinguish attribute-object bindings in text and image relevance scoring. On compositional reasoning benchmarks COLA, SugarCrepe++, and NegBench, it reports an 82.7% total average, 10.7 points above Jina-Reranker. The model is part of the Core-Embed family, which also includes 2B and 8B embedding models, with Core-Embed-8B reporting a 0.666 total average.

AIAlibaba NLP has released core-emb-2b and core-emb-8b, multimodal embedding models built on Qwen3-VL that distill reranker judgments to better match attribute-object bindings in text and image retrieval. The Core-Embed-8B model posts the best total average (0.666) among evaluated embedding models on compositional benchmarks, 5.7 points above its VL-Emb-8B backbone. Companion Core-Reranker-2B and 8B models are also available, with the 8B reranker reaching 82.7% total average on the same benchmarks.

AIAlibaba NLP released core-reranker-2b, a 2B-parameter multimodal relevance-scoring model built on Qwen3-VL-Reranker to better distinguish attribute-object bindings in text and image pairs. The Core-Reranker family also includes an 8B variant, and Core-Reranker-8B reports an 82.7% total average on compositional reasoning benchmarks COLA, SugarCrepe++, and NegBench, 10.7 points above Jina-Reranker. Usage details are provided in the source, including loading through the GitHub repository wrapper classes.

AIReplicate announced that Gemini Omni 1.1 Flash from Google DeepMind is now live on its platform. The update adds scene extension, control of a shot's starting and ending frames, video input references, upscaling to 4K, and 360p fast prototyping.

AIMiniMax-H3 on 8×H200 GPUs reaches 1.85–1.95x lossless speedup over Diffusers without approximation, with fixed prompts, seeds, resolution, FPS, and 50 denoising steps. Adding step reuse and sparse attention raises speedup to as much as 6.24x, but quality varies by workload, with SSIM from 0.76 to 0.91. Two presets trade off the two: a conservative Cache-DiT setting gives 2.99x at 0.90–0.98 SSIM, while a faster SubBlock 0.75 plus Cache-DiT stride gives 4.90–5.93x at 0.77–0.92.

AIGoogle is rolling out Gemini Omni 1.1 Flash updates in Google Flow, adding start and end frame controls to keep characters and narrative consistent between transitions. Creators can draft at 360p on lower credit cost, then export final clips in 720p, 1080p, or 4K for digital, social, or broadcast workflows.