Skip to contentSkip to stories

Updated

Open source

Showing low-relevance items too. Hide low-relevance items

Sep 25

Sep 25Fri
  1. Together AIOfficialAI score12

    Together AI Simplifies Access to Frontier Open Models via API

    AITogether AI says teams can access frontier open models through its API without managing underlying infrastructure, a point Ted Cui, its VP of Engineering and Inference Platform, made at Apsara Conference 2026. The company emphasizes reliable, fast inference as essential for this access.

Sep 24

Sep 24Thu
  1. ModelScopeOfficialAI score23

    NeoHorse-Jev-4B open model turns app states into structured decisions

    AIModelScope has released NeoHorse-Jev-4B, a compact open model that converts application states into structured decisions and probabilities. It scores 77.70 across six text decision benchmark groups, ranking first among four open-weight models with complete results in the comparison. Its prefill-only inference supports Choice, Noul, and Score primitives, accepts text or a single image with text, and is available under Apache 2.0 for deployment via vLLM, SGLang, Python, CLI, or HTTP.

    Video from @ModelScope2022's post
  2. vLLMOfficialAI score30

    vLLM integrates TileRT with PD disaggregation, benchmark config published

    AIvLLM has published a blog post explaining how its integration with TileRT works, alongside a public benchmark configuration in the InferenceX repository. The benchmark script covers GLM-5.3 FP8 on MI355X hardware and is linked on GitHub. The post itself provides the integration details.

  3. vLLMOfficialAI score42

    TileRT and vLLM hit 469 tok/s on GLM-5.3 with MI355X

    AIThe TileRT and AMD teams reached 469 tok/s single-user decode for GLM-5.3 on 8× MI355X using vLLM. The setup disaggregates work, with vLLM handling prefill and TileRT handling latency-critical decode through vLLM's V1 connector interface. SemiAnalysis's AgentX benchmark reports the configuration at 470 TPS on GLM 5.3 (FP8), over 40% faster than GB300 TRTLLM using FP4.

  4. Lewis Tunstall @ COLM 🌉XAI score42

    Hugging Face releases over 5,000 RL environments for data science tasks

    AIHugging Face released SmolDataEnvs, more than 5,000 open-source RL environments aimed at real-world data science tasks. They target the gap between simple educational games and frontier-level benchmarks, especially for improving coding in models under 10B parameters. The environments are designed as a testbed for developing new RL methods such as GRPO or OPSD.

  5. Baseten BlogOfficialAI score44

    LangSmith Fine-Tuning Trains Open Models on Agent Traces via Baseten Loops

    AILangChain launched LangSmith Fine-Tuning, which lets users fine-tune open models on their LangSmith agent traces using the open-source smithtune CLI. Training runs on Baseten Loops in the user's own workspace, and smithtune deploy places the evaluated checkpoint on a Baseten Dedicated Inference deployment. Loops is in early access, so users may need to request access for their workspace.

  6. GitHub Blog · AI & MLOfficialAI score66

    GitHub Security Lab shows an LLM agent running AI-driven fuzzing for C/C++ projects

    AIGitHub Security Lab describes the Fuzzing Taskflow, an LLM agent pipeline that identifies entrypoints, writes harnesses, runs AFL++, reads coverage reports, and triages crashes for C/C++ repositories. The agent makes decisions while MCP tools handle execution, and state is stored in a SQLite database. The post also warns that the taskflow runs AFL and build commands directly on the host, so it should be used only in disposable environments without elevated privileges.

    Why it matters: The post explains how an LLM agent automates fuzzing steps like harness writing, coverage gap chasing, and crash triage, with a runnable workflow and design tradeoffs.

  7. Google for DevelopersOfficialAI score37

    Gemma 4 now runs on-device in the Antigravity SDK

    AIGoogle says Gemma 4 can now run locally on-device within the Antigravity SDK. Developers can build fully local or hybrid multi-agent workflows that pair cloud models with Gemma 4 agents for auditing, patching, and testing code. The post emphasizes total data privacy and zero API fees, powered by LiteRT.

    Video from @googledevs's post
  8. OdysseyOfficialAI score18

    Odyssey introduces Agora-2, a multi-agent world model

    AIOdyssey launched Agora-2, a multi-agent world model that the company is making available for public experimentation. The post predicts such models will increasingly power applications in AI training, AI safety, robotics, autonomous vehicles, defense, energy, cybersecurity, and gaming.

  9. vLLMOfficialAI score34

    vLLM and RL-Kernel achieve bit-exact logprob match on AMD MI300X

    AIThe RLKernel team integrated RL-Align/RL-Kernel with vllm-project/vime, and a 200-step Qwen3-8B GRPO run on 8× AMD MI300X recorded zero logprob mismatches between Megatron training and vLLM rollout. The strict path aligns reduction order, intermediate precision, rounding points, and math primitives across both sides to achieve bit-for-bit matching on ROCm.

  10. OpenBMBOfficialAI score34

    FIT-GGUF enables size-targeted mixed-precision quantization of MiniCPM5-2B

    AIDeveloper @Scorp1o_117 used FIT-GGUF to build four MiniCPM5-2B GGUF variants, ranging from about 1.14 GiB to 1.46 GiB, tuned to target file sizes or fidelity tiers. Instead of fixed presets, FIT-GGUF allocates precision tensor by tensor, with Quality, Balanced, Compact, and Mini options, and its generated files matched predicted sizes. Builds are evaluated with KL Divergence and Same-top metrics and are available on Hugging Face.

    Image from @OpenBMB's post
  11. ModelScopeOfficialAI score38

    Qwen-Image-2.1-Fun-Controlnet-Union adds eight controls and inpainting

    AIModelScope released Qwen-Image-2.1-Fun-Controlnet-Union, a single checkpoint adding eight structural controls, including Canny, Depth, Pose, and Scribble, plus inpainting to Qwen-Image 2.1. Control and inpainting share one branch with 16 injection points across every second Transformer block, keeping the base model frozen and requiring no checkpoint switching. It runs at guidance scale 1.0 with CFG-distilled sampling and prefix KV caching, and is available under the Qwen Research License with base Qwen-Image 2.1 weights required.

    Image from @ModelScope2022's post
  12. Goodfire ResearchOfficialAI score52

    Block-Sparse Featurizers Recover Multidimensional Concept Geometry in Vision Models

    AIGoodfire Research introduces Block-Sparse Featurizers (BSF), which decompose model activations into subspaces rather than single directions. Applied to DINOv3 and Stable Diffusion XL, BSFs find interpretable multidimensional features that better explain activations and enable fine-grained steering. The authors report that most concepts they examined have a stable rank of about two to four dimensions.

  13. KrASIA · Big TechNewsAI score55

    Mind Lab launches Mint Recursive, a post-training platform for companies

    AIMind Lab unveiled Mint Recursive, a post-training and inference platform for industry use, alongside Macaron-V1.1, a model post-trained entirely on it. Macaron-V1.1 is a 752-billion-parameter model built from GLM-5.3 with four two-billion-parameter LoRA expert modules for chat, agents, coding, and generation. The platform is serverless and bills by token usage, and it collects feedback from models in use to support continued training.

  14. inclusionAI (Ant Ling) · new models on Hugging FaceOfficialAI score22

    inclusionAI Publishes Training-Content Summaries for Ling and Ring Models

    AIinclusionAI has published public training-content summaries on Hugging Face for its Ling and Ring model versions, including Ling-2.0, Ling-2.5, Ling-2.6-1T, Ling-3.0, Ring-2.0, Ring-2.5-1T, and Ring-2.6-1T. The documents, organized under the template associated with Article 53(1)(d) of Regulation (EU) 2024/1689, contain documentation only, not model weights or training datasets. Each summary covers only the model versions it names.

Sep 23

Sep 23Wed
  1. OpenClaw🦞OfficialAI score10

    OpenClaw plugins can use optional models for structured decisions

    AISupporting plugins can call an optional model for structured choices, kept separate from chat. TypeSafe Jev sends supplied information to its hosted API and incurs normal charges, while ONNX offers local CPU options. Decision Models are off by default.

  2. Midjourney UpdatesOfficialAI score31

    Midjourney Alpha changelog adds style previews, default parameters, and a new Create feed

    AIMidjourney's alpha site now lets users preview their current prompt across styles with "Live previews" in the Styles sidebar and save prompt-bar settings as defaults via Settings → Advanced → Your defaults. The Create feed received a full-width masonry redesign with hover-based prompts and buttons, and Korean is now live for all users on midjourney.com.

  3. Liquid AI BlogOfficialAI score46

    LFM2.5-VL-DSpark speeds up vision-language model decoding on GPUs and edge devices

    AILiquid AI released an experimental DSpark draft model for its LFM2.5-VL-3B vision-language model, delivering decoding throughput gains of up to 2.66× on GPUs and 3.13× on edge devices. The drafter adds about 280M parameters, an 8.9% increase in the deployed model's parameter count, and is available on Hugging Face with support in llama.cpp, SGLang, and MLX-VLM.

  4. vLLM BlogOfficialAI score54

    vLLM adds distortion-free Gumbel-max watermarking for text provenance

    AIvLLM now supports Gumbel-max watermarking, which embeds a keyed signal into generated text without changing the expected token distribution. Detection requires the secret key and tokenizer, and the signal accumulates over longer outputs. Benchmarks on Qwen3.5-27B with MTP-3 show throughput changes between -1.1% and +2.0% across batch sizes, with no consistent slowdown.

  5. Google Developers BlogOfficialAI score62

    Google reproduces Olmo 3 7B pre-training in MaxText on TPUs

    AIGoogle Developers reproduced Ai2's Olmo 3 7B from scratch in MaxText on Google Cloud TPUs, covering both the stage-1 pre-training run and the stage-2 mid-training anneal. The match was checked on held-out C4 loss, an 8-task accuracy suite, multi-domain perplexity, and token-level KL, not just the training loss curve. The post also describes a data-loader bug that made training loss look better than the reference while held-out metrics did not move.

    Why it matters: The post documents how a faithful reproduction was verified on held-out metrics, including a data bug that training loss alone would have hidden.

  6. Google GemmaOfficialAI score60

    Google's Antigravity SDK adds local execution with Gemma 4 and LiteRT

    AIGoogle says the Antigravity SDK now supports running agents entirely on a local machine with Gemma 4 and LiteRT. The post adds support for OpenAI-compatible endpoints, naming Ollama, llama.cpp, and vLLM as options for serving Gemma, and gives the install command pip install google-antigravity litert-lm.

    Why it matters: The post names the specific runtimes and serving endpoints supported, letting developers judge whether their current local setup fits the new SDK path.

    Video from @googlegemma's post
  7. InferactOfficialAI score44

    vLLM maintainers show TPUv7 megakernels beat GB200 NVL72 on Kimi K3

    AIInferact says vLLM maintainers used megakernel optimization to reach 700 tokens per second per user on TPUv7 running Kimi K3. SemiAnalysis, which shared the work, reports this is 56% better performance than Nvidia's GB200 NVL72. Inferact links a full technical breakdown of the TPU megakernel work on its blog.

  8. Google AntigravityOfficialAI score38

    Antigravity SDK runs Gemma 4 fully offline on local GPUs

    AIGoogle Antigravity says developers can now run open models such as Gemma 4 completely offline in its SDK. The setup uses Google AI Edge's LiteRT to run the model directly on a local GPU, with no API costs and no internet connection required.

    Video from @antigravity's post
  9. InferactOfficialAI score49

    Inferact's TPU megakernel runs Kimi K3 at 709 tokens/s

    AIInferact says its first TPU megakernel for Kimi K3 reaches 709 tokens/s on low-concurrency decode with DSpark speculative decoding, versus 450 tokens/s for its GB200 baseline. The company claims it is the first TPU inference megakernel, running the whole model in a single Pallas kernel, and says it is roughly 1.4 to 2x the GB200 baseline at batch sizes 1 through 8 without speculative decoding. Inferact says it is open-sourcing the kernel today.

    Video from @inferact's post
  10. LM StudioOfficialAI score28

    Bionic adds a built-in interactive canvas for shared diagrams

    AIBionic now includes a built-in interactive canvas where users can create Excalidraw diagrams that both they and Bionic can view and edit. The canvas supports collaboration on mockups, system designs, and process maps, and users can ask Bionic to implement what is drawn.

    Video from @lmstudio's post
  11. Black Forest LabsOfficialAI score67

    Black Forest Labs releases FLUX 3 Action, an open 7B world action model for robots

    AIBlack Forest Labs says FLUX 3 Action is an open-weights 7B world action model that ranks first on the RoboLab benchmark. The company says it outperforms the previous best open model by 6.1 percentage points while using 56% fewer parameters and running up to 3.95x faster. The model predicts video and actions together, and the company is releasing the weights, code, fine-tuning recipe, benchmarks, and examples. It also integrated the model into Hugging Face's LeRobot with NVIDIA, with edge deployment on NVIDIA Jetson.

    Why it matters: The release pairs benchmark results with the trade-off it claims to remove between world action model performance and VLA speed, which is useful context for robotics teams weighing open models.

    Video from @bfl_ai's post
  12. Thomas DohmkeXAI score22

    Open-source 3D-printed Marvin robot connects to ChatGPT and Entire

    AIDeveloper Stefano (@spedemo) built a 3D-printed, remote-controlled robot named Marvin that uses voice detection and speech, with all of it open source. The post says Marvin connects to ChatGPT and Entire, and it will be shown at the WeAreDevs booth 753 in San Jose.

    Video from @ashtom's post
  13. Microsoft ResearchOfficialAI score60

    Microsoft Research shows offloading robot AI inference improves performance and battery life

    AIMicrosoft Research reports that running physical AI inference on onboard GPUs can limit robot performance and battery life, while offloading inference to edge or cloud GPUs improved results in mobile manipulation tests. In its evaluation, smaller onboard GPUs slowed mapping and planning by up to 383% compared with an A100, and large onboard GPUs such as Jetson Thor drained robot batteries by up to 160%.

    Why it matters: The study measures how offloading robot inference to edge or cloud GPUs changes task success, battery life, and model size, offering evidence for infrastructure design.

  14. Mike KnoopXAI score57

    Tufa Labs reaches 83.06% on ARC-AGI-2, 2% short of the grand prize

    AIMike Knoop says the top ARC Prize 2026 ARC-AGI-2 score of 83.06% by Tufa Labs is only 2% short of the 85% grand prize threshold. The challenge runs under strict Kaggle compute limits with no internet access, and the winning solution is set to be open sourced. The image shows the leaderboard with RabbitHole at 76.94%, nvbanana at 74.17%, Yi-Chia Chen at 55.14%, and Kha Vo at 37.50%.

  15. Lewis Tunstall @ COLM 🌉XAI score40

    Lewis Tunstall makes voice acting debut with Reachy Mini robot

    AILewis Tunstall of Hugging Face shares his first cameo as a voice actor using the Reachy Mini robot, linked to a YouTube video about Australian football. The post itself provides no technical details, and the Reachy Mini context comes from a separate post by Andi Marafioti about NVIDIA's open-source Nemotron 3 Diarization model.