Skip to contentSkip to stories

Updated

#Open-source ecosystem

Items with an AI score under 20 are hidden. Show low-relevance items

Oct 9

TodayOct 9Fri
  1. PandailyNewsAI score59

    MirroS open-sources AgentGarten, a framework where AI agents learn in live-rendered code worlds

    AIMirroS has released AgentGarten, an open framework where AI agents act, observe and learn in simulated worlds. Code handles physics and game rules, while a neural renderer turns geometry sketches into realistic frames at more than 30 frames per second at 480p on a single GPU. Across five worlds, agents improved over rounds using a playbook of lessons, such as a companion-dog score rising from 13 to 19. The team describes it as a research environment, not a deployed robot product.

  2. RadixArkOfficialAI score60

    RadixArk's Miles runs end-to-end RL on NVIDIA Vera Rubin with SGLang

    AIRadixArk says Miles runs reinforcement learning end to end on NVIDIA Vera Rubin, using SGLang rollouts, Megatron training and one container image. Agentic RL runs 64 concurrent sandboxes on the Vera CPU next to the GPUs. The linked SGLang post reports that Kimi K3 inference gained up to 20% faster FP8 MLA at batch 1 with 128K context, and a 5.9% end-to-end speedup from MoE tail fusion.

    Why it matters: The post gives concrete speedup figures and a specific RL setup on early-access Rubin hardware, useful for engineers comparing inference and training stacks.

  3. LMSYS OrgOfficialAI score50

    SGLang brings Kimi K3 inference speedups to NVIDIA Vera Rubin

    AISGLang optimized attention, MoE, and speculative verification kernels for Kimi K3 NVFP4 on early-access NVIDIA Vera Rubin hardware. Reported gains include up to 20% faster FP8 MLA at batch 1 and 128K context, 20% faster KDA verification with bitwise-identical output, and a 5.9% end-to-end speedup from MoE tail fusion. Miles, from RadixArk, uses SGLang for rollouts in end-to-end RL training on Rubin, including agentic RL with 64 concurrent sandboxes on the Vera CPU.

  4. vLLMOfficialAI score33

    vLLM says Rubin GPUs run its Blackwell kernels unmodified

    AIvLLM says a Rubin GPU has 3.5x the FP4 FLOPS, about 2.4x the HBM bandwidth, and 1.7x the NVLink bandwidth of a GB200. The faster NVLink lowers the cost of AllReduce and all-to-all operations in MoE serving. vLLM's Blackwell kernels run on Rubin unmodified, and FlashInfer 0.7.0 adds Rubin-tuned attention, GEMM, and MoE kernels.

    Image from @vllm_project's post
  5. vLLMOfficialAI score28

    vLLM uses NVIDIA locality domains to speed MoE decode up to 1.2x

    AIvLLM's locality-aware MoE shards FC1 and FC2 weights column-wise and launches one kernel per CUDA 13.4 locality domain using Green Contexts, so each SM reads only local HBM. Early results show MiniMax M3 MoE layers up to 1.2x faster in decode. This is post 4 of a 5-post thread.

    GIF from @vllm_project's post
  6. vLLMOfficialAI score44

    vLLM now runs DeepSeek, Kimi, GLM, and MiniMax on Vera Rubin

    AIvLLM says users can try its Vera Rubin support today with the vllm/vllm-openai:cu134-nightly image, which runs DeepSeek, Kimi, GLM, and MiniMax models. The project thanked contributors and said it expects further improvements for vLLM on Vera Rubin.

  7. vLLM BlogOfficialAI score62

    vLLM adds support for NVIDIA Vera Rubin NVL72 with 7.8x throughput over GB200

    AIvLLM now supports NVIDIA Vera Rubin NVL72, with daily container builds and support for models from DeepSeek, Moonshot AI, Z.ai, and MiniMax. In early AgentX benchmarks, vLLM running MiniMax M3 delivered up to 7.84x the throughput per GPU of GB200 NVL72 at matched interactivity. The post is an early look, and the team expects further gains from ongoing optimizations.

    Why it matters: The post gives specific hardware specs, kernel configurations, and benchmark figures for running vLLM on Vera Rubin NVL72, useful for teams planning deployments.

  8. SGLangOfficialAI score34

    SGLang reports inference speedups for MLA, MoE, and KDA kernels

    AISGLang says restructured MLA decode kernels on Rubin, which fit a deeper pipeline in 327 KiB of shared memory, deliver a 16% speedup at batch 16 with 128K context and bit-identical output. The post also reports 20% faster full FP8 MLA at batch 1 and 20% faster KDA verify kernels after keeping weights in registers and reducing synchronization. It additionally covers fusing MoE finalization, the shared expert, 8-GPU all-reduce, and RMSNorm into one collective kernel.

  9. Bertholomus AIXAI score22

    DeepSeek TP=2 and TP=4 kernel kits released on GitHub

    AIA GitHub post announces that kernel kits for DeepSeek's TP=2 and TP=4 recipes are now live. The post links to a repository named deepseek-v4.1-tensorfold-tp2-2xgb10 and gives no further details on performance or features.

  10. RadixArkOfficialAI score28

    Miles v0.1.2 adds Kubernetes support and torchtitan training backend

    AIRadixArk releases Miles v0.1.2, adding score centering for stable async RL and an experimental native Kubernetes backend. RL jobs can run as ordinary cluster workloads, and orchestration can restart while training continues. The release also adds torchtitan as a third training backend alongside Megatron and FSDP, plus support for DeepSeek-V4.1-Flash and MiMo-V2.6-Flash-RL.

    Image from @radixark's post
  11. ModelScopeOfficialAI score28

    Corvus-Gov-3B: a 3B Chinese government-domain dialogue model

    AIModelScope released Corvus-Gov-3B, a compact model tuned for Chinese policy Q&A, public-service consultation, and internal government or enterprise assistants. It was fine-tuned on one million Chinese government-domain dialogue samples and built on Llama 3.2 3B Instruct using LoRA SFT via LLaMA Factory. The model is released under Apache 2.0.

    Image from @ModelScope2022's post
  12. OpenBMBOfficialAI score28

    MiniCPM5-2B runs at 37 tok/s on iPhone Air

    AIOpenBMB reports that its MiniCPM5-2B model runs at 37 tokens per second on an iPhone Air. The post presents this as evidence that small open multimodal models can run on mobile devices without a cloud GPU, with NobodyWho noting the model is available in its Chat app.

  13. MarkTechPostNewsAI score44

    Underdog Releases Saluki 27B, a 2-Bit Qwen3.8-27B That Beats the Original at Tool Calling

    AIUnderdog has released Saluki 27B under Apache 2.0, a 2-bit GGUF of Qwen3.8-27B that fits in 7.89 GB, versus 54 GB for the full BF16 model. On Underdog Bench, Saluki scores 88 against 84 for the full model, and it raises parallel tool-call accuracy to 42 from 35. It runs on stock llama.cpp, but math and reasoning drop sharply, with AIME 2025 at 79.2 versus 96.7.

  14. vLLMOfficialAI score42

    vLLM Semantic Router team releases Decision 2.0 multi-question classification models

    AIThe vLLM Semantic Router team has released Decision 2.0, which answers multiple questions about one input in a single forward pass and outputs per-option probabilities. The post presents this as useful for routing and classification. A quoted post from Xunzhuo Liu says Decision 2.0 includes six open decision models ranging from 0.6B to 27B parameters, each topping same-size open models on the Jev Decision Index 0.3.

Oct 8

Oct 8Thu
  1. meng shaoXAI score43

    Unsloth integrates Microsoft's mxc sandbox for Windows AI agent isolation

    AIUnsloth has integrated Microsoft's open-source mxc sandboxing system into Windows as an OS-level sandbox for isolating AI agent code execution. Its High mode provides real operating-system isolation that confines tool calls to specified directories, while its Low mode adds language-level checks that block dangerous commands and shell escapes. Both modes also strip secret environment variables and enforce resource limits such as 8GB memory and 600-second CPU time.

    Image from @shao__meng's post
  2. Teknium 🪽XAI score23

    TinyFish browser backend added to Hermes plugins catalog

    AITeknium announced that TinyFish, a new browser backend, is now available on the Hermes plugins catalog. According to a related post, TinyFish is added as a first-party Hermes plugin that lets agents search and fetch the live web for free, and it can be installed with hermes plugins install tinyfish.

  3. meng shaoXAI score77

    Theo open-sources tsc-rs, a Rust port of the TypeScript 7 compiler

    AITheo, creator of the T3 Stack, open-sourced tsc-rs, a line-by-line Rust port of Microsoft's Go-native TypeScript 7 compiler, type checker, and language server under MIT, pinned to typescript-go commit 673a5f17. The author reports tsc-rs is about 1.61× faster than tsc 7 and about 2.95× faster than bun check on six real-app benchmarks on an Apple M4 Pro. The port passes all 181,711 ported Go tests, and CLI output matches the Go version on 120 open-source repos except for known edge cases such as monorepo rootDir and tsc -b incremental output.

    Why it matters: The post reports a benchmarked, test-verified Rust port of the TypeScript 7 compiler, with pinned upstream and stated edge cases useful for judging its compatibility.

    Image from @shao__meng's post
  4. Jerry LiuXAI score38

    LightOn OCR-3 now on OpenDocRouter, near Gemini 3.8 Flash at lower cost

    AILightOn OCR-3 is now available on OpenDocRouter at $0.28 per 1M input tokens and $1.40 per 1M output tokens, about $3.19 per 1k pages on ParseBench. On ParseBench, the author says it sits on the Pareto frontier for open-weight OCR models, with performance similar to Gemini 3.8 Flash low at roughly 45% lower price. It is described as decent at tables, workable for charts, and quite good at grounding.

    Image from @jerryjliu0's post
  5. AnshuXAI score38

    Pocket Aces: open-source Pokémon-Balatro roguelike game with swappable IP

    AIDeveloper Anshu Chatterjee has open-sourced Pocket Aces, a Balatro-style poker roguelike that replaces all Pokémon IP with original characters. The Pokémon assets are modular and can be swapped back in from the PokeAPI repo, though the developer notes the user proceeds at their own risk. The post says the game now works on mobile with reduced-motion options, and the developer is willing to address further bug reports.

    Video from @anshuc's post
  6. elvisXAI score42

    Voyager: an open harness for creative AI work across video and games

    AIElvis Saravia argues that creative work needs domain-specific agent harnesses rather than coding-oriented ones, and he highlights Voyager as an open harness for video, graphics, and games. According to the quoted post, Voyager lets agents work with local files and drive apps such as Blender, DaVinci Resolve, and Unity, and it is designed to work with models like Opus, Astra, and DeepSeek.

    Video from @omarsar0's post
  7. Alexander DoriaXAI score46

    LightOnOCR-3 claims state-of-the-art OCR performance under 1B parameters

    AILightOn has released LightOnOCR-3, a family of OCR models in 0.8B and 4B versions that it says lead benchmarks including OlmOCR-Bench and ParseBench, with the 0.8B model positioned as the sub-1B option. The models recognize text, handwriting, images, charts and document structure in one pass, process documents up to twice as fast as LightOnOCR-2, and are released under the Apache 2.0 license.

    Image from @Dorialexander's post
  8. Dhravya ShahXAI score42

    MemoryRepo: open-source implementation of Cognition's dreaming agent memory

    AISupermemory introduces MemoryRepo.dev, an open-source implementation of Cognition's dreaming memory system built on Cloudflare Artifacts, Durable Objects, Alchemy, and Effect. The project follows Cognition's Devin memory design, which builds a memory graph across sessions and prunes stale records overnight. Supermemory says it will incorporate learnings from this research into its own product.

    Video from @DhravyaShah's post

Oct 7

Oct 7Wed
  1. MarkTechPostNewsAI score58

    Unsloth Studio re-checks changed model repos and blocks flagged weights before loading

    AIUnsloth Studio binds remote-code approval to a fingerprint of the scanned code, so changed code requires fresh consent before it runs. It also blocks weight files that Hugging Face has flagged for malware in the path the selected loader would deserialize. The article describes these checks as one layer among several, alongside package-content scans and OS sandboxes, and notes that the scanner is not a sandbox and cannot catch every evasion.

  2. InferactOfficialAI score38

    Inferact and partners cut vLLM TTFT nearly 70% at ~100K throughput

    AIInferact, working with DeepSeek, NVIDIA, and SemiAnalysis alongside the vLLM community, says joint work across models, custom kernels, and engine serving cuts time to first token (TTFT) by nearly 70% at ~100K throughput. vLLM is the open-source inference engine, and Inferact optimizes it for enterprise production deployments.

  3. Ars Technica · AINewsAI score46

    Artcraft releases open source clones of Adobe Photoshop, Premiere and other apps built with Claude

    AIDeveloper Brandon Thomas's Artcraft has launched seven open source apps in Rust that aim to replicate the interfaces and tools of Adobe Photoshop, Illustrator, Premiere, Lightroom, After Effects, InDesign, and Acrobat Pro. Thomas said he used Anthropic's Claude Opus 5.5 to build the clean-room replacements, with WebAssembly versions available for browser use. The apps remain in a "super early alpha" state, and commenters have pointed out many current shortcomings.

  4. vLLMOfficialAI score22

    vLLM and NVIDIA cut TTFT nearly 70% at ~100K throughput

    AITogether with DeepSeek's model and kernels and NVIDIA's collaboration, vLLM reports that time to first token (TTFT) drops nearly 70% at roughly 100K throughput. The post credits Inferact and the vLLM community for the work and thanks SemiAnalysis for AgentX.

  5. Daniel HanXAI score48

    Unsloth enables local training of decision models on 3GB VRAM

    AIUnsloth now lets users train their own decision models locally on just 3GB of VRAM by fine-tuning Qwen, Gemma, and Llama with a Clef head. The post says this raises accuracy from 30% to as high as 78%, and the tool is available through Unsloth Desktop.

    Video from @danielhanchen's post
  6. LlamaIndex 🦙OfficialAI score47

    LlamaIndex launches OpenDocRouter, one API for many document parsing models

    AILlamaIndex announced OpenDocRouter, a single API that routes document parsing requests to any of 10 frontier and open-source models at launch, including Claude Opus 5.5, Gemini 3.8 Flash, GPT-6 Luna, MinerU2.5-Pro, and PaddleOCR-VL-1.6. Users can switch models in one line with the same request and markdown output, and each model is scored on ParseBench for quality and cost. Pricing is per-token, failed pages are not charged, and the service costs $0.86 to $48.82 per 1,000 pages depending on the model.

    Video from @llama_index's post
  7. Teknium 🪽XAI score36

    Community brings Hermes Gadget SDK to LilyGO, AIPI Lite, and old Android phones

    AIDevelopers are running Hermes on devices such as LilyGO watches, AIPI Lite, desk gadgets, and old Android phones after the Hermes Gadget open SDK and demo were released three days ago. The post credits @NousResearch and says more boards are landing on main through contributor PRs, with the SDK available on GitHub.

  8. The Register · AINewsAI score38

    COSMIC bans AI-generated contributions as GNOME debates accepting AI bug reports

    AISystem76's COSMIC desktop now requires contributors to declare no LLM-generated content in pull requests, including code, comments, and descriptions. GNOME Calendar and GNOME Extensions also restrict AI-generated contributions, while GNOME developer Michael Catanzaro argues the project should accept AI-generated bug reports. Catanzaro's case rests on memory-unsafe languages such as C, C++, and Vala, and he has shortened GNOME Security's disclosure deadline from 90 days to 30, effective August 1.

  9. Teknium 🪽XAI score20

    Teknium Calls for Plugin Catalog Listing of Altryne's Project

    AITeknium says a plugin from @altryne's current project should be added to the plugin catalog. The post is a brief endorsement and does not describe the plugin's functions. Background from @tonysimons_ says Hermes is getting a local video editor for editing user footage with 42 FFmpeg scripts and no cloud or API key required.

Oct 6

Oct 6Tue
  1. Epoch AIOfficialAI score47

    GPT-6 Astra Hit 100% on EBR-bench Using a Card That Bypassed Its Time Limits

    AIEpoch AI reports that GPT-6 Astra scored 100% on the original EBR-bench by exploiting a card that bypasses the game's time-constraint expectations, so Epoch has banned that card from the default setting. Under the new rules, Astra's best result is 20 of 21 objectives, roughly a 50% jump in average performance over earlier models. Epoch will report revised scores only for Claude Fable 5.1, Claude Opus 5, GPT-5.6 Sol, GPT-6 Astra, and future models.

  2. SGLangOfficialAI score62

    SGLang adds support for Kandinsky 6.0 Video audio-visual generation

    AISGLang now supports Kandinsky 6.0 Video, which generates video and synchronized audio together from text or an image. The model comes in Lite (3B) and Pro (29B) sizes, with built-in super-resolution up to 1920×1080. A sample sglang serve command for the Pro distilled model is included.

    Why it matters: The post shows the exact serve command and model size options, which lets engineers judge whether this open video model fits their hardware and pipeline.

    Image from @sgl_project's post