Updated
Updated
Items with an AI score under 20 are hidden. Show low-relevance items
AIIndexTeam has published an official NVFP4 (W4A4) quantized version of its Index-Echo-S2TT-2B speech-to-text translation model on Hugging Face. Only the text LLM backbone is quantized, while the audio tower, connector, and speech-synthesis components remain in BF16. Perplexity rises 5.80%, from 4.8772 to 5.1599, on a fixed corpus, and full FP4 speedup requires an NVIDIA Blackwell GPU.
AIIndexTeam released Index-Nailong-9B-FP4, an official NVFP4 (W4A4) quantization of the Index-Nailong-9B multilingual translation model, which covers 150 languages. In a validation on an NVIDIA A100 against the BF16 checkpoint, perplexity rose 3.10% (2.4339 to 2.5094), and zh-en and en-zh outputs were semantically equivalent. Full FP4 compute acceleration requires an NVIDIA Blackwell GPU, while older GPUs get memory savings only; the FP8 build is recommended for Hopper and Ampere.
AIIndexTeam has released Index-Nailong-2B-FP4, an official NVFP4 (W4A4) quantization of its Index-Nailong-2B multilingual translation model, which supports 150 languages. The checkpoint keeps lm_head, embeddings, and MoE router gates in BF16, and a perplexity test on a fixed corpus rose from 3.2806 to 3.4998 (+6.68%), while zh->en and en->zh outputs matched BF16 semantically. Full FP4 acceleration requires an NVIDIA Blackwell GPU; on Hopper or Ampere, vLLM provides only memory savings, so the FP8 build is recommended.
AIIndexTeam released Index-Homura-9B-FP4, an official NVFP4 (W4A4) quantization of the Index-Homura-9B translation model from the Index-Translate family. On a fixed corpus, perplexity rose from 2.5386 in BF16 to 2.6245, a 3.38% increase, and zh->en generations matched the original. Full FP4 compute acceleration requires an NVIDIA Blackwell GPU, while older GPUs get only weight-only memory savings and the FP8 build is recommended for them.
AIIndexTeam released Index-Homura-2B-FP4, an official NVFP4 (W4A4) quantization of its Index-Homura-2B multilingual translation model, which supports 150 languages. The quantized checkpoint shows a 5.73% perplexity increase over the BF16 original (3.5011 to 3.7017) on a fixed corpus, and its zh-en and en-zh outputs are semantically equivalent under greedy decoding. Full FP4 acceleration requires an NVIDIA Blackwell GPU, while the source recommends the FP8 build for Hopper and Ampere hardware.
Cohere@cohereOfficialAI score55AIAleph Alpha has released Kolibri, a model with 78B total parameters, 3.46B active, and up to 1M tokens of context, under Apache 2.0. The quoted post says the weights can be run on the user's own hardware. Cohere's own post is a short endorsement of the release.
Amjad Masad@amasadXAI score42AIAmjad Masad of Replit and Alex Atallah of OpenRouter discuss why AI independence and model diversification matter for enterprises. They argue that depending on a single lab risks lock-in and that specialized agents may outperform one general superagent. The post presents the conversation as a podcast episode, the first Atallah has done since Stripe acquired OpenRouter.
Nathan Lambert@natolambertXAI score38AINathan Lambert says it is a huge failure of the AI ecosystem that people respond to some unspecified situation with accusations of evil and shame. He says he will work to shift those norms, arguing that positive paths forward exist even though the path will be hard.
SemiAnalysis@SemiAnalysis_XAI score34AIAMD has reached above 90% parity on upstream vLLM gating test groups this week, according to SemiAnalysis. The milestone followed months of work by AMD maintainers, including Andreas, and vLLM CI lead Kevin, plus SemiAnalysis supplying additional AMD GPUs to vLLM CI.
Aidan Gomez@aidangomezXAI score46AIAlephAlpha has released Kolibri, a German-English model with 78B total parameters, 3.46B active, and context up to 1M tokens. The weights are available under Apache 2.0 for running on users' own hardware. Cohere's Aidan Gomez congratulated the team on the model and its detailed technical report.
AMD@AMDOfficialAI score20AIAMD made 502 commits to core vLLM over 90 days, accounting for 13% of all organizational contributions and almost four times Nvidia's count. The company credited Red Hat, IBM, Embedded LLM, and Inferact for building the project alongside it.
Khazix@Khazix0918XAI score38AIThe creator Khazix open-sourced AIHOT, a monthly-active-million AI hot-news site, including its collection workflow, curation scoring, clustering mechanism, and production prompts. The main post reports the project gained 5.1K GitHub stars within a few days and thanks supporters on X.
Orange AI@oran_geXAI score55AIThe author reports that a dual RTX 5070 Ti setup running Qwen Flash rose from 200 prefill and 10 decode to 2200 prefill and 67 decode, now on a single card, using Strata and a custom PR. The post argues that such consumer-hardware speeds, once limited to top-end machines, could pressure the economics of selling model compute via API.
OpenClaw🦞@openclawOfficialAI score23AIOpenClaw v2026.9.8 is released with support for GPT-6.1 Sol, agent replies that return to their original conversation, and lower memory use. The release also includes update and Windows startup fixes, covering 43 PRs from 8 contributors.
vLLM@vllm_projectOfficialAI score31AIvLLM Semantic Router has released Decision 2.0, featuring open models ranging from 0.6B to 27B parameters. The models can answer 64 questions about a request in a single forward pass, are licensed under Apache-2.0, and load with Transformers.
ollama@ollamaOfficialAI score29AIOllama now offers Cloudflare's decision models, Clef (27B) and Clef Flash (9B), which classify images, label bug reports, and route support tickets. Users can run them locally with the commands ollama pull clef and ollama pull clef-flash.
NVIDIA AI@NVIDIAAIOfficialAI score33AINVIDIA's Nemotron 3 Diarization model identifies who spoke when, including during overlapping speech, and is now available on Hugging Face. It supports up to eight speakers and has 100M parameters. The post thanks users for downloads and trending activity and shares a follow-up answering community questions.
Prime Intellect@PrimeIntellectOfficialAI score43AICMU researchers released SMDD-Bench, a benchmark of 502 small-molecule drug design tasks that use RDKit, ADMET-AI, and Boltz-2 as feedback loops. The authors argue that long-horizon planning, exploration, and learning from imperfect feedback remain open problems beyond math and coding, and the benchmark is available in Prime Intellect's Environments Hub for training with prime-rl.
OpenClaw🦞@openclawOfficialAI score36AIOpenClaw has integrated Tencent Hunyuan's AI-Infra-Guard (AIG) into ClawScan, its open-source command-line security tool. Every skill and plugin uploaded to ClawHub now runs through AIG as part of its security review.
Prime Intellect@PrimeIntellectOfficialAI score20AIPrime Intellect reports that DEP8 provides about 5x the prefix-cache capacity of TEP8 on the same GPUs. The post argues that fast KV retrieval alone does not ensure fast first tokens, since cached KV often sat ready while requests waited to join a batch. Halving the prefill budget reduced median queue wait time and time to first token (TTFT).
Prime Intellect@PrimeIntellectOfficialAI score38AIPrime Intellect compresses the MLA latent KV cache to NVFP4, reducing each row from 576 to 352 bytes. This fits about 50% more cached tokens per decoder compared with FP8. Its native sparse-MLA kernel unpacks the format on-chip, and the company is contributing that kernel to FlashInfer as an experimental operation.
Prime Intellect@PrimeIntellectOfficialAI score38AIPrime Intellect served GLM-5.3 on GB200 NVL72 while targeting 100+ end-to-end tokens per second per user for concurrent agent tasks. At that interactivity bar, a 1:4 prefill-to-decode ratio delivered the most throughput, supporting 66 sessions per prefill group at 101 tokens/s per user and 100 output tokens/s per GPU.
Prime Intellect@PrimeIntellectOfficialAI score38AIPrime Intellect says its production stack now processes roughly 600B tokens daily on its own compute. The company also states its GLM-5.3 deployment ranks among the fastest GLM-5.3 endpoints on OpenRouter.
Vercel@vercelOfficialAI score22AIVercel has added Jev to the AI SDK for Python. The team tested it in two experiments: detecting whether typed text is Python or English as it is entered, and writing Python one decision at a time.
Together AI@togethercomputeOfficialAI score25AIAt an event, @zainhas and @parthsareen of Ollama discussed evaluating open models against production traffic rather than relying only on benchmarks. The post offers no further details on methods, models, or results.
Guillermo Rauch@rauchgXAI score34AIMuse has released Muse Gadgets, an open-source ESP32 firmware and Linux SDK for building hardware devices that work with Muse. Developers can obtain an API token from gadgets.muse.ai and use a coding agent with the GitHub repo to build peripherals. Guillermo Rauch praised the team's rapid shipping.
Muse@MuseOfficialAI score33AIMuse has released Muse Gadgets, open-source ESP32 firmware and a Linux SDK for building hardware devices that work with Muse. Developers can get an API token at gadgets.muse.ai and use a coding agent with the GitHub repository to build custom peripherals.
Aravind Srinivas@AravSrinivasXPickAI score62AIPerplexity has released several open source projects, including the pplx-decider-v1-27b multimodal decision model, the pplx-embed-v2-context-9b-preview contextual embeddings model, and the Lily local inference engine for Apple silicon. The post also lists the 0.6B on-device PII-Tracer classifier with its PII-TRACE benchmark, the WANDR research agent benchmark, and the Numbat and Bumblebee security tools, and says more open source releases are coming soon.
Why it matters: The post lists several named open source releases with specific benchmark figures, helping readers scan which tools and models Perplexity has recently published.
AIThe vLLM team integrated Helion, a PyTorch-native kernel DSL, into vLLM's linear backend, using per-shape autotuning to select among Standard GEMM, Split-K, and Swap-AB variants. On NVIDIA Hopper GPUs, the Helion backend outperformed the default CUTLASS and DeepGEMM backends across the evaluated models, with more than 10% throughput gains for some workloads. The work focuses on FP8 and INT8 quantized GEMM.
SGLang@sgl_projectOfficialAI score38AISGLang has released v0.5.20, bringing Intel XPU into standard releases alongside RL sampling masks that make rollouts more reliable with up to 52% faster decode. The update also adds Unified Radix Tree SWA branching-point caching, which the project says lifts cache hit rate about 20 points and cuts TTFT by roughly one-third, plus up to 12.5× faster ROCm model loading. New models named in the release include GLM-5.3-Flash, Qwen3.8-Flash-Next, K2 Horizon, Hy4-Preview, FastH3, and VDN-H3.
SGLang@sgl_projectOfficialAI score39AISGLang's update adds a /v1/score endpoint that returns scores for requested labels such as Yes/No or A/B/C, avoiding the label loss of generate with top-k logprobs. Its multi-item scoring computes shared context once and keeps each candidate isolated, with 16-candidate p95 on Qwen3-8B dropping from 54.1 ms (Generate) to 20.6 ms.
SGLang@sgl_projectOfficialAI score28AISGLang demonstrated Qwen3.8-27B as a multimodal decision model that beat Pokémon FireRed's Elite Four and champion with sub-100 ms decisions from live game state. The company says its native /v1/decisions API lets LLMs and VLMs be used for classification and scoring. It also announced /v1/systemone for running Jev-like open models with the TypeSafe SDK.
SGLang@sgl_projectOfficialAI score58AISGLang has released v0.5.21 with a native Decisions API that turns an LLM or VLM into a low-latency classifier and scorer. The release also lets /v1/score rerank search or RAG results in one call, lets PD instances switch between prefill and decode without restarting, and adds support for models including DeepSeek-V4.1 Flash, Kimi K3, and GLM-5.3-Flash on AMD MI355X. The announcement reports a 22% faster first token on long prompts for DeepSeek-V4.1 Flash and 20.6% higher prefill throughput for Kimi K3 in PD serving.
eric zakariasson@ericzakariassonXAI score47AIxAI has released an experimental TypeScript SDK, installable via npm install @xai-official/sdk, that covers text, voice, image, and video in one package. It provides access to the latest Grok models along with server-side tools including real-time X search, web search, code execution, and remote MCP.
Databricks@databricksOfficialAI score44AIDatabricks' new open-source meta-harness, Omnigent, lets multiple coding agents such as Claude Code and Codex share sessions, rules, and security policies in one system. A walkthrough by @leonvz demonstrates forking work across agents, multi-agent review and debate with Debby, and splitting implementation across subagents with Polly.
ChatGPT@ChatGPTOfficialPickAI score60AIChatGPT's Finances feature is rolling out to Free and Go users in the U.S. Users can securely connect their accounts through Plaid and Experian to get answers based on their own financial information.
Why it matters: The post names the rollout scope and the account connection method, which helps readers judge how the feature handles personal financial data.
François Chollet@fcholletXAI score28AIKeras is moving to a pluggable backend design, with MLX and PaddlePaddle backends upcoming as add-on libraries. The team is reducing the operations needed to ship new backends and streamlining unit testing so a single harness can test all ops, such as casting consistency. KerasHub also gains many new models and is shifting its preprocessing from tf-text to PyGrain.
TypeSafe AI@typesafeaiOfficialAI score22AITypeSafe AI shows how to build long-document search by combining its Jev with PageIndex, with no vector database or embeddings required. The project is open source on GitHub under VectifyAI's jev-doc-search repository.
NVIDIA AI@NVIDIAAIOfficialAI score40AINVIDIA reports that fine-tuning Nemotron 3.5 ASR reduced word error rate on Najdi and Hijazi Saudi Arabic from 55% to 30%. The post says a new tutorial shows how to adapt the model for other dialects and languages.
Nathan Lambert@natolambertXAI score35AINathan Lambert and Tom Zick have unveiled Trillium Labs, a new non-profit focused on the open science of frontier AI. The lab plans to build open post-training recipes and expand into open infrastructure to study topics such as RSI, reward hacking, and multi-agent systems. It is hiring, fundraising, and seeking compute, with support from Halcyon Futures and Schmidt Sciences.
