#Deployment/Engineering

AISpaceXAI says its combined support team handled a 175% rise in tickets without hiring, crediting Grok Bot, which it says would otherwise have required about 200 additional staff. The company reports resolving tickets for $0.20 to $0.30 each, versus the $1 to $4 per resolution it attributes to traditional AI support tools. Grok Bot is also reported to resolve 99% of refund requests without human intervention.

AIvllm-metal ports vLLM's scheduler, paged KV cache, and OpenAI-compatible server to Apple Silicon, with MLX and Metal handling execution. The v0.28.0 release added batched MTP, GGUF and hybrid-model support, and faster prefill on M5, and v0.29.0 is installable through Homebrew.

Why it matters: The post explains how vllm-metal packs requests and pages KV cache on Apple Silicon, with benchmarks showing where concurrent serving gains and tradeoffs appear.

AIAmp runners can now create Git worktrees from the directory picker, with each new worktree placed as a sibling folder on a new branch off the current HEAD while uncommitted changes stay in the original checkout. Runners can also opt in with --amp-env to inject Secrets & Env Vars configured on ampcode.com into thread shell commands, MCP servers, and plugins, with changes applied to the next thread without a restart.

AIGoogle AI subscribers now get premium Colab benefits, including priority access to faster accelerators and more powerful machines. Google AI Ultra subscribers also get uninterrupted background execution and Premium GPU access for long training runs. The benefits roll out over the next few weeks in Colab-supported countries, and existing Colab subscriptions are unchanged.

AITogether AI's canary rollouts shift production traffic between two model deployments on the same endpoint in staged percentages, with optional metric gates between steps. Operators can choose canary, blue-green, or rolling strategies, and a rollout starts only when explicitly launched; it can be paused, canceled, or reversed. The platform scales the target before moving traffic and waits for routing to converge before draining the source.

AIFireworks AI launched the Specialized Intelligence Index, which compares open, closed, and specialized models on domain benchmarks in seven initial areas: healthcare, legal, cybersecurity, finance, customer support, productivity, and software.

AIVercel is offering 40% off AI Gateway usage for Grok 4.7 until September 27, with the discount applying to projects built with v0, Eve, and fx. The post promotes building with Grok 4.7 on Vercel at reduced cost and links to the changelog for details.

AIFrançois Chollet argues that engineers can delegate coding to AI but must never delegate understanding. He says that if code was previously the source of truth for understanding a system, teams need a new source-of-truth artifact and new workflows to replace code-centric practices.

AIFive companies are using NVIDIA AI, digital twins, and accelerated simulation to help build a lower-carbon grid. The examples span fusion energy to repurposed EV batteries, according to NVIDIA's thread introducing these clean energy innovators.

AIXiaomi's MiMo-V2.6-Pro UltraSpeed is now available in MiMo Desktop and through the API, delivering up to 20× faster generation. MiMo Desktop and membership plans launch alongside Pro and Flash, and users can run both models via subscription or their own API key. API pricing remains unchanged from V2.5.

AIRadixArk says its Miles framework uses an async rollout buffer that can change which sample groups reach training and which prompts get retried, while reusing the rollout worker and trainer. The post argues that stable, granular extension points let contributors modify one part of an RL system without disrupting its neighbors.

AIAmazon Bio Discovery developed three AI approaches for antibody drug design: MochiBind for sequence-based affinity ranking, CA-MAP for developability prediction with batch effect correction, and an agent-guided design system. The agent-guided system produced 46 lab-validated hits against a novel cancer target.

AIMike Knoop notes that logprobs used to be widely exposed by LLM inference APIs and sees the market maturing so that parts of the LLM stack can be packaged in new, useful ways. He links this to Bryan Helmig's post on prompting with max_tokens: 1 plus logprobs for fast, parallel judgments, which Helmig says has a lot more depth than he expected.

AIThe article explains how Mixture of Experts models change inference by making prefill, midfill, decode attention, and decode experts distinct workloads. It describes how KV cache state, expert routing, and parallelism choices shape compute, memory, and network demands across an inference cluster.

AIAmazon Science describes three papers on AI for antibody discovery: MochiBind ranks antibody binding strength from sequence alone, CA-MAP predicts developability properties using batch-aware context, and an agent-guided pipeline designed nanobody binders against a novel cancer target. In the pipeline, 116 candidates survived lab screening, and 46 were identified as strong binders, which are being used to train the next design cycle.

Why it matters: The source reports the method, benchmark setup, and experimental validation in a single design workflow, showing how predictors, agents, and lab screening connect in antibody discovery.

AILMSYS Org shared a blog post about NVFP4 KV cache, a topic linked from its 2026-09-16 article. The post itself contains only a link, so no further technical details, figures, or results can be confirmed from this source.

AIThe post links to an official xAI news page for more details.

AIMeta has open-sourced Rebalancer, an assignment-problem solver it has used for over nine years to allocate resources across its infrastructure. The library separates problem specification, in-memory storage, solving, and debugging, and translates problems into expression graphs solved via local search or mixed integer programs using FICO Xpress, Gurobi, or the open-source HiGHS solver.

AIMicrosoft Research published RetroChimera, a retrosynthesis framework that combines the R-SMILES 2 Transformer model and the NeuralLoc graph neural network through learned ensembling to propose synthesis routes for small molecules. In blind tests, PhD-level chemists preferred its individual reaction predictions over those from preceding models and recorded literature reactions. The implementation and weights are open-sourced for researchers developing new medicinal molecules and materials.

AITim Dettmers argues that academic labs can do their most important AI research by building coherent open-source ecosystems rather than competing on GPU scale. He describes his lab's upcoming open-source week, including an agent harness that optimizes kernels autonomously, local inference of large Qwen and DeepSeek models on consumer hardware, and an auto-compaction technique called CliffCompaction that he says cuts costs by about fifty percent.

AIIQAX has surpassed one million electronic Bills of Lading (eBLs), built on the GSBN blockchain and supporting DCSA, BIMCO, and ISO standards. The company is combining AI, IoT, and digital twins to move supply chain management from visibility toward predicting risks, with its AI-powered IoT platform covering more than 200 regions and 11,000 city pairs and about 92,000 connected devices.

AIA research-agent design has GPT-6 orchestrating while MiniCPM5-2B runs locally on DGX Spark to read sources and extract traceable evidence. The post presents this as an example of pairing frontier reasoning with compact, efficient models for transparent research workflows.

AIA community developer integrated the Jev method into MiniMax H3 to sparsify attention, deciding per layer which parts to keep. On an RTX 4070, video generation time dropped from 6 min 7 sec to 3 min 34 sec, a 41.7% reduction. The post notes that Jev selected sparsity rates of 1%, 3%, 5%, and 10% across 49 layers in 4-step generation.

AIMatei Zaharia, a prominent AI researcher, said it is very cool that GEPA works on Jev. The post is a short endorsement, linking to background about a test in which GEPA optimized Jev's prompts for extracting suspected adverse drug effects from medical sentences.

AIOpenMed reports that MiniCPM5-2B, run on a local Mac, correctly kept naproxen in medication history rather than the current-medication export after a newer note said it was stopped. Every graph connection in the run links back to its source, using fictional clinical notes.

AISGLang-Diffusion now serves Qwen-Image-2.1 for text-to-image generation, multi-image editing, and transparent RGBA output. The quoted SGLang post reports 1024×1024 generation in 18.7s and editing in 21.7s on a single RTX 4090 24GB with CPU offload, using 22.7 GiB peak GPU memory, with no quantization.

AIQwen-Image-2.1 is now available as a live Hugging Face Spaces demo, letting users try image generation and editing in the browser without setup. The demo runs on a single checkpoint that handles both tasks. Background notes describe a 7B-parameter model supporting up to 10 image references, with integration into diffusers and ComfyUI.

AIFireworks AI reports that an oracle router choosing among 18 models per DeepSWE task reaches 97.6% at $1.88 per task, versus 74.1% at $6.52 for GPT-6 Astra alone. The oracle is hindsight-based, so the authors say a production router must predict the best model before the task starts, which is the harder problem.

AIvLLM achieved 5000 total token throughput per GPU in high-throughput PD serving of Qwen3.8-2.4T on a GB300 NVL72 cluster under an 8K/1K workload. The low-latency scenario reached 180 generated tokens per user, with both results shown on the Pareto frontier. The post also provides srt-slurm recipes and explains the tuning process used to create them.