Skip to contentSkip to stories

Updated

#Deployment/Engineering

Items with an AI score under 20 are hidden. Show low-relevance items

Sep 29

Sep 29Tue
  1. vLLMOfficialAI score58

    IQuest-Q1 320B MoE coding model gets day-0 support in vLLM

    AIvLLM announced day-0 support for IQuest-Q1, a 320B-parameter MoE model with 15B active per token, 256 experts with 8 active, and a 524,288-token context. The post credits existing vLLM features such as the hybrid KV cache coordinator, sinks attention path, and EAGLE speculative decoding with probabilistic draft sampling. The linked material includes a Docker image and vllm serve commands, with and without recursive MTP.

    Image from @vllm_project's post
  2. Azure BlogOfficialAI score75

    Microsoft announces Fabric IQ in Copilot, Power BI agentic app creation, and new Fabric and SQL updates

    AIMicrosoft announces new Microsoft Fabric and SQL Server updates at FabCon and SQLCon in Barcelona, including Fabric IQ integration with Microsoft Copilot Chat and Cowork, now generally available. Power BI agentic app creation enters preview in the coming weeks for Pro and Premium Per User customers, with Fabric Apps database capabilities up to 1 GB per app at no additional cost.

    Why it matters: The post lists dozens of Fabric and SQL updates tied to Copilot and agents, with specific availability and pricing terms for Power BI customers that help readers judge what applies to them.

  3. Thomas WolfXAI score29

    Thomas Wolf calls a post simply "impressive"

    AIThomas Wolf, owner of the Hugging Face account, posted the single word "impressive" in response to a quoted post. The quoted post reports a new NanoGPT training record of 39.9s, down 27.7s from the prior 67.6s, achieved through per-flop optimizations such as sampled softmax and sparse updates.

  4. SGLangOfficialAI score53

    SGLang adds Day-0 support for IQuest-Q1 with a single-node serve command

    AISGLang says it has Day-0 support for IQuest-Q1, an open-source sparse MoE model with 320B total and 15B active parameters for coding and agentic tasks. The post includes a single-node serving command for H200 GPUs in BF16, using tensor parallelism of 8, EAGLE speculative decoding, and the iquest_q1 reasoning and tool-call parsers. The image marks the command as not verified.

    Image from @sgl_project's post
  5. Matei ZahariaXAI score36

    Matei Zaharia says autoresearch results are going into serving stack

    AIMatei Zaharia said autoresearch produced strong results that are being integrated into a model serving stack. The post gives no specific figures, benchmarks, or product names. Background context from a related post says Databricks ranked #1 on NVIDIA's SOL-ExecBench kernel leaderboard across all four tracks using agents.

  6. howie.seriousXAI score23

    Qwen3-VL 32B tags 40,000 Eagle images on a 128GB Mac

    AIA user ran qwen3-vl:32b-instruct locally through Ollama on a 128GB computer to auto-tag 40,000 images in their Eagle app. The image library was collected over 10 years and is intended as a personal asset base for Claude Code-made knowledge videos. The user says the use case makes the 128GB memory purchase feel worthwhile.

    Image from @howie_serious's post
  7. Mastra BlogOfficialAI score42

    Mastra Adds Memory Hooks to Observe and Modify Agent Memory Cycles

    AIMastra has added memory hooks that let developers monitor or alter an agent's observational memory cycles. Lifecycle hooks such as onObservationStart and onReflectionEnd report on each cycle, including token usage for spotting cost spikes, while transform hooks like beforeObservation and afterReflection can prune, remove, or redact memory data.

  8. Artificial Analysis ArticlesOfficialAI score62

    Artificial Analysis open-sources AA-AgentPerf-Local for benchmarking local AI agents

    AIArtificial Analysis has open-sourced AA-AgentPerf-Local, a tool that replays recorded agent trajectories to measure inference speed on laptops and workstations. Initial results cover NVIDIA DGX Spark, NVIDIA GeForce RTX 5090, AMD Ryzen AI Halo, and MacBook Pro M5 Pro, with the RTX 5090 fastest for models that fit its 32 GB. The source states the tool and leaderboard will expand to more hardware, frameworks, and models.

    Why it matters: The source gives per-system completion times and memory bandwidth figures, letting readers compare local hardware for running agentic workloads.

  9. Manus BlogOfficialAI score50

    Manus Flex lets users connect their own API keys to the Manus workspace

    AIManus is launching Manus Flex, a module that lets users power Manus agents with their own API key from a supported inference provider. Model inference is billed directly by that provider, while other services used in Manus tasks still consume Manus credits. OpenRouter, Fireworks, and Modal are announced as initial inference partners for the Flex Inference Partner Program.

  10. Luma AI NewsOfficialAI score22

    AI Photo Editing Prompt Formula Preserves Color, Light, and Skin in Campaign Edits

    AIThe article presents a four-part prompt structure (action verb, target element, desired result, protection instructions) for AI photo editing, saying it preserves approved work across platforms. It identifies three common failure causes: unmatched light direction, stacked edits in one prompt, and vague visual language. It states that simple skin retouching takes 2-3 minutes versus 15-30 minutes manually.

Sep 28

Sep 28Mon
  1. ModelScopeOfficialAI score44

    Audio8 ASR Infinite enables unlimited-length streaming speech transcription with bounded memory

    AIAudio8 ASR Infinite transcribes Chinese and English audio of unlimited length using a rolling KV Cache that avoids accumulated drift. At a 480 ms delay, it reports 1.75 CER on AISHELL-1, 2.89 on AISHELL-4, and 3.04/6.81 WER on LibriSpeech test-clean/test-other. The preview release is under Apache 2.0, with deployment through an adapted vLLM stack.

    Video from @ModelScope2022's post
  2. clem 🤗XAI score23

    AMD acquires World Labs, led by Fei-Fei Li, for AI world models

    AIAMD is bringing World Labs and Fei-Fei Li into its organization, according to Lisa Su's post, which says the combination will pair World Labs' AI and world-model expertise with AMD's compute leadership. Hugging Face co-founder Clément Delangue congratulated the team and said he looks forward to what they will build in the coming years.

  3. KrASIA · Big TechNewsAI score47

    Alibaba unveils Zhenwu V900 AI chip, targets 20 GW data center capacity by 2032

    AIAlibaba unveiled the Zhenwu V900 AI chip at its 2026 Apsara Conference, claiming three times its predecessor's performance and support for clusters of up to 500,000 cards. The company is pursuing data center capacity beyond 20 gigawatts by 2032 and has committed RMB 380 billion in capital spending over three years.

  4. KreaOfficialAI score22

    Seedance 2.5 Draft Mode now available on Krea

    AIKrea has launched Draft Mode for Seedance 2.5, letting users experiment with 480p generations before switching to 1080p once a scene is right. The post directs readers to try the feature on Krea's platform.

    Video from @krea_ai's post
  5. vLLM BlogOfficialAI score54

    vLLM guide explains disaggregated serving for prefill and decode

    AIThe vLLM blog guide explains how separating prefill and decode, and moving tokenization to a CPU-only render tier, can keep token streams from stalling under load. In a two-L40S test on Qwen2.5-7B, collocated p99 inter-token latency reached 169 ms at 0.4 req/s while disaggregated serving stayed between 25 and 52 ms. The guide notes that the gain depends on fast KV cache transfer, and it includes setup code for NIXL-based serving and the render/derender API.

  6. Amp NewsOfficialAI score34

    Amp Adds Plaid Speed for GPT-6 Astra Modes at 6x Speed and Cost

    AIAmp now supports Plaid speed for modes that use GPT-6 Astra, using OpenAI's ultrafast tier to run inference up to 6× faster at 6× cost per token. Plaid works only with Amp-provided inference, not linked ChatGPT subscriptions, and subagents and non-Plaid inference fall back to fast or standard speed.

  7. DatabricksOfficialAI score38

    Claude Sonnet 5.5 now available on Databricks across AWS, Azure, GCP

    AIDatabricks now offers Anthropic's Claude Sonnet 5.5 on AWS, Azure, and GCP, governed through Unity Gateway. The post says Sonnet 5.5 is more efficient than Sonnet 5 for coding and agentic use and reaches Opus 5-level accuracy on document understanding, parsing, and search. It joins Claude Opus 5.5, Claude Fable 5.1, and 60+ other open-source and frontier models on the platform.

    Video from @databricks's post
  8. SpaceXAIOfficialAI score46

    Grok 4.7 is now available on Amazon Bedrock

    AIaccording to the SpaceXAI account, which is operated by xAI and Grok. The post gives no further details on pricing, context length, or benchmarks.

    Video from @SpaceXAI's post
  9. IEEE Spectrum · AINewsAI score25

    Charlie Kemp Builds Assistive Mobile Robots to Help People Live Independently

    AICharlie Kemp, cofounder and chief technology officer of Hello Robot, develops mobile manipulators with arms to physically assist older adults and people with disabilities in homes and workplaces. His work began with humanoid robots at MIT and led to assistive robotics research, including a collaboration with Henry Evans through the Robots for Humanity effort. The profile is part of IEEE Spectrum's "A Day in the Life of a Roboticist" series.

  10. Microsoft ResearchOfficialAI score30

    Microsoft Research Asia – Singapore marks one year advancing AI research, partnerships and talent

    AIMicrosoft Research Asia – Singapore, opened July 24, 2025 as Microsoft's first Southeast Asian research lab, reports progress after its first year. The lab's work spans next-generation AI models and agentic systems, domain-specific AI for real-world impact, AI-native research practices, and ecosystem and talent development. Its healthcare collaborations on multimodal and agentic AI for clinical decision-making are being deployed through partnerships across Singapore's healthcare ecosystem.

  11. Grok BotOfficialAI score45

    SpaceXAI launches Team Bots public beta for Teams and Enterprise

    AISpaceXAI says its Team Bots, which prep account teams, coordinate engineering work, answer data questions, triage customer feedback, and run hiring loops, are now in public beta for Teams and Enterprise customers. The post links to a full announcement at

  12. François CholletXAI score32

    K3-Node: a Keras 3 GNN library running on JAX, PyTorch, and TF

    AIK3-Node is a graph neural network library built natively on Keras 3, with models that run on JAX, PyTorch, and TensorFlow with hardware acceleration including Apple Silicon and TPU. According to the post, it achieves 100% public API parity with PyG and incorporates foundation models and architectures from Spektral and StellarGraph.

  13. SemiAnalysisBlogAI score43

    How GLM-5.3 Sparse Attention Affects HBM and Serving Costs on GB200, GB300, and MI355X

    AISparse attention cuts per-operation KV cache reads but does not reduce overall memory capacity, so top-k cache misses still depend on HBM. SemiAnalysis's InferenceX estimates GB200 at about $0.044 per million total tokens at 150 tokens per second, roughly 12% below MI355X running ATOM at $0.049. Neither system holds a uniform cost advantage across the tested 100, 125, and 150 tokens-per-second targets.

  14. Ali GhodsiXAI score62

    Databricks finds Opus 5.5 cheaper and better, GPT-6 Luna 20x cheaper per task

    AIDatabricks tested recent AI models across 2,400 engineers and found Opus 5.5 offers the highest quality mid-tier performance, with about 20% lower same-task costs than Opus 4.8. The company is now encouraging Opus 5.5 as a default model for coding, and reports that GPT-6 Luna is at least 20 times cheaper per task than Opus 5.5, roughly matching Opus 4.6 on one difficult evaluation suite. The Luna findings are preliminary.

  15. Perplexity DevelopersOfficialAI score44

    Perplexity adds reusable custom agents to its Agent API

    AIPerplexity says developers can now build custom reusable agents in its Agent API using Profiles, Skills, and managed connectors. Agents are configured once in the API Portal and can then be reused across applications and workflows.

    Video from @perplexitydevs's post
  16. Hacker News · Launch HN, YC launches (10+ points)BlogAI score54

    Vespper launches a DOCX MCP for agents editing Word documents

    AIVespper, a Y Combinator F24 startup, launches a DOCX MCP that lets agents edit Word files through HTML that a trained reconciler converts back to OOXML. On its 279-task internal benchmark, the company reports its MCP is 2.7–2.9x cheaper and 2.7–3.5x faster than Anthropic's DOCX skill, with higher pass rates. The post also lists current limitations, including no comment creation or reply, no image or video attachment, and no support for latent styles.

  17. RadixArkOfficialAI score46

    RadixArk releases Miles v0.1.1 with multi-LoRA and expanded model support

    AIRadixArk has released Miles v0.1.1, adding multi-LoRA with Tinker API compatibility so multiple training jobs can share one base model. The update also supports agentic training with harnesses like Claude Code and runs Harbor tasks in sandboxes including AgentENV, Daytona, E2B, and Modal. It further reduces memory needs for training larger models on validated NVIDIA and AMD GPUs and adds stable support for Qwen3.8-Flash-Next, GLM-5.3-Flash, and Kimi-K3.

    Image from @radixark's post
  18. Daniel HanXAI score29

    Unsloth Desktop serves local Laya decision models for real-time packing demo

    AIUnsloth Desktop can now serve local Laya decision models through a Jev-compatible API, shown in a real-time packing demo where suitcase items update as the user types. The demo runs through Unsloth's Decision API, and the team says more optimizations are coming to speed up local hardware performance.

    Video from @danielhanchen's post
  19. Google Cloud · AI & Machine LearningOfficialAI score40

    Why startups should pair open models like Gemma 4 with frontier APIs

    AIGoogle Cloud argues startups should combine open-weight models with frontier APIs rather than routing every request to one frontier model. It cites Gemma 4, which spans five sizes including a 31B dense model and a 26B A4B Mixture-of-Experts model, released under Apache 2.0. The article's examples report a 44% latency drop for Cue, from 876 ms to 488 ms, and a $0 server cost for BetterSpeak's on-device Gemma 4 E2B.

  20. François CholletXAI score36

    Chollet says LRMs make hand-written code less worthwhile

    AIFrançois Chollet says he no longer reads or writes code and instead directs a large reasoning model, though he does not consider its code quality perfect or its instructions reliably followed. He argues LRMs enable faster ways to test, audit, visualize, and red-team a codebase, achieving the benefits of code review through new workflows. He concludes that the return on hand-writing code no longer looks good, since these workflows can be more productive than the old ones.

  21. clem 🤗XAI score49

    Hugging Face proposes egress usage monitoring for OpenShell agent sandboxes

    AIHugging Face is contributing egress usage monitoring to NVIDIA's OpenShell, part of the newly launched Open Agent Safety Platform, arguing that allowlists alone restrict where agents can go but not what they do. The proposed features include per-sandbox network budgets for requests, writes, and bytes, drift detection against each sandbox's baseline and cohort, and a fleet view that flags many sandboxes writing to one host even when every request is allowed.

    Video from @ClementDelangue's post
  22. Kling AIOfficialAI score42

    Kling 4.0 Flash launches now for Ultra Yearly subscribers; Kling 4.0 arrives October

    AIKling AI says its Kling 4.0 Flash is live now for Ultra Yearly subscribers, with the full Kling 4.0 coming this October. The update advertises up to 4K resolution, 10-bit HDR output, stereo audio, and native 30-second generation. It also adds Omni Reference supporting up to 15 multimodal references and multi-keyframe control with up to 10 keyframes.

    Video from @Kling_ai's post
  23. Unsloth AIOfficialAI score34

    Laya Decision models can now run locally on 4GB RAM

    AIUnsloth AI says Laya Decision models can run locally on just 4GB of RAM, on CPU, Mac, Windows, Linux, and GPU setups. The post adds that Laya can be served through a Jev-compatible API via Unsloth Desktop.

    Image from @UnslothAI's post
  24. Philipp SchmidXAI score36

    Gemini Managed Agents' Credentials API keeps secrets out of sandboxed code

    AIGoogle's Credentials API for Gemini Managed Agents injects secrets on the wire only for trusted domains, so sandboxed code cannot read raw tokens. It supports environment variables, CLIs, and MCP servers. Passing API keys as plain environment variables lets any sandboxed dependency read and potentially leak them.

  25. Philipp SchmidXAI score52

    Gemini Managed Agents adds a Credentials API that keeps secrets out of sandboxes

    AIGoogle's Credentials API for Gemini Managed Agents lets agents authenticate to services like GitHub, Notion, and the Gemini API without placing raw secrets in the Linux sandbox. Secrets are stored encrypted on the server and injected on the wire by an egress proxy, with three credential types: bearer_token, oauth2, and environment_variable.