#Deployment/Engineering

AIAlibaba unveiled the Zhenwu V900 AI chip at its 2026 Apsara Conference, claiming three times its predecessor's performance and support for clusters of up to 500,000 cards. The company is pursuing data center capacity beyond 20 gigawatts by 2032 and has committed RMB 380 billion in capital spending over three years.

AIThe vLLM blog guide explains how separating prefill and decode, and moving tokenization to a CPU-only render tier, can keep token streams from stalling under load. In a two-L40S test on Qwen2.5-7B, collocated p99 inter-token latency reached 169 ms at 0.4 req/s while disaggregated serving stayed between 25 and 52 ms. The guide notes that the gain depends on fast KV cache transfer, and it includes setup code for NIXL-based serving and the render/derender API.

AIAmp now supports Plaid speed for modes that use GPT-6 Astra, using OpenAI's ultrafast tier to run inference up to 6× faster at 6× cost per token. Plaid works only with Amp-provided inference, not linked ChatGPT subscriptions, and subagents and non-Plaid inference fall back to fast or standard speed.

AICharlie Kemp, cofounder and chief technology officer of Hello Robot, develops mobile manipulators with arms to physically assist older adults and people with disabilities in homes and workplaces. His work began with humanoid robots at MIT and led to assistive robotics research, including a collaboration with Henry Evans through the Robots for Humanity effort. The profile is part of IEEE Spectrum's "A Day in the Life of a Roboticist" series.

AIMicrosoft Research Asia – Singapore, opened July 24, 2025 as Microsoft's first Southeast Asian research lab, reports progress after its first year. The lab's work spans next-generation AI models and agentic systems, domain-specific AI for real-world impact, AI-native research practices, and ecosystem and talent development. Its healthcare collaborations on multimodal and agentic AI for clinical decision-making are being deployed through partnerships across Singapore's healthcare ecosystem.

AISpaceXAI says its Team Bots, which prep account teams, coordinate engineering work, answer data questions, triage customer feedback, and run hiring loops, are now in public beta for Teams and Enterprise customers. The post links to a full announcement at

AIK3-Node is a graph neural network library built natively on Keras 3, with models that run on JAX, PyTorch, and TensorFlow with hardware acceleration including Apple Silicon and TPU. According to the post, it achieves 100% public API parity with PyG and incorporates foundation models and architectures from Spektral and StellarGraph.

AIThomas Wolf shared a read from @joedaroo, a former OpenAI insider, on security and safety work during a "summer in hell" at the company. The key advice is to prepare before surprises arrive, grant models only the access they need, test that boundaries hold, and keep evidence outside the model's control. Safety and infrastructure security teams, the post argues, should work closely together.

AISparse attention cuts per-operation KV cache reads but does not reduce overall memory capacity, so top-k cache misses still depend on HBM. SemiAnalysis's InferenceX estimates GB200 at about $0.044 per million total tokens at 150 tokens per second, roughly 12% below MI355X running ATOM at $0.049. Neither system holds a uniform cost advantage across the tested 100, 125, and 150 tokens-per-second targets.

AIDatabricks tested recent AI models across 2,400 engineers and found Opus 5.5 offers the highest quality mid-tier performance, with about 20% lower same-task costs than Opus 4.8. The company is now encouraging Opus 5.5 as a default model for coding, and reports that GPT-6 Luna is at least 20 times cheaper per task than Opus 5.5, roughly matching Opus 4.6 on one difficult evaluation suite. The Luna findings are preliminary.

AIHugging Face is inviting developers to suggest features for Gradio, its tool for building AI app frontends. The post follows a quoted message from Abid Lab noting that Gradio's original purpose has shifted and that the team is redesigning it from scratch around developers' current challenges with AI apps.

AIPerplexity Developers released a cookbook recipe that combines Profiles, Skills, and managed connectors to build an incident responder. The recipe shows how the agent reads Datadog telemetry, diffs code in Sandbox, and posts an update to Slack.

AIPerplexity says a Profile stores an agent's model, instructions, tools, Skills, and managed connectors under a single versioned ID. Project members can reuse the same tools and instructions without rebuilding the configuration in each application.

AIVespper, a Y Combinator F24 startup, launches a DOCX MCP that lets agents edit Word files through HTML that a trained reconciler converts back to OOXML. On its 279-task internal benchmark, the company reports its MCP is 2.7–2.9x cheaper and 2.7–3.5x faster than Anthropic's DOCX skill, with higher pass rates. The post also lists current limitations, including no comment creation or reply, no image or video attachment, and no support for latent styles.

AIGoogle Cloud argues startups should combine open-weight models with frontier APIs rather than routing every request to one frontier model. It cites Gemma 4, which spans five sizes including a 31B dense model and a 26B A4B Mixture-of-Experts model, released under Apache 2.0. The article's examples report a 44% latency drop for Cue, from 876 ms to 488 ms, and a $0 server cost for BetterSpeak's on-device Gemma 4 E2B.

AIFrançois Chollet says he no longer reads or writes code and instead directs a large reasoning model, though he does not consider its code quality perfect or its instructions reliably followed. He argues LRMs enable faster ways to test, audit, visualize, and red-team a codebase, achieving the benefits of code review through new workflows. He concludes that the return on hand-writing code no longer looks good, since these workflows can be more productive than the old ones.

AIGoogle's Credentials API for Gemini Managed Agents injects secrets on the wire only for trusted domains, so sandboxed code cannot read raw tokens. It supports environment variables, CLIs, and MCP servers. Passing API keys as plain environment variables lets any sandboxed dependency read and potentially leak them.

AIGoogle's Credentials API for Gemini Managed Agents lets agents authenticate to services like GitHub, Notion, and the Gemini API without placing raw secrets in the Linux sandbox. Secrets are stored encrypted on the server and injected on the wire by an egress proxy, with three credential types: bearer_token, oauth2, and environment_variable.

AISierra has turned its Ghostwriter tool into an always-on teammate in Slack and Teams that proactively suggests ideas, flags problems, and proposes experiments. Ghostwriter reviews recent customer calls, recommends which changes to try first, runs experiments, and reports when results are statistically significant. Sierra said it will begin rolling the feature out more broadly next week.

AILovable announced a partnership with Microsoft that lets users publish apps into their company's Microsoft Entra tenant using Copilot Managed Runtime. Apps can connect to Microsoft 365, Fabric, Dataverse, and SQL data, and staff sign in with their work login. Copilot Managed Runtime is in public preview, and Microsoft 365 connectors, Fabric, and Microsoft sign-in are available on every Lovable plan, while Entra workspace sign-in is included on Business and Enterprise.

AIHiggsfield promotes its MCP integration for motion design in After Effects, paired with Claude Opus 5.5. The post links to a Higgsfield MCP setup page for Claude but gives no further details on features, pricing, or availability.

AIMeta is launching Meta Enterprise Platform to bring its full technology stack to businesses and developers. The initial offering includes the Muse agent, Meta Business Agent, Muse API, and Muse Code, which the company says will help businesses grow.

AIImport AI 474 is a research newsletter by Jack Clark that surveys four developments and one fiction piece. It covers Michael Levin's paper proposing minds as patterns that ingress into bodies, Stanford researchers' call for a universal post-training recipe for robotics, Google's plan to send TPUs to space with Planet, and Zhipu's use of GLM-5.3 to speed up its own inference infrastructure.