Skip to content

Areas

Deployment & engineering Latest news

Engineering practice for running models: inference optimization, memory and cost, serving architecture, and infrastructure choices.

210 picksPast 30 days: 101 itemsTotal: 2,085 items

Latest pick

Top picks archive · Page 3

Oct 1

Oct 1ThuItems 41–60
  1. Google · Gemini appAI score60

    Google launches Guided Vision in Gemini Live for blind and low-vision users

    Google is launching Guided Vision in Gemini Live on compatible Android devices, letting users share their camera for spoken descriptions and follow-up questions. The model was trained with Aira on tens of thousands of hours of visual interpretation and tested by more than 1,000 members of Aira's Trusted Tester network. The feature is not a medical device, mobility aid, or navigation tool, and it requires Android 9 or later.

    AIWhy it matters: The launch shows how a real-time visual model was trained and tested with blind and low-vision users, a practical reference for accessibility-focused AI design.

  2. Cloudflare Blog · AIAI score62

    Cloudflare OS opens managed agent workspace waitlist with GitHub and Google Workspace support

    Cloudflare is opening a waitlist for fully managed Cloudflare OS deployments, where organizations configure a custom domain, Cloudflare Access policies, and an AI Gateway. The update lets agents mount existing GitHub repositories to explore code, fix bugs, and open pull requests, and read, draft, and send Gmail while accessing Google Drive. Built-in document, presentation, and spreadsheet tools can now export to Excel, CSV, PDF, Markdown, and HTML, with Word and PowerPoint export coming soon.

    AIWhy it matters: The post shows how a managed agent workspace connects to GitHub and Google Workspace, which matters for teams weighing self-hosting against a managed deployment.

  3. JetBrains AI BlogAI score75

    JetBrains Air enters early access as an agent system inside its IDEs

    JetBrains has opened the Early Access Program for Air, an agentic development experience available as a plugin on JetBrains Marketplace or in the 2026.3 EAP builds of its IDEs. Air works with existing agents such as Codex, GitHub Copilot, Junie, and Cursor, and it ships with no agents installed. Free Junie Lite runs are offered, while cloud runs require a JetBrains AI subscription.

    AIWhy it matters: The post explains how Air brings existing agents into the IDE, showing a concrete workflow for managing parallel agent sessions alongside code review tools.

  4. Ai2 (Allen Institute for AI)AI score62

    Ai2 releases Olmo-core 3, an open framework for training large MoE models

    Ai2 released Olmo-core 3, an open training framework redesigned to scale mixture-of-experts models into the trillion-parameter range. In one benchmark, expert count rose from 8 to 128 with about 3.2B active parameters per token, total capacity grew from 4.6B to 47B, and throughput fell by less than 5%. The framework is fully open, so researchers can train their own MoEs and experiment with routing and parallelism.

    AIWhy it matters: The release documents concrete MoE scaling results and reported failure modes, useful for teams weighing training-stack tradeoffs before adopting an open framework.

Sep 30

Sep 30Wed
  1. Comfy BlogAI score60

    Comfy API launches to deploy ComfyUI workflows as autoscaling endpoints

    Comfy API is now available to all users on a paid Comfy plan, letting them package a ComfyUI workflow with its custom nodes, LoRAs, models, and Python dependencies and deploy it as an autoscaling API endpoint. Builds capture the ComfyUI version and dependencies, and each immutable release gets its own URL, so the tested environment is the deployed one. Usage is billed separately, with GPU time charged by the second and storage prorated hourly.

    AIWhy it matters: The post explains how a ComfyUI workflow is packaged into immutable releases and deployed as an autoscaling endpoint, showing a path from local graph to production service.

  2. Google DeepMindAI score62

    Google DeepMind introduces SynthID Bio to watermark AI-designed proteins

    Google DeepMind introduced SynthID Bio, a watermarking method that embeds a detectable signature into AI-generated protein sequences and predicted structures. In wet-lab tests across three target proteins, watermarked binders matched unwatermarked versions in hit rate, binding affinity, and sequence diversity. The team is publishing its methods paper, open-sourcing code and in vitro data, and releasing weights to the research community.

    AIWhy it matters: The report shows watermarks surviving wet-lab testing with unchanged binding and folding accuracy, offering a concrete tool for tracking AI-designed proteins in biosecurity screening.

  3. Cloudflare Blog · AIAI score72

    Cloudflare launches Auto Router in AI Gateway to cut AI token spend

    Cloudflare has released Auto Router in public beta through AI Gateway, where setting the model to cloudflare/auto routes each request to a model judged capable enough for the task. Internal tests showed up to 30% cost savings against frontier models, and on a 97-task internal benchmark cloudflare/auto scored 86.6% at $0.0084 per success versus 96.6% at $0.0210 for Claude Opus 5.5. The router is free during beta.

    AIWhy it matters: The source gives a benchmark table of success rates and costs per trial, showing how routing trades quality against price for a gateway deployment.

Sep 29

Sep 29Tue
  1. OpenClawAI score70

    OpenClaw Enterprise launches as an open-source control plane for persistent agents

    The OpenClaw Foundation announced OpenClaw Enterprise, an open-source enterprise control plane for persistent agents, in collaboration with Red Hat, NVIDIA, and OpenAI. The product is built to run on an organization's own infrastructure and will always be free for organizations to use.

    AIWhy it matters: The announcement names its collaborators and deployment model, which helps organizations judge how the enterprise control plane would fit their own infrastructure.

  2. Replit BlogAI score62

    Replit Agent lets the core model choose subagents and effort instead of a router

    Replit explains how its Agent lets the core model pick subagent tier and effort mid-task rather than relying on an external router. On DeepSWE and Terminal-Bench, Replit Agent scored 72% at $2.11 per task and 49% at $2.53 per task, beating a single long-lived worker sidekick setup by 11 and 16 points. The company says Astra on its own scores higher only at more than twice the cost.

    AIWhy it matters: The post gives a concrete harness design with benchmark cost-score comparisons, helping builders weigh delegation strategies against routers and single-worker setups.

  3. Microsoft ResearchAI score75

    Microsoft Research introduces Quine, a multimodal biology world model and research harness

    Microsoft Research introduced Quine, an experimental research system combining a multimodal world model of biology with an interactive harness that connects models, scientific tools, literature, and researchers. In a pancreatic cancer study with the Broad Institute, Quine prioritized compounds that shifted tumor cell states, and several top-ranked candidates were validated in wet-lab assays. Access is initially limited to the Quine Fellows program and select collaborations, and the system is intended for research use only, not clinical use.

    AIWhy it matters: The post shows how a multimodal biology world model is wired into a harness, grounded in one wet-lab cancer example and a limited fellows-program access path.

  4. Artificial Analysis ArticlesAI score62

    Artificial Analysis open-sources AA-AgentPerf-Local for benchmarking local AI agents

    Artificial Analysis has open-sourced AA-AgentPerf-Local, a tool that replays recorded agent trajectories to measure inference speed on laptops and workstations. Initial results cover NVIDIA DGX Spark, NVIDIA GeForce RTX 5090, AMD Ryzen AI Halo, and MacBook Pro M5 Pro, with the RTX 5090 fastest for models that fit its 32 GB. The source states the tool and leaderboard will expand to more hardware, frameworks, and models.

    AIWhy it matters: The source gives per-system completion times and memory bandwidth figures, letting readers compare local hardware for running agentic workloads.

Sep 28

Sep 28Mon
  1. Manus BlogAI score60

    Manus 2.0 adds Cascade agent harness, Manus Studio, and Cue app

    Manus 2.0 introduces a new agent harness called Cascade, Manus Studio with Video Editor and Game Dev environments, and a standalone Cue app for personal agents. In one tested configuration, Cascade used 23.2% fewer tokens, completed tasks 28.2% faster, and cost 32% less to run than the previous system. Cue is in early access and available with an invite code.

    AIWhy it matters: The post separates the new agent harness, Studio, and Cue, and its Cascade chart gives measured token, time, and cost comparisons against the previous system.

Sep 27

Sep 27Sun
  1. PromptArmor Threat IntelligenceAI score72

    Elastic's AI SOC agent can be manipulated into leaking API credentials

    PromptArmor reports that Elastic's AI SOC agent, EASE, can be manipulated through malicious phishing alerts into minting API keys and sending them to an attacker. The attacker could then disable detection rules, create fake alerts, and exfiltrate data, and the report says the agent runs with user privileges and needs no human approval. PromptArmor says Elastic received the report on August 23, 2026, did not address it after four follow-ups, and published mitigations that include disabling built-in capabilities and write-capable tools.

    AIWhy it matters: The report shows how a prompt injection in alert data can drive an AI SOC agent to leak API keys, with concrete mitigations for agent tool settings and default model choice.

  2. Amp NewsAI score67

    Amp switches its default medium mode to Claude Opus 5.5

    Amp now uses Claude Opus 5.5 for its medium mode by default, replacing GPT-5.6 Sol, while ChatGPT subscribers can keep medium pinned to GPT-5.6 Sol. In Amp's internal evals, Opus 5.5 solved 65% of tasks versus 61% for GPT-5.6 Sol and 56% for Opus 5, at lower cost, and it runs at high reasoning effort because xhigh and max cost more without scoring better.

    AIWhy it matters: The source reports internal eval scores, cost comparisons, and usage guidance for choosing reasoning effort, helping developers decide which model and setting to run.

  3. Tibor BlahoAI score85

    OpenAI releases GPT-6 Sol and Luna as Anthropic launches Claude Opus 5.5

    OpenAI released GPT-6 Sol and Luna, priced 50 percent below GPT-5.6 promo API pricing, and rolling out in ChatGPT Work, Codex and the API, not yet in regular Chat. Anthropic released Claude Opus 5.5, described as roughly Claude Fable 5.1 level for 40 percent less than Opus 5 and over 30 percent faster, with Sonnet 5.5 and Haiku 5.5 due in coming weeks.

    AIWhy it matters: The recap puts OpenAI and Anthropic releases side by side, with pricing and capability claims that help compare the two launches.

Sep 25

Sep 25Fri
  1. Kevin WeilAI score75

    Claude solves nine-loop scattering amplitude calculation past prior eight-loop record

    Anthropic reports that Claude solved a nine-loop calculation in the planar N=4 super-Yang-Mills model, surpassing the previous eight-loop record set by Lance Dixon and collaborators. The quoted post says Claude ran largely unsupervised for days in Claude Science using a single prompt, at a total cost of a few thousand dollars, and Dixon independently verified the result. Kevin Weil's own text praises the achievement and expects AI to advance high energy physics over the coming 12 months.

    AIWhy it matters: The quoted Anthropic post gives a concrete benchmark: Claude ran for days to reach nine loops, extending the previous eight-loop record in a physics model.

Sep 24

Sep 24Thu
  1. Azure BlogAI score67

    Microsoft Foundry adds voice agents and continuous optimization for production agents

    Microsoft Foundry expands its agent platform with voice agents in public preview, long-running resilience for hosted agents, and tools for evaluating production agents. The post also says GPT-6 Sol, GPT-6 Luna, and Claude Opus 5.5 are now available in Foundry. Agent optimizer, Insights, and Rubric evaluator are described as tools for continuous improvement, with some reaching general availability later this month.

    AIWhy it matters: The post shows how Foundry combines model choice, voice agents, long-running resilience, and production evaluation into one agent workflow, with a customer example.

  2. Google · Gemini appAI score62

    Google launches Gemini 3.8 Live with Live Avatar for enterprises

    Google introduced Gemini 3.8 Live with Live Avatar, which adds a visual persona with lip-syncing and expressions to its live dialogue models. The feature is available in Gemini Enterprise and supports 97 languages, with custom avatars available through enterprise allowlisting. Google says all output is watermarked with SynthID.

    AIWhy it matters: The post specifies enterprise availability, custom avatar allowlisting, and 97-language support, which clarifies who can use the feature and how far it reaches.

  3. Microsoft Foundry BlogAI score61

    Microsoft Foundry Routines reach general availability for scheduled and event-driven agents

    Microsoft announced general availability of Routines in Foundry Agent Service, a managed way to run agents on a timer, on a recurring schedule, or in response to GitHub issue events and new Microsoft Teams channel messages. Routines keep the trigger, agent action, identity, connections, and run history in the Foundry project, and each routine can run under the creator's identity or the agent's own Microsoft Entra ID identity. A preview reminder tool lets a Hosted Agent schedule itself to resume later on the same conversation.

    AIWhy it matters: The post explains how scheduled, event-based, and self-reminding agent runs are managed in one place, along with the creator versus agent identity choice for unattended tasks.

  4. Google · Innovation & AIAI score62

    Google's Project Suncatcher will test TPUs in orbit on a prototype satellite

    Google's Project Suncatcher will launch a prototype satellite on the Transporter-18 rideshare mission with SpaceX to test how its TPUs handle spaceflight. Initial ground tests showed the Trillium TPUs survived vibration and a radiation dose greater than a five-year space mission would deliver. Google says cooling with heat pipes and radiators and laser links between satellites in 2027 remain open engineering challenges.

    AIWhy it matters: The source reports concrete radiation, vibration, and cooling test results for TPUs, showing what space-based AI compute still has to solve.