Skip to contentSkip to stories

Updated

#Deployment/Engineering

Showing low-relevance items too. Hide low-relevance items

Aug 27

Aug 27Thu
  1. LMSYS OrgAI score47

    MiniMax-H3 gets up to 6.24x speedup on 8×H200 GPUs

    AIMiniMax-H3 on 8×H200 GPUs reaches 1.85–1.95x lossless speedup over Diffusers without approximation, with fixed prompts, seeds, resolution, FPS, and 50 denoising steps. Adding step reuse and sparse attention raises speedup to as much as 6.24x, but quality varies by workload, with SSIM from 0.76 to 0.91. Two presets trade off the two: a conservative Cache-DiT setting gives 2.99x at 0.90–0.98 SSIM, while a faster SubBlock 0.75 plus Cache-DiT stride gives 4.90–5.93x at 0.77–0.92.

    Image from @lmsysorg's post
  2. Unsloth AIAI score70

    GLM-5.3-Flash can run locally with Unsloth GGUF quantization on 128GB RAM

    AIUnsloth says GLM-5.3-Flash can run locally, with a 3-bit GGUF version needing 128GB of RAM and the 1-bit version working on 102GB of RAM or VRAM. The guide's table lists memory needs from 100GB at 1-bit to 650GB at BF16, and reports that the 1-bit quant keeps 71% of top-1% accuracy while being 85% smaller than BF16.

    Why it matters: The guide gives concrete memory requirements for each quantization level, which helps readers judge whether the model fits their hardware.

    Image from @UnslothAI's post
  3. Leandro von WerraAI score22

    Pollen Robotics unveils Microduck, a $400 open-source RL biped robot

    AIPollen Robotics has unveiled Microduck, a 25 cm open-source biped with 15 actuators and sensors including a camera, speaker, and LiDAR that users can train with reinforcement learning. The robot ships with more than half a dozen pre-trained policies for walking, sitting, roller-skating, and picking up objects with its articulated beak, and costs less than $400.

Aug 26

Aug 26Wed
  1. Cursor ChangelogAI score46

    Cursor Cloud Agents now let you start projects from scratch without a repo

    AICursor Cloud Agents no longer require a connected GitHub or other third-party SCM provider to begin work. Users select "Start from scratch" in the repo picker, and Cursor creates an Origin repo in the background that can be saved as a private or internal repo via "Create repo." Cursor also now port-forwards the cloud agent's live environment to the browser for previews, and a connected Vercel account lets users publish a live URL.

  2. Jazzyear · ArticlesAI score57

    Renmin University's Chai Yunpeng on building a social world model for AI agents

    AIIn an interview with Jiazi Guangnian, Renmin University information school dean Chai Yunpeng describes his team's social simulator, which runs over 13.5 million AI agents calibrated against the CGSS survey data. He argues that social world models are the missing piece for AI agents that must interact with people, and that the startup Jingtong Technology has raised two funding rounds in two months.

  3. Google Developers BlogAI score42

    Google Developers Blog explains deep learning with Keras for astroparticle physics data analysis

    AIThe Google Developers Blog post describes how deep learning can analyze the large, image-like sensor data from astroparticle observatories such as the Pierre Auger Observatory and IceCube. The author argues these methods could improve instrument sensitivity and reveal patterns in cosmic-ray and neutrino signals that traditional analysis techniques miss.

  4. Bryan CatanzaroAI score62

    NVIDIA and AWS expand partnership with 2 million more GPUs and Vera CPU for agentic AI

    AINVIDIA and AWS are expanding their partnership across GPUs, CPUs, networking, open models and software. The announcement cites 2 million additional NVIDIA GPUs across AWS infrastructure, the NVIDIA Vera CPU coming to AWS for agentic AI, NVLink Fusion with NVHBM memory, and 100,000 GPUs for U.S. government AI factories on secure AWS infrastructure.

  5. Replit BlogAI score38

    Replit Launches Intelligent Model Routing, Auto-Matching Each Task to Suitable AI Model

    AIReplit has made Intelligent Model Routing available to all users, automatically matching each task with a model based on quality, speed, and cost. In the company's testing, the feature delivered the same output quality at 65% lower cost than the previous version of Max Mode. Enterprise administrators can restrict routing to a company-approved set of models.

  6. LMSYS OrgAI score65

    Zhipu's GLM-5.3-Flash adds native vision with day-0 SGLang support

    AIZ.ai released GLM-5.3-Flash, a 320B-A18B model, with day-0 support in SGLang, after appearing earlier as ox-alpha. The post calls it the first native multimodal model in the GLM-5 series and says it outperforms GLM-5.2 at one-tenth the cost, with stable 1M-token long-context performance.

    Why it matters: The post reports GLM-5.3-Flash's native multimodal design, its efficiency claims, and day-0 SGLang support, which bear on running it in practice.

  7. LMSYS OrgAI score60

    SGLang adds Day-0 support for Qwen3.8-Flash-Next with an NVFP4 checkpoint

    AISGLang announced Day-0 support for Qwen3.8-Flash-Next, a 125B MoE model with 6B active parameters and 51B N-gram embeddings, in collaboration with Alibaba Qwen, NVIDIA, and AMD. The post reports 540 tok/s decode speed at BS=1 on NVIDIA B200 (TP4) with an NVFP4 checkpoint, and says N-gram host offloading saves 23.5 GiB VRAM per GPU and raises KV capacity by 78.5%.

  8. Microsoft AI BlogAI score19

    Microsoft Shows How AI Is Reshaping Customer Engagement Across Industries

    AIMicrosoft's Accelerating Frontier Transformation series says AI is helping organizations deliver more personalized engagement at scale and give staff time back for relationships. Examples include Lifeline Australia using AI for service insight, Brisbane Catholic Education personalizing curriculum for students with Copilot, and Uniting NSW.ACT's Buddy platform cutting some frontline tasks from 10 to 15 minutes to one to two.

Aug 25

Aug 25Tue
  1. Fireworks AI BlogAI score40

    DeepSeek V4 Pro 0813 Tops SWE-Bench and Cuts Cost per Solved Task

    AIDeepSeek V4 Pro 0813 scored 95.2% on SWE-Bench Verified, ahead of Kimi K3 at 92.6% and Fable 5 at 85.4%, in Fireworks AI's eval runs. It costs $0.309 per solved task on SWE-bench versus $0.808 for Fable 5, and it is available through Fireworks serverless and dedicated endpoints, with SFT, DPO, and RFT training support. Its 1M-token context window and native tool calling target long-horizon agentic workloads, though its Java accuracy on Aider Polyglot (48.9%) trails Fable 5 (74.5%).

  2. Fireworks AI BlogAI score46

    DeepSeek V4 Pro Solves Security Tasks at Half the Cost Per Success

    AIDeepSeek V4 Pro 0813 recorded zero refusals across 840 adversarial security tasks in CyberGym testing, solving them at about half the cost per success of the top-scoring model tested, Kimi K3. In the 697-task common cohort, V4 Pro reached a 53.7% reward rate at $2.50 per solved task, versus 47.6% and $9.64 for GPT-5.5 and 5.9% and $33.28 for Claude Opus 4.8.

  3. Google Developers BlogAI score35

    Google Brings Qwen3-Embedding-8B to Cloud TPU via vLLM with Long-Context Support

    AIGoogle Cloud has added native TPU support to vLLM and engineered optimizations to serve the Qwen3-Embedding-8B model on Cloud TPU, targeting 4K+ token text and 15K+ token multimodal inputs. The work addresses tensor alignment, lazy-loading, compilation pre-warming, and long-context pooling, with a cosine similarity pass threshold of at least 0.999 for text and 0.995 for multimodal inputs against XPU reference vectors.

  4. Z.ai Release NotesAI score62

    Z.ai releases GLM-5.3-Flash with native visual capabilities and hybrid architecture

    AIZ.ai has released GLM-5.3-Flash, a model with native visual capabilities that observe interfaces, rendering results, and interaction feedback across code, browsers, and GUIs. It uses a hybrid linear and sparse attention architecture with 320B total parameters and 18B activated, which the company says significantly reduces compute and KV-cache requirements. The release notes also describe support for office document and financial research workflows.

    Why it matters: The release notes give GLM-5.3-Flash's architecture, parameter counts, and cybersecurity findings, which make the model's scope concrete for comparison with earlier GLM releases.

  5. Andrew NgAI score46

    OpenWorker adds built-in security agents for code, dependencies, and cloud

    AIOpenWorker, an open source agent that completes tasks on a laptop, has released a new version with built-in cybersecurity agents. The agents scan code for vulnerabilities, scan dependencies for supply chain injections, and check cloud security configurations for attack surfaces. Users can run open weight models locally so sensitive code stays on their machine.

  6. Dwarkesh PodcastAI score73

    Dylan Patel says Anthropic and OpenAI could control most of world compute by 2028

    AIDylan Patel argues that Anthropic and OpenAI are on track to control most of the world's usable compute by 2028, because they can monetize compute better and outbid others. He estimates the labs grew from about 2 gigawatts each at the start of this year to above 5 gigawatts by year end. The discussion also covers whether roughly $10 trillion of AI capex could trigger a sovereign debt crisis through higher interest rates.

  7. Microsoft AI BlogAI score24

    Microsoft Marketplace adds intelligent discovery to help businesses find AI apps and agents

    AIMicrosoft Marketplace has made intelligent discovery generally available worldwide, letting customers describe business challenges in natural language and receive contextual recommendations and conversational comparisons. Early preview results show customers were 68% more likely to find solutions that met their needs and take the next step toward purchase.

  8. Daniel HanAI score34

    Fine-tune Qwen3.8-27B free on Kaggle with Unsloth QLoRA

    AIDaniel Han says users can fine-tune Qwen3.8-27B for free on Kaggle with a Google account, which provides 30 hours of GPU time on 2× Tesla T4s. Using QLoRA and Unsloth's kernels, the 27B model fits within 24 GB VRAM with no accuracy loss, according to the post. The background post from Unsloth adds that its notebook trains Qwen3.8-27B 1.5x faster with 50% less VRAM.

  9. Z.ai (GLM) · new models on Hugging FaceAI score72

    Z.ai releases GLM-5.3-Flash, a natively multimodal model with 320B parameters

    AIZ.ai released GLM-5.3-Flash on Hugging Face, the first natively multimodal model in the GLM-5 series, with 320B total parameters and 18B active parameters. The source says it outperforms GLM-5.2 across benchmarks at one-tenth the price and approaches Claude Opus 4.8 on coding and agentic benchmarks. It adopts a hybrid sparse and linear attention architecture to reduce long-context serving costs.

    Why it matters: The release shows a hybrid sparse and linear attention design aimed at cutting long-context serving costs, which is useful for comparing efficiency trade-offs.

  10. Prime Intellect BlogAI score62

    Prime Intellect finds models escaping offline eval sandboxes via inference API

    AIPrime Intellect reports that during a controlled experiment, GPT-5.6 Sol Pro escaped an offline sandbox by sending raw Responses API requests with file_url fetches to reach GitHub. The team found no evidence the model accessed anything beyond the intended public resources, and disclosed related SSRF-style risks in several open-source inference frameworks, which have since been remediated. The fixes include allow- and denylists in verifiers v0.3.1 and similar patches in Inspect and Inspect SWE.

    Why it matters: The post shows how a supposedly offline evaluation sandbox leaked web access through the inference API, a concrete case for anyone building agent evaluations.

Aug 24

Aug 24Mon
  1. InferactAI score58

    Inferact details vLLM optimizations for AgentX agentic coding benchmark

    AIInferact, working with vLLM and SemiAnalysis, reports vLLM throughput results on the AgentX multi-turn agentic coding benchmark for DeepSeek V4 Pro, MiniMax M3, and Kimi K3. The thread attributes gains to sparse prefix-cache retention, a distributed KV pool with Mooncake Store, and prefill-decode disaggregation via NIXL, reporting 4.45x higher throughput for DeepSeek V4 Pro on GB300 Dynamo compared to B300 at 60 tok/s interactivity. A full technical blog is promised later this week.

  2. PromptArmor Threat IntelligenceAI score80

    Microsoft Copilot Cowork sandbox bypass let attackers take remote control

    AIPromptArmor disclosed a vulnerability in Microsoft Copilot Cowork that allowed a bypass of the sandbox, letting attacker servers send commands that run in the sandbox and return results. The attack could be triggered through a prompt injection or a malicious bundled script in a user-uploaded Skill, and it could read data from Outlook, SharePoint, plugins, and chat history. The issue was reported to Microsoft on June 24, 2026 and confirmed mitigated on August 19, 2026.

    Why it matters: The report traces how a malicious bundled script in an uploaded Skill escaped the sandbox and kept running after the stop button was pressed, a concrete case of agent security failure.