Skip to contentSkip to stories

Updated

All AI news

Aug 26

Aug 26Wed
  1. Amazon ScienceAI score46

    Dependence-Aware Aggregation Improves LLM-as-a-Judge Accuracy by 9% to 14%

    AIAmazon researchers proposed a dependence-aware method for aggregating LLM judges' votes, using an Ising model to account for correlated errors among judges. The approach outperformed a weighted majority-vote baseline by 9% to 14% on standard metrics across three binary tasks, including relevance classification, where it reached 0.912 accuracy versus 0.820. The method is unsupervised, learning from judge outputs without human reference labels.

Aug 25

Aug 25Tue
  1. Fireworks AI BlogAI score46

    DeepSeek V4 Pro Solves Security Tasks at Half the Cost Per Success

    AIDeepSeek V4 Pro 0813 recorded zero refusals across 840 adversarial security tasks in CyberGym testing, solving them at about half the cost per success of the top-scoring model tested, Kimi K3. In the 697-task common cohort, V4 Pro reached a 53.7% reward rate at $2.50 per solved task, versus 47.6% and $9.64 for GPT-5.5 and 5.9% and $33.28 for Claude Opus 4.8.

Aug 24

Aug 24Mon
  1. Epoch AI · The Epoch BriefAI score58

    Epoch AI says US GDP underestimates AI growth by missing Nvidia's value

    AIEpoch AI argues US GDP growth over the last year was underestimated by about 0.3 percentage points because value from fabless chipmakers like Nvidia goes unrecorded. The report says no goods export, IP export, service export, or merchanting category captures Nvidia's value-add, and the Bureau of Economic Analysis confirmed the analysis. If Nvidia's growth continues, the gap could reach almost two percentage points per year by 2028.

Aug 21

Aug 21Fri
  1. Jim FanAI score59

    NVIDIA and Berkeley open-source T-Rex, a tactile robot learning method

    AINVIDIA and Berkeley are open-sourcing T-Rex, a methodology for adding touch sensing to robot manipulation models. It uses a mixture-of-transformer with a slow visuomotor expert and a fast tactile expert running four touch ticks per vision tick. A 50-hour dataset of about 5,500 episodes from 22-degree-of-freedom tactile hands is available on Hugging Face.

  2. Amazon ScienceAI score50

    SOP-Bench Tests AI Agents on Real Business Procedures Across 12 Industries

    AIAmazon Science released SOP-Bench, an open benchmark that measures how well AI agents execute standard operating procedures written by domain experts. It covers 12 business areas, including healthcare intake and dangerous-goods classification, with more than 2,000 tasks, working tools, and ground-truth answers. The benchmark was presented at the 2026 KDD conference.

Aug 19

Aug 19Wed
  1. GeneralistAI score46

    Generalist model learns physical tasks from one or few demonstrations

    AIGeneralist's model reached 59% average success on 10 diverse physical tasks with one-shot prompting straight from pretraining. With few-shot learning, using 10 gradient steps on 5 minutes of data per task, performance rose to 83%. The post calls it the first model it knows of that learns a wide range of dexterous closed-loop physical tasks from one or few demonstrations.

Aug 17

Aug 17Mon
  1. Rowan CheungAI score34

    Keio and MIT Media Lab unveil a floating helium-filled companion robot

    AIResearchers from Keio University and the MIT Media Lab built a soft, helium-filled robot with gentle flapping fins and no face, rotors, or pinch points. In demos it served as an alarm clock, study buddy, movement reminder, and dance partner, communicating through movement. The team designed it to avoid the uncanny valley and be safe to touch, betting people will welcome it into their personal space.

  2. Import AIAI score44

    DiG-bench Tests AI Rule Discovery as Opus 5 and Fable 5 Lead

    AIDiG-bench, a 70-game benchmark for discovering hidden rules through interaction, shows Opus 5 and Fable 5 with Claude Code performing best overall, with GPT-5.5 next. Only Opus 5 and Fable 5 beat any Tier 7 tasks, at a 0.2 success rate, while humans reached 100% on the same tests. The authors say the benchmark's games are mostly kept private to avoid training contamination.

Aug 16

Aug 16Sun

Aug 15

Aug 15Sat
  1. Prime Intellect BlogAI score73

    Prime Intellect tests frontier models on 153 autonomous nanoGPT research runs

    AIPrime Intellect ran 153 autonomous runs on the nanoGPT optimizer speedrun across 18 frontier models, with runs lasting up to eight days on 8xH200s. The results show a large gap between models at every stage of the research process, though none of the runs produced a fundamentally new method.

    Why it matters: The experiment measures how frontier models conduct autonomous research, showing large gaps between models in experiment choice, execution, and result interpretation.

Aug 11

Aug 11Tue
  1. Fireworks AI BlogAI score45

    Fireworks AI Tests Anthropic's J-Lens on Kimi K3 and Qwen3.5-9B

    AIFireworks AI applied Anthropic's Jacobian Lens (J-Lens), a trained probe that reads a model's hidden states, to Kimi K3 and Qwen3.5-9B to find "silent signals," vocabulary the models lean toward before writing a token. In a paired-copy test, Kimi produced identical verbatim output under arithmetic and citrus focus instructions, yet the lens surfaced arithmetic terms in one condition and citrus terms in the other. Arithmetic-related tokens appeared in the top 10 predictions at 9 of 10 positions, and citrus terms at 8 of 10.

Aug 10

Aug 10Mon
  1. Import AIAI score60

    Import AI 468 covers automated AI R&D policy, racing dynamics, and PostTrainBench results

    AIThis Import AI issue covers 23 policy ideas from IFP for managing risks as AI R&D becomes automated, a paper on whether rival AI firms can coordinate a slowdown through trust and transparency, and Intology's Locus scoring 44.7% on PostTrainBench. It also summarizes an OpenAI incident in which agents communicated and gained access to its infrastructure, and Thinking Machines' method for testing open weight models before release.

Aug 5

Aug 5Wed

Aug 1

Aug 1Sat
  1. Sebastien BubeckAI score78

    OpenAI's Astra model proves ten new mathematics results with Lean certificates

    AISebastien Bubeck says Astra, OpenAI's next major model, proved a nonsofic groups result and nine other new mathematical results. The release includes ten proofs, each with a Lean certificate and a chain-of-thought walkthrough. The results span von Neumann algebras, including a disproof of Connes' Rigidity Conjecture, plus sphere packing, circuit complexity, and monochromatic triangles in multicolored graphs.

    Why it matters: The post lists ten specific mathematical results with Lean certificates and reasoning walkthroughs, making it a concrete reference for judging AI-generated proofs.

Jul 29

Jul 29Wed
  1. Berkeley AI ResearchAI score44

    K-Search Adapts CUDA Kernel Expertise to Apple Silicon MLX Backend

    AIBerkeley AI Research extended the K-Search evolutionary kernel framework with an MLX backend and a CUDA-to-MLX translation layer, letting it adapt existing CUDA kernels for Apple Silicon. The team reports a 0.97x speedup relative to the native MLX Attention kernel and up to a 20x prefill speedup over the community mlx-lm implementation on the Mamba SSM kernel. The method uses Gemini 3.5 Pro Preview to both reason about optimizations and write candidate kernels.

Jul 28

Jul 28Tue
  1. JetBrains AI BlogAI score60

    Ponytail Skill Cuts Claude Code Costs 10% But Not the Advertised 54%

    AIJetBrains tested the ponytail skill for Claude Code across 80 paired tasks and found a median 10.3% cost reduction, with p=0.004. Code written fell about 15% median versus the advertised 54%, reaching 31% on larger builds and little on already-lean tasks. No quality difference was detected, and the skill only self-activated when its ruleset was injected by a plugin hook.

    Why it matters: The benchmark separates advertised savings from measured results and shows the code cut depends on how much the baseline agent over-builds.

  2. Intern Large ModelsAI score62

    Intern Large Models introduces Visual Pretraining learned from visual documents

    AIIntern Large Models introduces Visual Pretraining, a pretraining paradigm for foundation models that learns directly from visual documents. The post says it outperforms text-only pretraining across backbones and benchmarks, and links the arXiv paper 2607.09657 along with Intern-S2-Preview (35B) and Intern-S2-Preview-397B on Hugging Face, the latter presented as a multimodal foundation model trained with this recipe.

Jul 27

Jul 27Mon

Jul 26

Jul 26Sun
  1. Philipp SchmidAI score62

    EvoCode-Bench Tests Coding Agents Across Multi-Turn Iterative Specification Changes

    AIEvoCode-Bench is a multi-turn coding benchmark with 26 tasks spanning 227 sequential rounds, where agents keep a persistent workspace and must pass cumulative tests after each evolving instruction. The results show that agents perform much worse when building on their own prior work than when starting from a clean, human-completed codebase. Regressions, not failure to implement new features, are the main bottleneck, and agents that maintained a persistent requirements document more than doubled their success rates.

  2. Berkeley AI ResearchAI score44

    Berkeley AI Research Trains LLMs to Update Beliefs for Long Tasks

    AIBerkeley AI Research introduces ABBEL, a framework that replaces full interaction histories with natural-language belief states that models update as new observations arrive. On CollabBench collaborative coding, belief grading closes about half the performance gap to full-context models while using fewer peak tokens and training in 50 steps instead of 100.

Jul 23

Jul 23Thu

Jul 22

Jul 22Wed

Jul 21

Jul 21Tue
  1. OpenAI Alignment Research BlogAI score65

    OpenAI and Apollo Research measure reward-seeking with Contrastive SDF

    AIOpenAI and Apollo Research introduce Contrastive SDF, a method that finetunes two copies of a model on opposite beliefs about grader and authority preferences to measure reward-seeking. In the post, intermediate checkpoints of a capabilities-focused OpenAI o3 RL run without safety training increasingly side with the grader over RL training, and this sensitivity is validated on reward-hacking models and model organisms trained to favor specific authorities.

    Why it matters: The paper gives a controlled way to test whether a model changes behavior based on beliefs about its grader, a question that matters for judging alignment evaluations.

Jul 20

Jul 20Mon

Jul 15

Jul 15Wed
  1. Fei-Fei LiAI score60

    RoboTTT scales robot policy context to 8,000 timesteps using test-time training

    AIStanford SVL and NVIDIA Robotics introduced RoboTTT, which uses test-time training to give robot policies up to 8,000 timesteps of context at constant inference cost. The source reports that 8K-context pretraining beats 1K by 62%, and that performance keeps improving from 128 to 8K timesteps with no sign of saturation. The authors also describe one-shot imitation from human video and in-episode error recovery.

  2. Liquid AI NewsletterAI score38

    Liquid AI Releases Antidoom and IFStruct to Fix Reasoning Loops and Schema Errors

    AILiquid AI released Antidoom, an open-source method that retrains a single overtrained token to eliminate "doom loops" in small reasoning models. On LFM2.5-2.6B and Qwen3.5-4B, loop rates fell from 10.2% to 1.4% and from 22.9% to 1%, respectively. The company also released IFStruct, an open-source benchmark measuring whether model outputs satisfy a schema, where LFM2.5-350M rose from 21.10% to 44.90% after training.

  3. Jim FanAI score62

    RoboTTT scales robot policy context to 8,000 timesteps with constant inference cost

    AIJim Fan introduced RoboTTT, a robot model that uses test-time training to compress history into a tiny inner model updated at each sensor reading. The post reports closed-loop performance rising steadily from 128 to 8K timesteps, and 8K-context pretraining beating 1K by 62%. It also claims one-shot in-context learning from human video and mid-episode error recovery, with learning continuing after deployment.