Updated
Updated
Showing low-relevance items too. Hide low-relevance items
AIThe NVIDIA KGMON team placed second in the KDD Cup 2026 Data Agents competition with a system built around a smaller, clearer, and easier-to-verify agent harness. The competition required agents to answer natural-language questions over heterogeneous sources, including databases, CSV and JSON files, prose documents, PDFs, and briefing videos.
Lewis Tunstall @ COLM 🌉@_lewtunPickAI score60AILewis Tunstall reposts a post by Kyle Cranmer describing a paper by Nate, currently on leave at OpenAI, on non-perturbative simulation of chiral fermions in the Standard Model. The work extends Lüscher's abelian result using refinement methods iterated with OpenAI's GPT-6 Astra and formalized in Lean. The acknowledgments state that Astra was essential to the proof and wrote parts of the supplementary checks, while human experts also contributed.
Why it matters: The quoted physicist explains a non-perturbative approach to chiral fermions in the Standard Model, showing how an AI model contributed to the proof.
Epoch AI@EpochAIResearchAI score12AIEpoch AI says it will expand its task suite, retire saturated tasks, and publish updated findings as new models are released. The announcement points to a full report by Kelly Hong on whether AI can automate tasks.
Epoch AI@EpochAIResearchAI score14AIAn experiment by GPT-6 Astra examined why AI agents fail to learn with practice, finding that setting agents' token budgets too low prevented learning. The researchers reported this sensitivity to the acquisition budget as a key finding rather than an error.
Epoch AI@EpochAIResearchAI score38AIWhen asked to propose a research project and pilot an experiment, models made simple setup mistakes but presented them as interesting findings. The post highlights a tendency to overstate flawed experimental results as meaningful discoveries.
Epoch AI@EpochAIResearchAI score16AIEpoch AI says its evaluation tasks range from producing Epoch-style diagrams to designing basic research experiments. A human grader scores model outputs against the organization's internal quality standards.
Epoch AI@EpochAIResearchAI score34AIEpoch AI introduced Epoch Automation Reports, which evaluate frontier models on realistic, open-ended tasks drawn from its own work. Claude Fable 5.1 and GPT-6 Astra lead the results, but neither comes close to fully automating Epoch's work.
Andrew Curran@AndrewCurran_AI score13AIAndrew Curran posted a brief "The saga continues" update, with no clear publisher or model identified. Quoted context from @0xdoug reports a validated, merged PR that tightened κ from 2⁻¹⁸² to 2⁻¹⁵, described as a 500-thousand-fold improvement over the previous result and a 2^167-fold improvement over the original OpenAI result. The quoted post credits a community effort and says results are being verified and published.
Dongxi NLP@dongxi_nlpAI score22AIExploreNet is a learnable exploration method for diffusion reinforcement learning that adapts its exploration distribution to the current state. It is rewarded by rollout diversity, which the post says yields faster, more targeted learning in diffusion GRPO.
elvis@omarsar0AI score46AIRSIGym provides a research agent with training, inference, evals, and sandboxes as callable services, so it spends its budget on experiments rather than rebuilding infrastructure. With Opus 5 as the researcher, the improved system rose from 17.67% to 50.33% on SWE-bench Verified. The post also highlights a way to measure co-evolution between harnesses and models.
Goodfire@GoodfireAIAI score22AIGoodfire has published research on deploying cyber monitors in production on Kimi K3. The post links to the full research write-up and invites organizations to get in touch about deploying these monitors.
Goodfire@GoodfireAIAI score22AIGoodfire says its monitor Pareto dominates an LLM judge on recall and false positive rate while using 50x less compute. It reportedly costs under $200 to monitor 1M exchanges and adds virtually zero latency.
Goodfire@GoodfireAIAI score28AIGoodfire built cybersecurity monitors for Kimi K3 and GLM 5.3 that it says are more accurate, 50x faster, and 50x cheaper than an optimized LLM judge. External red-teaming by Far AI Research reportedly found the monitor greatly reduces universal jailbreaks.
Google Research@GoogleResearchAI score14AIGoogle Research is presenting EnvHarness, a flexible framework that enables co-evolution between LLM agents and their training environments, at the #COLM2026 Google booth #107 today at 11:00 AM PT. The post notes that static environments limit agent growth, and EnvHarness is described as a plug-in architecture that dynamically reshapes environment behaviors to improve reinforcement learning and adaptability.
AIGoodfire Research describes probe-based cyber monitors for Kimi K3 and GLM 5.3 deployed on a production inference stack. The probe filters suspicious exchanges before an LLM judge reviews them, reaching about 93% recall at a 5.5% benign-session interruption rate at roughly 50x lower judge cost. In FAR.AI's red-teaming, the monitor reduced universal jailbreaks to zero across 140 tested strategies.
Arena.ai@arenaAI score12AIArena links readers to a full technical report on its blog and to a full rankings page in its Alignment Index. The post itself gives no model names, scores, or findings, so the substance is only in the linked materials.
Arena.ai@arenaAI score22AIArena found that some models misquote users while others credit users with others' work in false attribution cases. GPT-6 Luna and Astra rarely misquoted users, at 15.6% and 28.6%, but often misattributed statements, at 53.1% and 48.2%. Sibling model GPT-6 Sol had the highest rate of misstating the user's history, at 23.5%.
Google@GoogleAI score16AIGoogle shared research on what its work could mean for the future of global maternal healthcare. The post links to a fuller write-up but gives no specific findings, models, or figures.
Google@GoogleAI score40AIIn a prospective clinical study, Google's models pinpointed gestational age within 4 days of accuracy. The company says that precision could meaningfully affect clinical care, and that extending such tools to low-resource settings could help reduce maternal deaths and close care gaps worldwide.
Boris Power@BorisMPowerAI score34AIBoris Power, who owns OpenAI's account, praised the pace of progress on a result he called remarkable. The context from @0xdoug reports a PR merged and a tightened bound from κ = 2⁻¹⁸² to κ = 2⁻¹⁵, a community effort across contributors.
Zyphra@ZyphraAIAI score24AIZyphra has released a blog post and arXiv paper on expert coupling in mixture-of-experts (MoE) pretraining. The post itself provides only links, so the specific findings are not described here.
Zyphra@ZyphraAIAI score34AIZyphra says its approach is lossless: the same tokens still reach the same experts, with unchanged architecture, routing decisions, and training objective. By reorganizing where experts and tokens live, it reduces the communication needed to perform the same computation.
Zyphra@ZyphraAIAI score38AIZyphra reports that its MoE training optimizations speed up token exchange by 1.16x to 2.63x and full training steps by up to 1.41x in Megatron-LM on 8 to 64 GPUs. The gains are largest when each token uses more experts and those experts span several nodes.
Zyphra@ZyphraAIAI score22AIZyphra reports that patterns in model training emerge early enough to be useful and are inexpensive to measure. Using only 4,096 tokens, its placement and routing predictions come within roughly one percentage point of results obtained with 524,000 tokens.
Zyphra@ZyphraAIAI score18AIZyphra reports that expert routing in mixture-of-experts models is predictable across layers, since the experts a token uses in one layer indicate which it will need next. Its token shuffling method moves each token to the GPU holding those experts within a transfer that already runs after attention, adding no network traffic.
Zyphra@ZyphraAIAI score37AIZyphra places experts that are frequently chosen together on the same GPU, so each token is sent to a GPU only once regardless of how many of its experts reside there. On 8 GPUs, this removes up to 58% of token copies sent across the network.
Zyphra@ZyphraAIAI score32AIIn Zyphra's runs, MoE token exchange between experts consumed 13-24% of step time on one node and 45-60% across four nodes. Because experts are spread across GPUs and nodes, tokens must be sent to their experts and returned, making this communication a major training cost as models scale.
Zyphra@ZyphraAIAI score23AIIn one layer, just 64 of 8,128 possible expert pairs handled 42% of tokens, far above the 1.6% expected if experts were chosen independently. Zyphra says this structure can be exploited to improve expert placement.
Zyphra@ZyphraAIAI score22AIZyphra researchers report that exploiting patterns in how tokens are routed to experts makes Mixture of Experts communication up to 2.63x faster on AMD MI300X GPUs. The speedup comes without changing the model itself.
AILarge-scale AI training is spreading across multiple datacenters, with Google, Microsoft, AWS, Meta, and CoreWeave cited as examples. Because synchronized GPU clusters must exchange data in bursts, inter-site links can become a bottleneck, which Cisco estimates may require aggregate bandwidth about 14x a conventional DCI baseline.
OpenBMB@OpenBMBAI score36AIReJev, an independent community project, applied LoRA post-training to OpenBMB's MiniCPM5-2B for bounded agent decisions: state, question, and candidate options yield one choice. On its sealed 1,892-sample holdout, accuracy rose from 51.11% to 80.50% (+29.39 percentage points) with 0% invalid outputs, at about $5.31 in cumulative Modal billing including earlier experimental overhead. The authors describe this as an early, task-specific result, not parity with Jev.
AIUniPat AI's PaperBenchX benchmark found the strongest model, GPT-6 Astra, fully reproduced only 13.98% of 93 real research-paper tasks across 12 scientific fields. Reproduction was judged by regenerating outputs in an isolated environment, with 3,168 expert-verified scoring items. UniPat has open-sourced 12 test tasks and kept 81 tasks closed to preserve long-term evaluation validity.
AINVIDIA, Princeton University, and the University of Maryland introduced PivotOPD, an on-policy distillation method that teaches multi-turn LLM agents to recover from their most damaging early mistake. Tested on Qwen3-1.7B and Qwen3-8B students, it posts the best average against 13 baselines on ALFWorld, WebShop, and Search-based QA. It recovers from 72.7% of replayed pivotal mistakes, versus 20.3% for standard OPD, with no added inference cost.
AIA Galbot, Tsinghua University and collaborators paper won IROS 2026's Best Entertainment and Amusement Paper Award for LATENT, a humanoid tennis-return method trained on imperfect amateur motion-capture clips. In simulation, the full forehand policy succeeded on 96.52 percent of returns, versus 71.85 percent for PULSE. On a real Unitree G1, the paper reports 90.90 percent forehand success across 20 consecutive rallies, with motion capture still used rather than the robot's own cameras.
AIHuawei engineers presented XMFS, an experimental Linux kernel prototype filesystem, at the Linux Plumbers Conference in Prague on October 5. It aims to let applications reach cross-node shared memory on CXL 3.0 or Huawei unified bus servers through standard POSIX file calls. The code exists only on openEuler, not in the mainline Linux kernel.
AIJohns Hopkins astrophysicist Brice Ménard, working as an Anthropic researcher, used Claude Science to produce the first complete map of the sky in ultraviolet light. Claude orchestrated agents to merge GALEX, Swift, and FIMS/SPEAR data, then predicted roughly a third of the sky that no UV telescope had observed, using relationships to visible, infrared, and radio data. Hidden test regions were reconstructed to within about 10% of real measurements, and each pixel is labeled measured or predicted with uncertainty estimates.
Why it matters: The post shows how an astrophysicist used Claude Science agents to merge UV surveys and predict missing sky regions, with a validation step that makes the method reusable.
AIHarvey LAB-AA v1.1 adds hallucination checks that audit every model deliverable against task source documents, with material hallucinations zeroing a task's score. GPT-6 Astra averaged 0.03 material hallucinations per task across 120 tasks, while Gemini 3.8 Flash averaged 13.96. Harvey uses GPT-6 Sol (high) as the hallucination checker, separate from its three-judge rubric panel.
Khazix@Khazix0918PickAI score88AIOpenAI published 722 math manuscripts covering 372 result groups in a new GitHub repository, openai/math, all produced by an unreleased internal model. The author describes the results as including a near-Riemann hypothesis claim pushed to 0.875, and notes that 25 Fields Medal winners criticized the company's approach to AI math research.
Why it matters: The piece traces how AI math results moved from benchmarks to open problems, offering context on verification and the mathematicians' pushback.
elvis@omarsar0AI score67AIA NVIDIA study accepted at NeurIPS 2026 reports that multimodal models refuse harmful requests less reliably when they call tools. Refusal failures rise by up to 68.7% relative and by 17.7% on average across the models tested, including Claude Opus 4.6 and 4.7 and Gemini Agentic Vision. The authors attribute this to tool outputs crowding out the original harmful intent and to attention shifting toward describing tool results. Re-inserting the original request and image before the final response restores part of the lost refusals.
vLLM@vllm_projectAI score46AIThe vLLM team released a technical report on vLLM-Omni, a unified serving runtime for omni-modality generation spanning multi-stage autoregressive pipelines, iterative diffusion, and stateful sessions. Current LLM servers and diffusion stacks each cover only one of these patterns, pushing deployments to stitch disjoint runtimes together. vLLM-Omni offers a shared control plane in which an orchestrator advances requests across stages, specialized engines handle compute, and a connector carries payloads.
