#Data/Training

AINathan Lambert says Trillium Labs would be willing to support open research on how distillation affects frontier AI progress. He says the lab first needs more funding and compute to make that work happen.

AIAdaption Labs has launched Invent-a-dataset, which creates post-training datasets from a natural language description alone. A technical report compares the Invent API against frontier proprietary and open-weight LLMs used for data generation. Sara Hooker's post links to the launch page and the report's technical details.

AIIdeaLens is a detector that identifies whether the ideas in a text came from a human or an AI, rather than judging the prose alone. On mixed-provenance benchmarks, it reached 81.3% average idea-detection accuracy, versus 25.4% for ProseLens and 25.9% for Pangram 4. The model, code, and data are open-sourced, and it was trained on Tinker.

AIMicrosoft's Foundry blog guide advises keeping existing Azure Document Intelligence workloads that meet production requirements. It recommends evaluating Azure Content Understanding for high-variation, unstructured, reasoning, RAG, or multimodal document scenarios, and for new cloud OCR or layout workloads.

AIGoogle released EmbeddingGemma 2 on Hugging Face, and Paige Bailey called it a step toward open models for open science. The post links the model and cites earlier EmbeddingGemma-based projects, including medical, geographic, oncology, and PubMed embedding models.

AINVIDIA's technical blog describes how its team taught robots to assemble GB300 tester trays, a task that currently requires skilled manual labor in factories. The post also discusses lessons about robot learning, mechanical intelligence, and engineering. The source excerpt provides limited detail beyond this.

AIEpoch AI reports that AI models instructed to improve on several benchmarks could already be boosted by a recent human-authored post-training method, on-policy self-distillation (SDPO). The post implies these gains were known before the models' own technique was evaluated.

AIEpoch AI gave Fable 5 and GPT-5.6 Sol 3000 GPU-hours each to develop a new post-training technique intended to outperform the standard GRPO baseline. The post reports the task setup but does not state the results.

AILucas Beyer says robotics is accelerating in the physical world, not just in AI research. He attributes this partly, though not only, to progress in coding models over the past year. The post cites a related thread on scaling a UMI data collection operation from 5 to 90 operators and reaching over 1M unique tasks.

AIGitHub reports that one in three pull requests now involves an AI agent, and that public secret exposures rise with the volume of pushes rather than from declining developer care. It introduces a ModernBERT-based classifier with Microsoft Applied Sciences that evaluates candidate secrets in under two milliseconds and could more than double the secrets prevented at push time. The feature is in private preview, with availability for GitHub Secret Protection customers later this month.

AIDongxi NLP recommends Sherpa, a framework for training LLMs to teach adaptively, tailoring instruction to individual learners rather than simply solving problems. The post presents this as a way for AI to support human learning instead of replacing human teachers, citing the principle of teaching according to each student's aptitude.

AIThe post argues that companies are increasingly recognizing business opportunities from reinforcement learning, since many real-world tasks need specialized models, harnesses, and data flywheels rather than AGI. It predicts a new post-training era led by full-stack AI companies, though it provides no concrete figures or raw data to support the claim.

AIUnsloth says users can train their own Decision Model on as little as 2.5GB of VRAM using small models such as Laya. Training is done through a UI, with a video tutorial and guide linked from the post and the project's GitHub repository.

AIA new model extracts values absent from a document by computing them from figures that are present, such as deriving a yearly product cost from a monthly price. Santiago says the video shows examples of inferring complex formulas. The background post describes this as Higher-Order Extraction, which deterministically computes needed numbers from raw page values.

AIPerplexity has published both pplx-embed-v2 models on Hugging Face, with the collection available at the linked URL. The post provides no further details on model sizes, benchmarks, or capabilities.

AIMicrosoft Research Asia has open-sourced Agent Lightning v1.0, a roughly 3,500-line agentic RL framework that trains the same agent harness used in deployment. In an end-to-end coding agent pipeline, Qwen3.5-9B rose from 41.8% to 56.4% Pass@1 on SWE-bench Verified using about 6,000 training samples. The framework runs agents as standard Kubernetes jobs without paid commercial sandbox services.

Why it matters: The source shows how training with the deployed agent harness avoids rebuilding agents, and reports concrete SWE-bench Verified gains from about 6,000 samples.

AIAi2 is making new Stage 1 checkpoints available, with the byte-level components already trained and the original model's weights left unchanged. Researchers can use them to test new architectures and train the full system without repeating that initial stage.

AIAi2 introduces Bolmo, a model that operates on bytes rather than tokens, which the team hopes will lead to larger models adapting how they represent information across languages and domains. Because bytes can also represent images and audio, the approach could eventually extend beyond text.

AIAi2 describes a recipe that adapts existing models to process raw bytes through a brief additional training run. The approach keeps the model's core intact and adds components that group bytes into variable-length patches for processing, then expand outputs back to byte-level predictions of the next byte.

AIMost language models split text into subwords from a fixed vocabulary, which can obscure spelling details and fragment meaningful units in code or math. Byte-level models instead work directly with the bytes computers use to represent text.

AINVIDIA's cuOpt decision optimization software now targets problems with 100 million variables using mPDLP. The source says cuOpt already delivers more than 10x speedups over CPU solvers, while detailing little else about mPDLP's design or availability.

AIGoogle's Gemma account promotes research showing how AI can help scientists secure the global food supply, linking to a Gemma 4 and BOTANIC-1 demo on Hugging Face. The post also offers the BOTANIC-1 download and the accompanying paper.