#Data/Training

AINumerical differences between a rollout engine and a trainer can make reinforcement learning collapse even when algorithm and data stay identical. In a GLM 5.2 experiment, reward fell from about 0.9 to under 0.2 around step 20 without alignment, while aligned numerics kept reward stable over 25 steps. A Qwen3.5-MoE investigation traced a significant mismatch to how expert outputs were combined, and router replay alone was judged insufficient.

AIMicrosoft's Azure AI team argues that better models do not eliminate the need for a dedicated content extraction layer, since agents need trustworthy, structured, and auditable inputs. The post notes that building extraction directly on an LLM quickly demands chunking, layout parsing, grounding, normalization, and evaluation infrastructure. Microsoft positions Azure Document Intelligence and Azure Content Understanding in Foundry Tools as managed options for that layer.

AIwh announced joining Proximal in San Francisco, citing open problems in data and post-training for large models. Proximal builds infrastructure that lets AI improve from real-world experience, and the background describes over $200M in annualized revenue from helping frontier labs and enterprises improve coding agents.

AIMicrosoft has made SQL Server on Azure Local generally available for connected and disconnected deployments, letting organizations run SQL Server in their own datacenters and edge locations. Disconnected operations continue locally where external connectivity is restricted or unavailable. Eligible existing SQL Server licenses can be used, and Foundry Local on Azure Local, currently in preview, brings AI inference alongside SQL Server data.

AIProximal, a year-old startup supplying coding data to AI labs, raised funding from General Catalyst at a $300m valuation. In the past 10 months, it has surpassed $200m in annualized revenue, reflecting the labs' ongoing demand for data.

AIMicrosoft Research introduced Quine, an experimental research system combining a multimodal world model of biology with an interactive harness that connects models, scientific tools, literature, and researchers. In a pancreatic cancer study with the Broad Institute, Quine prioritized compounds that shifted tumor cell states, and several top-ranked candidates were validated in wet-lab assays. Access is initially limited to the Quine Fellows program and select collaborations, and the system is intended for research use only, not clinical use.

Why it matters: The post shows how a multimodal biology world model is wired into a harness, grounded in one wet-lab cancer example and a limited fellows-program access path.

AISebastian Raschka traces text classification from bag-of-words models such as naive Bayes and logistic regression through pre-transformer neural networks, then sets up an analysis of the recently released Jev AI model. The article frames Jev as a general-purpose classifier that trades specialized accuracy for speed, cost, and breadth of tasks.

AIMicrosoft is bringing business context from Fabric IQ into Microsoft Copilot, with Fabric IQ in Copilot Chat and Cowork generally available and integration into the new Code experience coming soon through the Frontier program. Power BI is also gaining agentic app creation in Power BI Desktop, letting users generate applications from trusted semantic models and publish them to Microsoft Fabric.

AIThomas Wolf, owner of the Hugging Face account, posted the single word "impressive" in response to a quoted post. The quoted post reports a new NanoGPT training record of 39.9s, down 27.7s from the prior 67.6s, achieved through per-flop optimizations such as sampled softmax and sparse updates.

AIMastra has added memory hooks that let developers monitor or alter an agent's observational memory cycles. Lifecycle hooks such as onObservationStart and onReflectionEnd report on each cycle, including token usage for spotting cost spikes, while transform hooks like beforeObservation and afterReflection can prune, remove, or redact memory data.

AIAlexander Doria says high parameter capacity still matters for harder document processing, running Astra for initial annotation and Gemma 4 31B for finetuning. Yifei Hu reports that gpt-6-sol improved over last week's version on domain-specific document parsing but remains far behind gpt-6-astra, with the benchmark itself built using Astra.

AIMicrosoft Research Asia – Singapore, opened July 24, 2025 as Microsoft's first Southeast Asian research lab, reports progress after its first year. The lab's work spans next-generation AI models and agentic systems, domain-specific AI for real-world impact, AI-native research practices, and ecosystem and talent development. Its healthcare collaborations on multimodal and agentic AI for clinical decision-making are being deployed through partnerships across Singapore's healthcare ecosystem.

AISparse attention cuts per-operation KV cache reads but does not reduce overall memory capacity, so top-k cache misses still depend on HBM. SemiAnalysis's InferenceX estimates GB200 at about $0.044 per million total tokens at 150 tokens per second, roughly 12% below MI355X running ATOM at $0.049. Neither system holds a uniform cost advantage across the tested 100, 125, and 150 tokens-per-second targets.

AIEpoch AI estimates that the cheapest cost of reaching a given benchmark score has fallen about 13× per year over the past five years, faster than DNA sequencing, compute, lithium batteries, or electricity. Its example: a 75% GPQA Diamond score that cost about 30 cents per question with o3 in January 2025 cost $0.0004 per question with GPT-5.6 Luna under 18 months later. The authors caution that benchmarks are imperfect proxies for market prices, and the decline rate slows over time.

Why it matters: The source compares AI price declines with other transformative technologies using benchmark-based cost estimates, giving readers a measured sense of how fast cost per capability is falling.

AITwo South Korean companies, SK Hynix and Samsung, control 83% of the global memory chip market and are competing to deepen ties with U.S. AI firms. Samsung has more than doubled its market share over the past year, while SK Hynix has held a long lead in high-bandwidth memory and is building a $4 billion advanced packaging facility in Indiana. Both remain exposed to China, where they face new U.S. licensing requirements and growing domestic competition.

AIA blog post by @Reveur_7 asks whether GEPA-style evolutionary search can improve NVIDIA's Graph-as-Policies, which generates robot controllers. Matei Zaharia praises the research as a cool approach to automatically generating state-of-the-art robot controllers.

AIAlexander Doria argues that embedding AI models in industrial processes requires easing audits and supporting local languages and professional registers. He says this need is real despite sarcasm about the idea. Background from Aleph Alpha notes that reasoning models think in English even for German prompts, and that small German reasoning data doses can hurt performance while large doses mostly recover it.

AIXiaomi MiMo reports that tool-call repetition in MiMo-V2.6 reached over 0.05% of responses across agent harnesses, causing stalled agents and wasted context. The team traced the cause to an RL flooding penalty set at 32 calls per turn, which missed smaller excess behavior, and replaced the approach with a specialized teacher distilled via MOPD. Repetition rates for both Pro and Flash dropped substantially, at roughly $90,000 versus an estimated $2.31 million for the alternative fix.

Why it matters: The post traces an agent failure to a reward blind spot and compares the costs of two fixes, offering a transferable debugging method for RL-trained tool-calling models.

AIWill Depue says a pretraining API for Tinker would be very successful, likely mainly through enterprise and quote-based sales. He notes there is no good open-source pretraining stack, unlike the available open-source options for RL.

AIA neolab is a startup of AI researchers that raises large pre-production funding to finance GPU compute, with 1000 GB300s (about 14 NVL72 racks) costing $125-150M over 3 years, roughly 2-2.5MW. That buys about 10^25 FLOPs per quarter, enough for a GPT-4-level model that is 1-2 OOMs behind the frontier for pretraining. Recouping $10M in training at 50% inference margin would take serving about 10T tokens at a $2/M blended price, so neolabs often pivot to a different model game, proprietary data, or high-revenue niches.

AIXiaomi released an open-source RL environments repository, MiMo-V2.6-RL-oss, on Hugging Face. Hugging Face CEO Clément Delangue promoted the release, and a commenter estimated that comparable commercially sold tasks cost hundreds to thousands of dollars each.

AISemiAnalysis tore down Intel's Panther Lake chip, examining its 18A process with RibbonFET gate-all-around transistors and PowerVia backside power delivery. Measurements put 18A compute logic and TSMC N3E GPU logic at similar logic density, though 18A does not lead TSMC N3P, N2, or Samsung SF2 in peak density. The analysis also compares the compute, GPU, I/O, and Foveros-S packaging against Lunar Lake and Samsung's SF2 process.

AIAlexander Doria reports that the released set is a smaller selection of 989 environments for RL training a 9B distilled model, not the full MiMo. Rewards are not self-contained: the general part requires setting up a judge, and webdev relies on its own grader service and VLM. The most important content is in the general/envs directory and Docker setup rather than the Hugging Face dataset, offering a solid mix of real and simulated documents.

AIShanghai AI Lab's InternLM released Intern-Decision-4B, a multimodal structured decision model fine-tuned from Qwen3.5-4B, which returns answer distributions for multiple questions in one forward pass. On its benchmark table it scores an average of 90.02 with a Brier score of 0.347 and an ECE of 0.065, and per-query latency averages 44.16 ms on a single RTX 4090. The model is available with a Python DecisionEngine inference interface.

AIInternLM released Intern-Decision-0.8B, a multimodal structured decision model fine-tuned from Qwen3.5-0.8B that scores answers to multiple questions in one forward pass. The model reports a 79.38 average score and a 33.98 ms mean latency on a single RTX 4090, with 0.8B, 2B, and 4B sizes available. It is accessed through a Python DecisionEngine API that returns calibrated probabilities rather than generating free-form text.

AIGoogle Cloud has launched a managed reinforcement learning fine-tuning service (RLFT) that lets customers adapt Gemini models using a reward function they define instead of labeled answers. Users supply prompts and a reward function, while Google handles the RL infrastructure and proprietary model internals. The guide advises exhausting prompting and supervised fine-tuning first, and notes that RLFT suits tasks that are easy to score but hard to demonstrate.

AISemiAnalysis's China Datacenter Model tracks over 1,000 facilities across 60+ operators and puts China's fleet above 24GW, larger than EMEA. The report attributes the buildout to the Eastern Data, Western Compute policy and hyperscale AI demand, which is moving capacity to western hubs such as Inner Mongolia at construction speeds it says the West cannot match.