Skip to contentSkip to stories

Updated

#Data/Training

Showing low-relevance items too. Hide low-relevance items

Oct 1

Oct 1Thu
  1. Prime IntellectOfficialAI score34

    Qwen3.6 reward rises 2.8x via GRPO on Hosted Training

    AIPrime Intellect reports that after about 100 GRPO steps on Hosted Training, Qwen3.6's reward on held-out problems rose from 0.127 to 0.361, a 2.8x gain. Qwen3.5, trained the same way, reached 0.356, suggesting the method works across model families. Both post-trained models finished well ahead of other open models and narrowed the gap to Claude Opus 4.8, with Qwen3.6 activating only 3B parameters per token.

    Image from @PrimeIntellect's post
  2. Prime IntellectOfficialAI score12

    Extropic and Prime Intellect Divide Roles in an RL Training Setup

    AIExtropic designed the tasks and reward, while Prime Intellect supplied the RL infrastructure, including verifiers for environment construction, Hosted Training for the RL loop, and Prime Sandboxes for executing model code. Prime Inference serves the LLM judge and frontier baselines in the same workflow.

    Image from @PrimeIntellect's post
  3. Yellowbrick InvestingXAI score18

    Yellowbrick 2.0 launches with leaderboards, API access, and custom feeds

    AIYellowbrick 2.0 is live, tracking 35,000+ stock pitches from 4,000+ authors and adding 300+ new pitches weekly. The rebuilt platform adds author leaderboards, custom feeds and alerts, API access, and paid research partner discounts. Premium subscribers get a 30% discount on Koyfin, which the company says covers the cost of Yellowbrick Premium.

  4. ZyphraOfficialAI score20

    Zyphra's Results Explain How NoPE Models Encode Position

    AIZyphra says its results clarify how state-of-the-art NoPE models encode position and which inductive biases support generalization. It adds that global NoPE could enable models to extrapolate to contexts longer than those seen in training, potentially indefinitely.

  5. ZyphraOfficialAI score23

    Hybrid NoPE models pair local attention with global NoPE layers

    AIHybrid NoPE models combine sliding window attention or recurrent layers, which focus on nearby words, with global attention layers that use no positional encoding (NoPE). The post notes that NoPE layers receive no positional information yet can still learn long-range dependencies, and raises the question of how this works.

    Image from @ZyphraAI's post
  6. Jerry LiuXAI score42

    LlamaIndex launches Extract v2.5 document extraction agents with improved accuracy

    AILlamaIndex introduced Extract v2.5, a series of agents tuned for document extraction across cost-effective, agentic, and agentic plus tiers. The company reports the agents outperform Opus 5.5 and GPT-6 Sol while costing 30% to 4x less, with accuracy gains on long lists (86.1% to 95.5%), multi-page records (85.5% to 96.5%), and scanned forms (90.9% to 95.7%) on its agentic tier. The release adds advanced citations with bounding boxes and structural reasoning, and the agents are available on LlamaParse.

    Video from @jerryjliu0's post
  7. merveXAI score46

    Hugging Face clarifies ml-intern options, one trained model for $6

    AIHugging Face says ml-intern is an open-source ML engineering and research harness usable free on local setups, and it is also hosted on Hugging Chat with no-code access. A second hosted option runs on Hugging Face infrastructure, where ml-intern selects the cheapest GPU for a task so models can be trained for a few dollars. MaziyarPanahi reportedly trained a model by prompting alone for $6.60 on an NVIDIA A100 in 16 minutes.

  8. Alexander DoriaXAI score54

    SYNTH paper proposes fully synthetic single-stage training for reasoning models

    AIThe SYNTH paper, titled It's All Training, presents a fully synthetic single-stage pipeline for training workable reasoning models with high data efficiency. The authors argue this approach does not separate training into pretraining, mid-training, or post-training stages. The image shows the paper's abstract, which describes a pipeline built from a 58,000-article Wikipedia-based synthetic corpus and models named Baguettotron-600M and Baguettotron-MoE.

    Image from @Dorialexander's post
  9. DatabricksOfficialAI score18

    Databricks launches ai_decide for fast, governed AI decisions

    AIDatabricks has introduced ai_decide, a new AI Function for fast, structured decisions over governed data. It classifies, scores, and chooses next actions in a fraction of a second, with lower latency and cost than an LLM on similar tasks. It is suited to model routing, document processing, agent evaluations, and real-time app logic.

    Video from @databricks's post
  10. The SequenceBlogAI score38

    The Sequence explores creating a futures market for AI compute capacity

    AIThe Sequence argues that AI compute could become a commodity that requires a futures market, because unused GPU-hours cannot be stored and suppliers and buyers face forward-price risk. The piece says realizing this requires defining what is traded, measuring its quality, and building contracts around its risks, drawing on commodity market history.

  11. Ai2 (Allen Institute for AI)OfficialAI score62

    Ai2 releases Olmo-core 3, an open framework for training large MoE models

    AIAi2 released Olmo-core 3, an open training framework redesigned to scale mixture-of-experts models into the trillion-parameter range. In one benchmark, expert count rose from 8 to 128 with about 3.2B active parameters per token, total capacity grew from 4.6B to 47B, and throughput fell by less than 5%. The framework is fully open, so researchers can train their own MoEs and experiment with routing and parallelism.

    Why it matters: The release documents concrete MoE scaling results and reported failure modes, useful for teams weighing training-stack tradeoffs before adopting an open framework.

  12. Anthropic ResearchOfficialAI score60

    Matthew Schwartz on finding Claude-shaped science problems with BootLoops

    AIPhysicist Matthew Schwartz describes building BootLoops, an open-source harness for exact quantitative calculations, after choosing problems suited to Claude's strengths. He reports that Claude solved long-standing integrals and found connections across ecology, population genetics, economics, and linguistics, with domain experts steering results toward questions those fields care about. The post states that the approach required constant human oversight, since Claude often overstated results and misjudged time.

    Why it matters: The guest post explains why scientists often find current AI tools frustrating and offers a method for finding problems where AI and researchers match, backed by concrete projects.

  13. Mastra BlogOfficialAI score26

    Mastra Platform Adds VPC-Isolated Postgres Databases for Same-Network Access

    AIMastra platform now lets users attach a VPC-isolated Postgres database to any environment, restricting access to resources on the same network. The database cannot be reached from outside the network, so psql connections from external clients return an error. VPC Postgres joins Turso and Neon as managed database options, with MongoDB and Redis coming soon; it requires mastra@1.32.0 or later.

Sep 30

Sep 30Wed
  1. Apple Machine Learning ResearchOfficialAI score36

    RLTL;DR: Self-Improvement Through Internalized Self-Generated Feedback

    AIApple researchers introduced RLTL;DR, a reinforcement learning method in which an agent writes its own one-line insight after each failed attempt and learns to map tasks to those insights. On challenging tool-calling and coding datasets filtered to Pass@128 = 0, standard GRPO training of a Qwen 3.5 9B Thinking policy stayed at 0% to 1% Pass@1, while RLTL;DR reached 14–31% with insights in context and 12–13% without them at evaluation. A compact variant, SFTL;DR, trained on just 4k task-insight tuples recovered nearly the full performance of RLTL;DR.

  2. PerplexityOfficialAI score20

    Perplexity distills query-aware compression scores to train retrieval embedders

    AIPerplexity overcomes gold-chunk supervision limits by distilling relevance from its query-aware context compression model. The model scores every document token against the query, and those scores, aggregated into chunk-level targets, train the embedder to retrieve answer and supporting chunks.

    Image from @perplexity_ai's post
  3. LlamaIndex 🦙OfficialAI score14

    LlamaIndex hosts document-processing events for AI agents in New York and San Francisco

    AILlamaIndex held Tuesday-night events in New York and San Francisco on document processing for AI agents, with the New York room filling a waitlist and San Francisco drawing almost 600 attendees. The talks focused on the problem that agents often receive document text without its layout, so they must guess which figures, such as a monthly rate versus a total on an invoice, mean what.

    Image from @llama_index's post
  4. O'Reilly RadarBlogAI score45

    The Agentic Data Science Playbook: Delegating Analysis to AI Agents

    AIAgentic data science has AI agents explore datasets, choose modeling approaches, run analyses, and explain findings while data scientists frame questions and verify evidence. In an experiment, Claude Opus 5.0 given the vague prompt "Build me a model to detect fraudulent nodes" on a modified Elliptic Bitcoin dataset reported F1 0.87 and ROC AUC 0.99 using a random split that leaked a planted label proxy.

  5. Microsoft ResearchOfficialAI score29

    Microsoft Research ML system predicts space-weather damage 30-60 minutes early

    AIMicrosoft Research has developed a machine learning system that predicts where extreme space-weather events are likely to damage power systems 30-60 minutes before a storm arrives. Such storms can also degrade GPS accuracy and satellite operations, so advance warning could help operators prepare.

    Video from @MSFTResearch's post
  6. Microsoft ResearchOfficialAI score46

    Machine learning system forecasts space-weather grid risk for 66,935 U.S. substations

    AIMicrosoft Research intern-developed machine learning pipeline forecasts location-specific geomagnetic risk for 66,935 substations in the continental United States. It combines solar-wind observations, AE and Dst forecasts, geological conductivity and grid data to estimate risk 30 to 60 minutes ahead. The pipeline detected nearly 80% of major space-weather events during the evaluation period.

  7. Liquid AIOfficialAI score42

    LongevityBench: Liquid AI's compact LFMs beat frontier models on aging tasks

    AILiquid AI and InSilicoMeds released LongevityBench, an aging benchmark with 17 tasks spanning clinical records, DNA methylation, transcriptomics, proteomics, and genetics. On several tasks, Liquid AI's compact LFMs outperformed every frontier model the team evaluated. The team plans to present the work to the longevity research community at ARDD this week.

    Video from @liquidai's post
  8. Azure BlogOfficialAI score36

    Azure Circular Centers recover value from retired hyperscale hardware

    AIMicrosoft says its Circular Centers now operate eight facilities across North America, Europe, and Asia Pacific to decide the next life of decommissioned Azure hardware. Last year, Microsoft achieved a 92% reuse and recycling rate for decommissioned servers and components. Since 2014, Azure cores per rack have increased about 13-fold while power for the same task fell roughly 90%.

  9. OpenBMBOfficialAI score42

    Diffusion Reward Models learn full human preference distributions, not single scores

    AIOpenBMB introduces Diffusion Reward Models (DRM), which learn the full reward distribution of human preferences instead of collapsing them into one scalar score. The approach preserves disagreement and uncertainty, enabling distribution-aware Best-of-N ranking and a new test-time scaling axis by sampling more reward outputs. DRM also improves downstream policy performance over scalar reward baselines when used as the reward in RLHF, according to the post.

    Image from @OpenBMB's post
  10. X.PINXAI score72

    DeepSeek releases Ascend versions of its core kernel toolkit

    AIDeepSeek has released an Ascend toolkit that mirrors its Nvidia components, including TileLang, DeepGEMM, DeepEP, TileKernels, FlashMLA and DeepSelect. It says every TileLang kernel used in its training now has a high-performance Ascend implementation. The post also reports that a 128-card Ascend 950 supernode, jointly optimized with Huawei, has key compute and communication tests approaching hardware limits.

    Image from @thexpin's post

Sep 29

Sep 29Tue
  1. Jerry LiuXAI score20

    Jev, a System One model, tops OSS rivals on document tasks

    AIJerry Liu says Jev, a System One model, outperformed other open-source classifiers and document-specific models on orientation detection, language detection, classification, and splitting. The benchmark measured accuracy, cost, and latency across these fast document decisions, with Jev leading most comparisons. The benchmark code is available in the run-llama/jev_vs_oss repository.

    Video from @jerryjliu0's post
  2. Jerry LiuXAI score22

    GPT-6.1 Sol Improves Table Parsing and Reading Order in OCR Benchmarks

    AIJerry Liu benchmarked gpt-6.1 sol on document OCR tasks and found a sizable increase in table parsing and reading order over gpt-6 sol from a week earlier. Its table parsing is similar to gpt-6 astra. He noted frontier models still cost roughly an order of magnitude more than cost-effective document parsing solutions, leaving room to improve the premium end above 1c per page.

    Image from @jerryjliu0's post
  3. Fireworks AI BlogOfficialAI score51

    Fireworks explains how numerical mismatch and MoE routing can derail RL training

    AINumerical differences between a rollout engine and a trainer can make reinforcement learning collapse even when algorithm and data stay identical. In a GLM 5.2 experiment, reward fell from about 0.9 to under 0.2 around step 20 without alignment, while aligned numerics kept reward stable over 25 steps. A Qwen3.5-MoE investigation traced a significant mismatch to how expert outputs were combined, and router replay alone was judged insufficient.