Pro-2B pretraining cost under $5,090 on a single RTX 5090 setup
Original title (Chinese)
小团队也能预训练!普罗2B:RTX5090训练成本不到5090美元
AISummary
The Pro-2B project reportedly trains a 2B-parameter model on RTX 5090 hardware for under $5,090 in total cost. The source frames it as a way for small teams to try billion-parameter, trillion-token pretraining without the budgets of large labs.
Source: AI Era · aiera.com.cnPublished