# Airbnb shares when to fine-tune a 2B model for production classifiers

> Original title: Everyone’s excited about decision models. When should you buy one, or train your own?

- Source: Ahmad Al-Dahle
- Published: 2026-11-04T21:52:49.000Z
- Bad Influence: https://badinfluence.news/items/ujfuk27oyl5ll3hw6ii56j9fu
- Original: https://x.com/Ahmad_Al_Dahle/status/2118099171051962831

## Summary

Airbnb says a fine-tuned 2B model reached frontier-level quality for a production classifier at 35ms latency and about 1% of the cost. The post shares guidance on when fine-tuning a model is worth it and when it is not, with a production benchmark of LLM classifiers.

## Post

Everyone’s excited about decision models. When should you buy one, or train your own?

We fine-tuned a 2B model for a production classifier: frontier-level quality, 35ms, ~1% of the cost.

We’re sharing when we think it’s worth it, and when it isn’t: https://airbnb.tech/ai-ml/frontier-quality-at-1-of-the-cost-a-production-benchmark-of-llm-classifiers/

![](https://badinfluence.news/api/img-proxy?u=https%3A%2F%2Fpbs.twimg.com%2Fmedia%2FHWT2dBuakAAFCvP.jpg&mode=thumb&exp=1794096000&sig=7f68009f921fe8f3)