# Inference vendors' value rests on scarce GPUs, infra ease, and data security

> Original title: Most important stuff inference vendors offer:

- Source: Gergely Orosz
- Published: 2026-11-09T21:13:17.000Z
- Bad Influence: https://badinfluence.news/items/rdl98kw8xljf7saxgs7xq16in
- Original: https://x.com/GergelyOrosz/status/2119901162828947695

## Summary

Gergely Orosz says inference vendors sell three things: access to hard-to-get GPUs, infrastructure abstraction that simplifies operations, and privacy and security of customer data. He argues a data breach would normally be very damaging, but GPU scarcity leaves customers with few alternatives. The post cites Fireworks, after a hack exposed customer data, as a case where some customers are considering leaving the platform.

## Post

Most important stuff inference vendors offer:

1. Access to GPUs (hard to get!)

2. Infra abstraction so it's easier to operate

3. Privacy of data and security

Usually, a breach would be very bad. BUT GPUs are so scarce today that customers don't have all that many options...

## Quoted post @steph_palazzolo

> Fireworks, the most highly-valued out of a growing group of inference providers, told customers including Harvey that it had been hit with a hack that exposed customer data. Some customers are now considering moving their business off the platform.
> 
> https://www.theinformation.com/articles/new-fireworks-hack-threatens-1-billion-business

https://x.com/steph_palazzolo/status/2119879358575714545