By spending lots of compute at indexing time, you can reuse that computation to get better performance without increasing inference-time compute!
Original titleBy spending lots of compute at indexing time, you can reuse that computation to get better performance without increasing inference-time ...
AISummary
Embeddings are the simplest mechanism that achieve this!
Source: Aman Sanger · x.com