Jev model chooses from predefined outputs, promising very cheap inference
Original titleInteresting approach. Models can't output freeform text but can choose from a set of predefined values. Could be useful for data labeling...
AISummary
Chip Huyen praises an approach where models select from predefined values rather than generating freeform text, which she sees as useful for data labeling and fixed-action tasks. She notes that how reasoning would work is unclear, but the approach is very cheap because output tokens are free.
Source: Chip Huyen · x.comPublished · added here