Zyphra describes top-p tree routing for query retrieval

AIZyphra says each query starts at the top of the tree and recursively follows promising branches down to the original keys during generation. It adds that top-p routing adapts to query complexity, exploring few branches for precise lookups and more for complex queries, whereas top-K routing must discard evidence as context grows.

ZyphraOfficial

@ZyphraAI

View on X

Part of a thread · earlier post

During generation, each query starts at the top of the tree and recursively follows promising branches to the original keys.

While top-K routing must discard evidence as context grows, top-p adapts: precise lookups explore few branches, but complex queries can explore more.

Source details

Zyphra · x.comPublished Nov 2, 5:04 PM ET · added here 5:21 PM ET

Original title: During generation, each query starts at the top of the tree and recursively follows promising branches to the original keys.

Topics

Deployment & engineering Data & training Tutorials & how-to