Skip to content
Trending storyDeveloping

Perplexity releases pplx-embed-v2 embedding models trained on distilled chunk relevance scores

4 articles1 sourcesince Nov 2Last article 2h ago ·

Overview

AISummary of 4 articles

Perplexity Developers releases pplx-embed-v2-context, open-weight vision-language embedding models in 9B and 0.6B sizes.

The company says it trains its contextual embedding models on chunk-level relevance scores distilled from a query-aware context compression model in its answer pipeline, instead of one gold chunk per query, and no longer treats supporting chunks as negatives. Both models return one int8 vector per document, or one per chunk that sees the whole document, and also support a non-contextual mode with one embedding per document.

Perplexity says the 0.6B model is the strongest sub-1B model on ViDoRe-V3 markdown, and the 9B contextual model with 128-token chunks ranks second only to voyage-context-4. It also says the text-only 9B model beats Nemotron-3.5-Embed-8B on visual documents on ViDoRe-V3, using two 1024-dimensional embeddings per page with a 4x smaller index. These benchmark results are Perplexity's own claims.

Written by AI from the articles below · updated Nov 2, 5:22 PM ET

Check the sources:

Developments

4 developments

  1. Nov 2, 4:51 PM ET · 1 article
    Perplexity releases 9B and 0.6B embedding models that beat leading retrievers on visual documents
    Perplexity Developers: Perplexity's text-only 9B embedding model beats leading retrievers on visual documents
  2. Nov 2, 4:51 PM ET · 1 article
    Perplexity's embedding models rank top on ViDoRe-V3 markdown retrieval
    Perplexity Developers: Perplexity's embedding models rank top on ViDoRe-V3 markdown retrieval
  3. Nov 2, 4:50 PM ET · 1 article
    Perplexity describes training contextual embedding models with distilled chunk-level relevance scores
    Perplexity Developers: Perplexity trains embedding models on distilled chunk-level relevance scores
  4. Nov 2, 4:50 PM ET · 1 article
    Perplexity Developers introduces pplx-embed-v2-context, open-weight vision-language embedding models in 9B and 0.6B sizes
    Perplexity Developers: Perplexity releases open-weight pplx-embed-v2-context embedding models

Article timeline

The articles in this story. Times are ET.

Nov 2
  1. Perplexity DevelopersOfficial
    Perplexity's text-only 9B embedding model beats leading retrievers on visual documents

    AIPerplexity says its 9B embedding model, trained only on text, outperforms the leading dense retrievers on visual documents. Using two 1024-dimensional embeddings per page, it beats Nemotron-3.5-Embed-8B on ViDoRe-V3 with a 4x smaller index.

  2. Perplexity DevelopersOfficial
    Perplexity's embedding models rank top on ViDoRe-V3 markdown retrieval

    AIPerplexity says its 0.6B embedding model is the strongest sub-1B model on ViDoRe-V3 markdown, whether chunked or unchunked. Its contextual 9B model with 128-token chunks ranks second only to voyage-context-4. Both models also support a non-contextual mode that creates one embedding per document without chunking.

  3. Perplexity DevelopersOfficial
    Perplexity trains embedding models on distilled chunk-level relevance scores

    AIPerplexity says its contextual embedding models are trained differently from other contextual embeddings models. Instead of one gold chunk per query, chunk-level relevance scores are distilled from a query-aware context compression model in its answer pipeline, and supporting chunks are no longer treated as negatives.

    Image from @perplexitydevs's post
  4. Perplexity DevelopersOfficial
    Perplexity releases open-weight pplx-embed-v2-context embedding models

    AIPerplexity releases pplx-embed-v2-context, open-weight vision-language embedding models in 9B and 0.6B sizes. Both return one int8 vector per document, or one per chunk that sees the whole document.

    Image from @perplexitydevs's post

Heat Trend

Not enough continuous observations to show a trend yet.