Preserve Token-Level Signals with Late Interaction Retrieval
A single embedding compresses an entire query or document into one vector before similarity is computed. That representation is convenient for approximate nearest-neighbor search, but every token-level signal must survive the compression step. Late interaction retrieval keeps the independent encoding property while postponing part of the query-document comparison until search time. The core change is representational. Instead of storing one vector per document, a late interaction model can retain a set of contextual token vectors. A query is also represented by multiple vectors. Relevance is then computed from interactions between those two sets rather than from one global dot product.