Two-tower embeddings are familiar; I like the care they take with training labels. A conversion is an imperfect positive, while a non-conversion isn’t automatically a negative when brand, flavor, or nutrition preferences can explain it. That asymmetry is worth keeping in mind when learning retrieval from implicit feedback.

I’d start with the cheese-board example: residual-quantized codes give cheeses, olives, tapenade, and deli trays shared prefixes across taxonomy branches, then finer levels separate close substitutions from looser accompaniments. That makes the representation easy to reason about, though the examples show what the codes mean, not whether they improve recommendations; the interesting angle is using grocery taxonomy structure as a supervision signal alongside product embeddings.

On a sub-billion-parameter model, Tulip’s scheduler sees the GPU saturate at around 512 tokens, after which packing in more sequences doesn’t improve efficiency. I like the focus beyond kernels: whole-model CUDA graphs and lazy result tracking let CPU scheduling overlap with GPU work, a serving detail that matters for both low-latency queries and large embedding batches.

I can’t judge the reported 12.5% accuracy lift without the evaluation details, but the two-index explanation is worth reading: semantic search handles intent, while sparse n-grams handle exact patterns, and each covers a gap in the other. The more unusual detail is training embeddings from agent-session traces, with an LLM ranking what should have surfaced earlier; the author’s suggested contrastive objective is clearly marked as inference, not a confirmed implementation detail.

This guide explains how to train and fine-tune multi-vector embedding models—such as ColBERT-style encoders—in Sentence Transformers. Instead of compressing an entire document or query into one vector, these models retain multiple token-level representations and use late-interaction scoring for more expressive retrieval.

• Multi-vector encoders represent each input as a sequence of embeddings, enabling fine-grained query–document matching while remaining compatible with approximate retrieval pipelines.
• Late interaction commonly scores a query and document with MaxSim: for each query token, find the most similar document token, then sum those maximum similarities.
• Sentence Transformers provides reusable modules and training objectives for in-batch negatives and hard-negative fine-tuning, making experimentation with custom multi-vector architectures more practical.