Ankit Garg

Microsoft proves an exponential retrieval gap, and ColBERT holds a 99% lead after fine-tuning

Microsoft Research India proved single-vector embeddings need exponentially more dimensions than multi-vector ones to rank correctly, and on their new ANDOR benchmark a small ColBERT model beats OpenAI's largest embedder 16x at Recall@2 zero-shot.