Global Table of Contents
A map of every note in the vault organized by category and theme. This index tracks concepts, topics, people, tools, companies, case studies, conferences, and datasets.
Maps of Content
- All about Information Retrieval & Search — top-level overview
- Concepts · Topics · People · Tools · Case Studies · Videos · Conferences · History · Index
Concepts
Lexical & Sparse Retrieval
BM25 · Bayesian BM25 · Bag-of-Documents Model · Full-Text Search · WAND · Block-Max WAND · Sparse Vector Retrieval · Learned Sparse Retrieval · SPLADE · ELSER · miniCOIL · Sparse Embeddings · Collocations · Out-of-Vocabulary
Dense Retrieval & Embeddings
Embeddings · Dense Embeddings · Dense Vector Retrieval · Semantic Search · Asymmetric Semantic Search · Bi-Encoder · Dense Passage Retriever · BERT · Word2Vec · Word2Box · Concept Vectors · Matryoshka Embeddings · Multimodal Embeddings · Compositional Embeddings · Task-Aware Embeddings · Embedding Fine-tuning · Pooling · Zero-Shot Retrieval · Vector Similarity Metrics · Contrastive Gap · Modality Gap
Geometric & Set-Theoretic Embeddings
Set-Theoretic Embeddings · Box Embedding · Gaussian Embedding · Poincaré Embedding · Region-Based Representation
ANN Indexing & Quantization
ANN · Brute-Force Vector Search · HNSW · IVF · LSH · ACORN-1 · Vector Filtering · Wormhole Vectors · Vector Quantization · Scalar Quantization · Binary Quantization · BBQ · RaBitQ · TurboQuant · ASH · ITQ · Token Pooling
Dimensionality Reduction
Dimensionality Reduction · PCA · UMAP · t-SNE
Late Interaction & Multi-Vector
Late Interaction · ColBERT · ColPali · MUVERA
Reranking & Cross-Encoders
Reranking · Cross-Encoder · MonoT5 · RankGPT · RankLLaMA · Knowledge Distillation
Learning to Rank
Learning to Rank · LambdaMART · LambdaLoss · RankNet · LTR Feature Engineering · Hashing Trick · Ranking Objectives · Ranking Signal Selection · Pointwise Relevance Evaluation · Pairwise Relevance Evaluation · Listwise Relevance Evaluation · Feature Store · Results Boosting
Hybrid Search & Score Fusion
Hybrid Search · Reciprocal Rank Fusion · Linear Score Combination · Relative Score Fusion · Score Normalization · Semantic Boosting
Query Understanding
Query Understanding · Query Segmentation · Query Specificity · Query Types · Query Sampling · Search Intent · Intent Drift · Keywords Extraction · Compositional Queries
Lexical Query Operations
Tokenization · Spelling Correction · Synonyms · Stopwords · Autocomplete · Query Expansion · Query Relaxation
Evaluation & Metrics
Search Evaluation · NDCG · MAP · MRR · Precision and Recall · Hit Rate at K · UDCG · Diversity Metrics · Judgment Lists · Implicit Judgments · LLM as Judge · Staged Judging · Statistical Significance in Search Evaluation · Interleaving · Isolated Feedback Loops · Out-of-Time Validation · Session-Based Evaluation · Vector Search Evaluation · Relevance feedback · APD
Behavioral Signals & Bias
Click Models · Neural Click Models · Click Signals · Clicks Residual · Impression Bias · Position Bias · Presentation Bias · Ranking Signal Selection · Signal Downboosting · Personalization · Exploration vs Exploitation
Agentic, Generative & RAG
Agentic Search · Agentic Query Workload · Conversational Search · RAG · Generative Retrieval · Differentiable Search Index · Direct Corpus Interaction · Purpose-Built Agentic Search Models · SIRA · Search-R1 · Reinforcement Learning for Search · Semantic IDs · TIGER · RQ-VAE · Context Engineering · Clean Context · Hypothetical Document Embeddings · Steering Vectors
Model Fine-Tuning & Serving
LoRA · QLoRA · PEFT · GGUF · Hard Negative Mining · Contrastive Learning · Knowledge Distillation · Synthetic Query Generation · Consistency Filtering · PROMPTAGATOR · FLAN-T5
Search Architecture & Operations
Search Architecture · Retrieval Pipeline · Sharding · Compute-Storage Disaggregation · Unified Search Index · Denormalization for Search · Search Governance · Search Team · Search Results Explainability · Text Chunking · Knowledge Graph Search
Search UX & Discovery
Faceted Search · Federated Search · Search Scopes · Zero Results · Results Merchandising · MMR
Topics
Retrieval & Ranking Techniques
Reasoning Reranking · RL-Trained Search Agents · Late Interaction in Elasticsearch · Late Interaction in OpenSearch · Late Interaction in Qdrant · Late Interaction in Vespa · Elasticsearch Learning to Rank · Vespa Learning to Rank · Vector Search Tradeoffs · Dimensionality Reduction vs Quantization · PCA vs t-SNE for Retrieval · Search UX · Search UX Research · Search Result Diversity · Multilingual Search · Personalization in Search · Query Classification · Query Understanding in Practice · Spelling Correction in Search · Synonyms and Vocabulary Management · Autocomplete and Autosuggest · Conversational and Agentic Search · Interaction Paradigms
Domains & Platforms
E-commerce Search · Two-Sided Marketplace Ranking · Enterprise Search · Search using PostgreSQL · Search Platforms · Extreme Search Systems · Migration between Search Engines · Elasticsearch vs OpenSearch · Federated vs Unified Search · Multi-Tenancy in Search
Quality & Operations
A-B Testing for Search · Duality in Measuring Search · NDCG Variants · Search Quality Assurance · Relevance Program Setup · Relevance Evaluation Tools Compared · Quepid Beyond Supported Engines · Model Selection and Fine-Tuning Evaluation · Retrieval Benchmarks and Leaderboards · Embedding Models Compared · Search Observability
Team, Career & Community
Hiring for Search · How to Start a Career in Search · Managing a Search Team · Understaffed Search Team · Search Consultancy · Search Communities · Women of Search · Events and Conferences
Learning Resources
Strategy & Meta
Frontier of Search · Frontier of Search 2025 · Frontier of Search 2026 · Economics of Search · Search Problem Archetypes · Fun and Philosophy
Tools
Search & Vector Engines
Elasticsearch · OpenSearch · Solr · FAISS · Milvus Vector DB · Pinecone Vector DB · Qdrant Vector DB · Weaviate Vector DB · turbopuffer Search DB · PostgreSQL · ParadeDB · VectorChord
PostgreSQL Extensions
pgvector · pgvectorscale · pg_textsearch · pg_trgm · psql_bm25s
Ranking & ML Libraries
LightGBM · XGBoost · CatBoost · RankLib · Metarank · eland
Embedding Training
Sentence Transformers · qdrant-sparse-finetune · qdrant-relevance-feedback
Relevance & Query Tooling
Querqy · Quepid · Search Relevance Workbench · Elasticsearch Relevance Studio · Rated Ranking Evaluator · User Behavior Insights · ann-benchmarks · SID-1
ML & Model Serving
LightGBM · XGBoost · CatBoost · RankLib · ONNX · eland
Companies
Airbnb · Algolia · Amazon Web Services · Baymard Institute · Bonsai · Booking.com · Canva · Carousell · Cohere · Delivery Hero · Dropbox · Elastic · Elsevier · Empathy · Enterprise Knowledge LLC · Etsy · Grubhub · Hornet · Jina AI · Kleinanzeigen · LightOn AI · LinkedIn · Meta · MongoDB · Netflix · Nielsen Norman Group · OpenSource Connections · Otto · Pinecone · Qdrant · Reddit · SID.ai · Sease · Shaped · Shopify · Skyscanner · Slack · Spotify · The Search Juggler · Tiger Data · Twitter · Uber · Vespa · Vinted · Voyage AI · Weaviate · Zalando · searchHub · turbopuffer
Case Studies
Airbnb - ML-Powered Experiences Ranking · Bonsai - Designing Search for a Relational Database · Canva - Search Pipeline Modernization · Etsy - Search Quality and Query Understanding · foodpanda - Classifying 300K Noisy Search Terms Across 16 Markets · Hybrid Fusion Failure - BM25 Displacing Reference Documents · Kleinanzeigen - Vespa Migration for Homepage Feed · Netflix - Content Search Architecture · Reddit - Vector Database Selection · Skyscanner - Learning to Rank for Flights · Slack - Enterprise Message Search with LTR · Uber Eats - Scaling Search for Food Delivery · Vespa - Ranking Without Labels on CORD-19 · Vinted - Migrating Search from Elasticsearch to Vespa · Zalando - Self-DoS via Facet Aggregation
Videos
Conference talks and recorded presentations.
Max Irwin - The Search Engine Migration Circus — Max Irwin, OpenSource Connections; Haystack Live talk on search-engine migration (playbook, “Hello Search”, feature parity, the “damage” metric, war stories)
Choosing Indexes for Similarity Search (Faiss in Python) — James Briggs, Pinecone; hands-on FAISS tutorial comparing Flat, LSH, HNSW, and IVF on Sift1M
Rene Kriegler - Query Relaxation — Rene Kriegler, OpenSource Connections; Query Relaxation as a query recommendation problem — word-shape heuristics, term frequency, Word2Vec and a neural network compared for predicting which term to drop
Roman Grebennikov - Personalizing Search Results in Real-Time — Roman Grebennikov, Findify; MICES 2019 talk on real-time LTR personalization — Position Bias feedback loops, shuffled Exploration vs Exploitation segments, cross-merchant generic models, purchase-weighted perfect rankings
Evgeniya Sukhodolskaya - Fine-Tuning Sparse Neural Retrievers for E-Commerce — Evgeniya Sukhodolskaya, Qdrant; MICES 2026 talk on making SPLADE fine-tuning approachable — why MS MARCO-trained sparse models misfire on catalogs, the ANCE Hard Negative Mining loop, full vs inference-free SPLADE, specialize vs generalize
Evgeniya Sukhodolskaya - Relevance Feedback Inside the Search Engine — Evgeniya Sukhodolskaya, Qdrant; Berlin Buzzwords 2026 talk on index-native Relevance Feedback — model-generated feedback steering HNSW hop selection instead of reranking a top-k, Knowledge Distillation of a reranker into the index, and the case against black-box search engines
Podcasts
Vector Podcast — Dima Kan, Aiven; interview series running since October 2021 (38 episodes) covering vector search, search engines and the businesses around them — vector database founders interviewed mid-build, HNSW co-author Yury Malkov, and on-site batches from Berlin Buzzwords
Conferences
See the Conferences MOC. Berlin Buzzwords · Haystack EU · Haystack US · MICES
Datasets
Amazon ESCI Dataset · BEIR · BRIGHT · ESCI-S Dataset · Home Depot Product Search Relevance · LoTTE · MIRACL · MS MARCO · MTEB · Natural Questions · RTEB · SIFT1M · TREC-COVID · WANDS Dataset
People
A — Achinoam Soroker · Adrien Grand · Aleksas Kateiva · Alexander Marquardt · Amélie Chatelain · Andre Charton · Andrea Schütt · Andreas Wagner · Andrew Kornilov · Andrew McCallum · Andrew Mende · André Mourão · Antoine Chaffin · Aparna Dhinakaran · Asif Makhani · Atita Arora · Audrey Lorberfeld
B — Benjamin Trent · Billy Chan · Brage Vik
C — Charlie Hull · Chris Fournie
D — Dai Sugimori · Dainius Jocas · Daniel Doro · Daniel Tunkelang · David Albrecht · David Argüello Sánchez · Davit Khachaturyan · Dima Kan · Dmitriy Meyerzon · Dotan Horovits · Doug Turnbull · Dylan Castillo
E — Erik Hatcher · Ernestas Poškus · Eugene Yan · Elzbieta Jakubowska · Evgeniya Sukhodolskaya
F — Florent Krzakala · Florian Narr · Fraidoon Omarzai · Francesco Casalegno · Frank Goortani · Freddy Domínguez
G — Geoffrey Hinton · Giovanni Fernandez-Kincade
H — Hailey Cheong · Han Xiao · Hassam Chundrigar · Heather Hedden · Honza Král · Hugo Galvão
I — Isabella Tromba · Ivan Pleshkov
J — Jagadeesh Chandra · Jaideep Ray · James Briggs · James Rubinstein · Janani Narayanan · Janu Verma · Jithendrasaikilaru · Jo Kristian Bergum · Jodi Sloan · Jonas Schulz · Joon-Pil (JP) Hwang · Jose Parreño
K — Karthik Ramasamy · Kemal Erdem
L — Lakhan Bukkawar · Lakshmi Devi Prakash · Laura Ham · Laurynas Jasiukėnas · Laurens van der Maaten · Leo Schuster · Leonie Monigatti · Lester Solbakken · Li Zhang · Luca Arnaboldi · Luke Vilnis
M — Marianne Haugvaldstad · Maryna Kryvko · Matei Zaharia · Max Irwin · Michael Hannecke · Michael Ryaboy · Mihajlo Grbovic · Mohamed Arbi Nsibi
N — Namratesh Shrivastav · Nathan VanBenschoten · Neal Lathia · Nick Zadrozny · Nicolò Rinaldi · Nikhil Dandekar
O — Omar Khattab
P — Peter Straßer · Piotr Mazurek · Prateek Chandra Jha
Q — Quynh Nguyen
R — Ravindra Harige · Rene Kriegler · Ritik Jain · Roberto Pagano · Roman Grebennikov · Roshmita Dey · Roy Keyes · Rudolf Batt
S — Sergey Feldman · Shaw Talebi · Shay Banon · Shib Sankar Dasgupta · Shun Tsukagoshi · Siegfried Schüle · Skip Everling · Soraya Hausl · Steffen Rendle · Stuart Cam · Stéphane Clinchant · Sujit Pal
T — Tao Ruangyam · Taylor Roy · Ted Underwood · Themis Mavridis · Thibault Formal · Thierry Damiba · Thomas Veasey · Tomas Mikolov · Trey Grainger · Tullie Murrell
U — Udi Manber
V — Venkat Ram Rao · Vsevolod Goloviznin
W — Wolf Garbe · Daniel Wrigley