Awesome Search KG

Tag: search-evaluation

98 items with this tag.

Sep 26, 2026
Amazon ESCI Dataset
Sep 26, 2026
ESCI-S Dataset
Sep 26, 2026
Home Depot Product Search Relevance
Sep 26, 2026
MS MARCO
Sep 26, 2026
WANDS Dataset
Sep 20, 2026
Brier Score
Sep 20, 2026
Expected Calibration Error
Sep 20, 2026
Prompt Optimization
Sep 19, 2026
Hev meets Jev
Sep 19, 2026
Calibrated Relevance Probability
Sep 07, 2026
Releval
Sep 04, 2026
Do LLM Judges Actually Agree With Us?
Sep 04, 2026
Adversarial Relevance Judgment
Sep 04, 2026
Inter-Annotator Agreement
Sep 04, 2026
Levels of Judge Agreement
Sep 04, 2026
Prompt Sensitivity
Sep 03, 2026
Benchmarking LLM-based Relevance Judgment Methods
Sep 03, 2026
Criteria-Based LLM Relevance Judgments
Sep 03, 2026
ANTIQUE
Sep 03, 2026
LLMJudge
Sep 03, 2026
TREC Deep Learning Track
Sep 03, 2026
Charles L. A. Clarke
Sep 03, 2026
Laura Dietz
Sep 03, 2026
Naghmeh Farzi
Sep 03, 2026
Negar Arabzadeh
Aug 31, 2026
Semantic Relevance
Aug 30, 2026
How Etsy Uses LLMs to Improve Search Relevance
Aug 28, 2026
Kendall Rank Correlation
Aug 28, 2026
STaRK
Aug 21, 2026
Tuning BM25 for E-commerce Search
Aug 20, 2026
Automating Search Relevance Assessment at Scale with LLM-as-a-Judge
Aug 05, 2026
Towards Scalable Relevance Engineering
Aug 05, 2026
Impression Bias
Aug 05, 2026
Staged Judging
Aug 05, 2026
Statistical Significance in Search Evaluation
Aug 05, 2026
BRIGHT
Aug 05, 2026
LoTTE
Aug 05, 2026
MIRACL
Aug 05, 2026
MTEB
Aug 05, 2026
RTEB
Aug 05, 2026
Model Selection and Fine-Tuning Evaluation
Aug 05, 2026
Retrieval Benchmarks and Leaderboards
Jul 30, 2026
Improving Zero-Shot Ranking with Vespa Hybrid Search
Jul 30, 2026
Natural Questions
Jul 30, 2026
TREC-COVID
Jul 30, 2026
User Behavior Insights
Jul 29, 2026
BEIR
Jul 27, 2026
Fine-Tuning Sparse Embeddings for E-Commerce Search (Parts 1–5)
Jul 03, 2026
How to Securely Hook Up Quepid to Vespa
Jul 03, 2026
Elasticsearch Relevance Studio
Jul 03, 2026
Rated Ranking Evaluator
Jul 03, 2026
Search Relevance Workbench
Jul 03, 2026
NDCG Variants — The Flavors of NDCG
Jul 03, 2026
Relevance Evaluation Tools Compared
Jun 28, 2026
Creating Judgement Lists with Quepid
Jun 28, 2026
How to Evaluate Image Search in Qdrant Using Quepid Part 1 (No Hacks)
Jun 28, 2026
How to Evaluate Image Search in Qdrant Using Quepid Part 2 (Hacks)
Jun 28, 2026
Oops, I Did It Again
Jun 28, 2026
Why Setting Up Quepid for Vector Search Evaluation Went Wrong
Jun 28, 2026
Vector Search Evaluation
May 31, 2026
Classic ML to Cope with Dumb LLM Judges
May 31, 2026
Search Quality Assurance with AI as a Judge
May 31, 2026
What AI Engineers Should Know about Search
May 31, 2026
Listwise Relevance Evaluation
May 31, 2026
Pairwise Relevance Evaluation
May 31, 2026
Pointwise Relevance Evaluation
May 31, 2026
Presentation Bias
May 31, 2026
Relevance Feedback
May 17, 2026
Quepid
May 16, 2026
Click Signals
May 16, 2026
Diversity Metrics
May 16, 2026
Hit Rate@K
May 16, 2026
Judgment Lists
May 16, 2026
LLM as Judge
May 16, 2026
MAP (Mean Average Precision)
May 16, 2026
MRR (Mean Reciprocal Rank)
May 16, 2026
NDCG (Normalized Discounted Cumulative Gain)
May 16, 2026
Position Bias
May 16, 2026
Precision and Recall
May 16, 2026
Search Evaluation
May 16, 2026
Session-Based Evaluation
May 16, 2026
UDCG (Utility and Distraction-aware Cumulative Gain)
May 15, 2026
Choosing Your Search Relevance Evaluation Metric
May 15, 2026
Compute Mean Reciprocal Rank (MRR) using Pandas
May 15, 2026
Demystifying nDCG and ERR
May 15, 2026
Evaluating Search: Using Human Judgments
May 15, 2026
Flavors of NDCG — Normalized to What!?
May 15, 2026
Improving Retrieval with LLM-as-a-Judge
May 15, 2026
LLM-as-a-Judge: When to Use Reasoning, CoT, and Explanations
May 15, 2026
Map of Content: Search Quality Assurance & Query Understanding
May 15, 2026
Measuring Search, A Human Approach
May 15, 2026
Measuring Search: Metrics Matter
May 15, 2026
Measuring Search Effectiveness
May 15, 2026
Relevance Feedback
May 15, 2026
Session vs Query Based Search Evals
May 15, 2026
How to Succeed with Explicit Relevance Evaluation using PPS Sampling
May 15, 2026
What Is a Judgment List?
May 15, 2026
What is Presentation Bias in Search?

Created with Quartz v4.5.2 © 2026

GitHub
Discord Community