STaRK
Benchmark for retrieval over knowledge bases that combine text with relational/graph structure (Wu et al., NeurIPS 2024). Used in Relational Reranking - Scoring Search Results with Structured Facts to demonstrate RelativeDB’s Relational Transformer (RT): on an Amazon product graph recording frequent co-purchases, RT resolves a named product in the query to its row, adds the also_buy relational edge into the candidate context, and uses that edge to move the correct matching product from rank #2 (under title-similarity alone) to rank #1.
Related Concepts
- Relational Transformer — reranker evaluated on this benchmark