On Search Leadership
Source: https://dtunkelang.medium.com/on-search-leadership-815b36c15df1 Author: Daniel Tunkelang
Summary
Tunkelang’s perspective on what makes search teams and their leaders effective — emphasizing that search leadership requires blending technical, product, and organizational skills.
Core Themes
The Relevance Engineering Mindset
Search leaders must resist the temptation to optimize a single metric. True relevance is multidimensional and requires judgment that can’t be fully automated.
Communication Across Disciplines
Search leaders translate between:
- Engineers (algorithms, latency budgets, data pipelines)
- Product managers (user stories, business metrics)
- Researchers (academic approaches, evaluation methodology)
Long-term vs. Short-term
Good search leadership resists “quick fixes” that optimize near-term metrics at the cost of long-term quality debt. Each shortcut that hides poor relevance makes the next iteration harder.
Building Evaluation Culture
The most important infrastructure a search leader builds is evaluation:
- Judgment Lists and annotation pipelines
- Offline evaluation harnesses
- A-B Testing for Search discipline
Without measurement, there is no leadership — only guessing.