Conversational Search

Definition

Conversational search is an interaction model where users find information through a multi-turn dialogue rather than a single query. The system maintains context across turns, asks clarifying questions, and refines results based on ongoing conversation.

Distinct from single-query search in that the query is not a single string — it’s a conversation history.

Core Challenges

Coreference and Context Carryover

“Show me laptops under 1000.”

Query Rewriting

Each user turn must be rewritten into a standalone query before retrieval. LLMs have made this tractable:

Conversation history + new turn → LLM → self-contained query → retrieval

Mixed Initiative

Both user and system can take initiative:

  • User-driven: user narrows down step by step
  • System-driven: system asks clarifying questions (Query Understanding → clarification dialogues)

Architecture Patterns

RAG with conversation history in the LLM context. User’s question + prior turns → query rewriting → retrieval → LLM answer generation. The dominant pattern for LLM-powered search.

Faceted Dialogue

System presents Faceted Search options as conversation turns: “Did you mean laptops for gaming or for work?” — structured clarification.

Search agents that decompose complex questions into sub-queries, run multiple searches, and synthesize answers across turns.

Conversational Search vs. Chatbots

Conversational SearchChatbot
Primary goalInformation retrievalTask completion / conversation
Truth groundingRetrieved documentsModel weights
Hallucination riskLower (grounded)Higher
Failure modePoor retrievalConfabulation

Evaluation

Standard single-query metrics (NDCG, MRR) don’t capture multi-turn quality. Additional considerations:

  • Turn-level relevance: was each response relevant to that turn?
  • Session-level coherence: did the conversation converge on the user’s need?
  • Clarification quality: did clarifying questions actually help?

Session-Based Evaluation is most appropriate.