Laura Dietz

Information retrieval researcher working on evaluation and automatic relevance assessment, including the failure modes of unconstrained LLM relevance judgments.

Known For

• Criteria-Based LLM Relevance Judgments (arXiv:2507.09488, 2025) with Naghmeh Farzi — decomposed, criteria-based relevance grading for robustness and interpretability

Articles

• Criteria-Based LLM Relevance Judgments

Related Concepts

• LLM as Judge
• Search Evaluation
• Semantic Relevance

People

• Naghmeh Farzi — co-author