Jodi Sloan

Data Scientist at Shopify. Author of Shopify’s three-step search algorithm evaluation framework.

Key Contributions

Search Evaluation Framework: Described the Kafka events + annotation + offline/online metrics pipeline used at Shopify Help Center. Key insight: human annotation by domain experts (Shopify Support team) preferred over click models for knowledge base search. Annotation datasets go stale and must be refreshed.