Search Relevance
Rate results against what the searcher actually wanted
Keyword overlap is not relevance. Have people read the query and the result, and judge whether it answers the question behind the search.
What workers do
- Compare two results for the same query
- Rate a result’s relevance on a scale
- Classify query intent
- Flag results that match keywords but miss the intent
What you upload
- query
- result_a
- result_b
Any format: CSV, TSV, JSON, JSONL, XLSX or TXT. Columns are detected automatically.