Zerank 2
State-of-the-art cross-encoder trained with novel zELO pipeline for calibrated relevance scores. First reranker with native instruction-following for domain-specific optimization, multilingual parity across 100+ languages, normalized scores with confidence statistics, and robust SQL-style aggregation query handling.
Model Information
- Provider
- ZeroEntropy
- License
- cc-by-nc-4.0
- Price per 1M tokens
- $0.025
- Release Date
- 2025-11-18
- Model Name
- zerank-2
- Total Evaluations
- 3000
Performance Record
Wins1748 (58.3%)
Losses1109 (37.0%)
Ties143 (4.8%)
Wins
Losses
Ties
Performance Overview
ELO ratings by dataset
Zerank 2's ELO performance varies across different benchmark datasets, showing its strengths in specific domains.
Zerank 2 - ELO by Dataset
Detailed Metrics
Dataset breakdown
Performance metrics across different benchmark datasets, including accuracy and latency percentiles.
FiQa
ELO 180460.2% WR301W-172L-27T
Accuracy Metrics
- nDCG@5
- 0.108
- nDCG@10
- 0.119
- Recall@5
- 0.098
- Recall@10
- 0.130
Latency Distribution
- Mean
- 251ms
- P50 (Median)
- 254ms
- P90
- 270ms
arguana
ELO 170062.4% WR312W-176L-12T
Accuracy Metrics
- nDCG@5
- 0.283
- nDCG@10
- 0.355
- Recall@5
- 0.540
- Recall@10
- 0.760
Latency Distribution
- Mean
- 280ms
- P50 (Median)
- 278ms
- P90
- 312ms
MSMARCO
ELO 162952.8% WR264W-192L-44T
Accuracy Metrics
- nDCG@5
- 0.491
- nDCG@10
- 0.546
- Recall@5
- 0.620
- Recall@10
- 0.780
Latency Distribution
- Mean
- 233ms
- P50 (Median)
- 228ms
- P90
- 251ms
PG
ELO 160854.4% WR272W-226L-2T
Accuracy Metrics
- nDCG@5
- 0.000
- nDCG@10
- 0.000
- Recall@5
- 0.000
- Recall@10
- 0.000
Latency Distribution
- Mean
- 293ms
- P50 (Median)
- 281ms
- P90
- 328ms
DBPedia
ELO 156665.8% WR329W-128L-43T
Accuracy Metrics
- nDCG@5
- 0.138
- nDCG@10
- 0.151
- Recall@5
- 0.004
- Recall@10
- 0.005
Latency Distribution
- Mean
- 247ms
- P50 (Median)
- 242ms
- P90
- 274ms
business reports
ELO 155654.0% WR270W-215L-15T
Accuracy Metrics
- nDCG@5
- 0.000
- nDCG@10
- 0.000
- Recall@5
- 0.000
- Recall@10
- 0.000
Latency Distribution
- Mean
- 288ms
- P50 (Median)
- 269ms
- P90
- 367ms
Compare Models
See how it stacks up
Compare Zerank 2 with other top rerankers to understand the differences in performance, accuracy, and latency.