Back to all rerankers

Zerank 2

State-of-the-art cross-encoder trained with novel zELO pipeline for calibrated relevance scores. First reranker with native instruction-following for domain-specific optimization, multilingual parity across 100+ languages, normalized scores with confidence statistics, and robust SQL-style aggregation query handling.

Leaderboard Rank
#1
of 9
ELO Rating
1658
#1
Win Rate
63.0%
#1
Accuracy (nDCG@10)
0.079
#9
Latency
265ms
#2

Model Information

Provider
ZeroEntropy
License
cc-by-nc-4.0
Price per 1M tokens
$0.025
Release Date
2025-11-18
Model Name
zerank-2
Total Evaluations
2282

Performance Record

Wins1438 (63.0%)
Losses844 (37.0%)
Ties0 (0.0%)
Wins
Losses
Ties

Performance Overview

ELO ratings by dataset

Zerank 2's ELO performance varies across different benchmark datasets, showing its strengths in specific domains.

Zerank 2 - ELO by Dataset

Detailed Metrics

Dataset breakdown

Performance metrics across different benchmark datasets, including accuracy and latency percentiles.

FiQa

ELO 176666.4% WR251W-127L-0T

Accuracy Metrics

nDCG@5
0.108
nDCG@10
0.119
Recall@5
0.098
Recall@10
0.130

Latency Distribution

Mean
251ms
P50 (Median)
254ms
P90
270ms

arguana

ELO 171767.1% WR261W-128L-0T

Accuracy Metrics

nDCG@5
0.283
nDCG@10
0.355
Recall@5
0.540
Recall@10
0.760

Latency Distribution

Mean
280ms
P50 (Median)
278ms
P90
312ms

MSMARCO

ELO 164359.7% WR219W-148L-0T

Accuracy Metrics

nDCG@5
0.000
nDCG@10
0.000
Recall@5
0.000
Recall@10
0.000

Latency Distribution

Mean
233ms
P50 (Median)
228ms
P90
251ms

PG

ELO 164055.0% WR219W-179L-0T

Accuracy Metrics

nDCG@5
0.000
nDCG@10
0.000
Recall@5
0.000
Recall@10
0.000

Latency Distribution

Mean
293ms
P50 (Median)
281ms
P90
328ms

DBPedia

ELO 160973.2% WR265W-97L-0T

Accuracy Metrics

nDCG@5
0.000
nDCG@10
0.000
Recall@5
0.000
Recall@10
0.000

Latency Distribution

Mean
247ms
P50 (Median)
242ms
P90
274ms

business reports

ELO 157657.5% WR223W-165L-0T

Accuracy Metrics

nDCG@5
0.000
nDCG@10
0.000
Recall@5
0.000
Recall@10
0.000

Latency Distribution

Mean
288ms
P50 (Median)
269ms
P90
367ms

Compare Models

See how it stacks up

Compare Zerank 2 with other top rerankers to understand the differences in performance, accuracy, and latency.