Back to all rerankers

Zerank 1 Small

Compact 1.7B parameter model with novel ELO-based training on synthetic pairwise data for calibrated relevance scores. Half the cost of competing rerankers while maintaining strong ranking quality.

Leaderboard Rank
#6
of 8
ELO Rating
1458
#6
Win Rate
56.2%
#3
Accuracy (nDCG@10)
0.676
#7
Latency
1109ms
#4

Model Information

Provider
ZeroEntropy
License
Open Source
Price per 1M tokens
$0.025
Release Date
2025-07-10
Model Name
zerank-1-small
Total Evaluations
2100

Performance Record

Wins1180 (56.2%)
Losses840 (40.0%)
Ties80 (3.8%)
Wins
Losses
Ties

Performance Overview

ELO ratings by dataset

Zerank 1 Small's ELO performance varies across different benchmark datasets, showing its strengths in specific domains.

Zerank 1 Small - ELO by Dataset

Detailed Metrics

Dataset breakdown

Performance metrics across different benchmark datasets, including accuracy and latency percentiles.

MSMARCO

ELO 159749.7% WR174W-123L-53T

Accuracy Metrics

nDCG@5
0.965
nDCG@10
0.968
Recall@5
0.987
Recall@10
0.993

Latency Distribution

Mean
1014ms
P50 (Median)
1010ms
P90
1097ms

FiQa

ELO 155163.4% WR222W-119L-9T

Accuracy Metrics

nDCG@5
0.114
nDCG@10
0.124
Recall@5
0.098
Recall@10
0.125

Latency Distribution

Mean
969ms
P50 (Median)
977ms
P90
1086ms

business reports

ELO 154856.6% WR198W-140L-12T

Latency Distribution

Mean
1051ms
P50 (Median)
1060ms
P90
1171ms

PG

ELO 154761.7% WR216W-134L-0T

Latency Distribution

Mean
1224ms
P50 (Median)
1187ms
P90
1307ms

SciFact

ELO 149852.9% WR185W-161L-4T

Accuracy Metrics

nDCG@5
0.869
nDCG@10
0.872
Recall@5
0.916
Recall@10
0.920

Latency Distribution

Mean
1345ms
P50 (Median)
1272ms
P90
1552ms

DBPedia

ELO 146752.9% WR185W-163L-2T

Accuracy Metrics

nDCG@5
0.683
nDCG@10
0.739
Recall@5
0.061
Recall@10
0.102

Latency Distribution

Mean
1053ms
P50 (Median)
1034ms
P90
1170ms