Back to all rerankers

Cohere Rerank 3.5

Advanced reranking model with improved reasoning and multilingual capabilities for enterprise data. Excels in complex enterprise scenarios including Finance, E-commerce, and Hospitality across 100+ languages.

Leaderboard Rank
#9
of 11
ELO Rating
1452
#9
Win Rate
41.0%
#9
Accuracy (nDCG@10)
0.200
#8
Latency
392ms
#4

Model Information

Provider
Cohere
License
Proprietary
Price per 1M tokens
$0.050
Release Date
2024-12-02
Model Name
cohere-rerank-v3.5
Total Evaluations
3000

Performance Record

Wins1230 (41.0%)
Losses1696 (56.5%)
Ties74 (2.5%)
Wins
Losses
Ties

Performance Overview

ELO ratings by dataset

Cohere Rerank 3.5's ELO performance varies across different benchmark datasets, showing its strengths in specific domains.

Cohere Rerank 3.5 - ELO by Dataset

Detailed Metrics

Dataset breakdown

Performance metrics across different benchmark datasets, including accuracy and latency percentiles.

arguana

ELO 164745.0% WR225W-275L-0T

Accuracy Metrics

nDCG@5
0.267
nDCG@10
0.355
Recall@5
0.520
Recall@10
0.800

Latency Distribution

Mean
570ms
P50 (Median)
373ms
P90
617ms

MSMARCO

ELO 155940.4% WR202W-264L-34T

Accuracy Metrics

nDCG@5
0.522
nDCG@10
0.553
Recall@5
0.700
Recall@10
0.800

Latency Distribution

Mean
339ms
P50 (Median)
285ms
P90
304ms

DBPedia

ELO 149940.2% WR201W-272L-27T

Accuracy Metrics

nDCG@5
0.156
nDCG@10
0.166
Recall@5
0.004
Recall@10
0.005

Latency Distribution

Mean
286ms
P50 (Median)
279ms
P90
290ms

PG

ELO 145448.4% WR242W-258L-0T

Accuracy Metrics

nDCG@5
0.000
nDCG@10
0.000
Recall@5
0.000
Recall@10
0.000

Latency Distribution

Mean
458ms
P50 (Median)
360ms
P90
615ms

FiQa

ELO 130132.4% WR162W-333L-5T

Accuracy Metrics

nDCG@5
0.124
nDCG@10
0.128
Recall@5
0.123
Recall@10
0.130

Latency Distribution

Mean
364ms
P50 (Median)
315ms
P90
401ms

business reports

ELO 125139.6% WR198W-294L-8T

Accuracy Metrics

nDCG@5
0.000
nDCG@10
0.000
Recall@5
0.000
Recall@10
0.000

Latency Distribution

Mean
334ms
P50 (Median)
293ms
P90
503ms

Compare Models

See how it stacks up

Compare Cohere Rerank 3.5 with other top rerankers to understand the differences in performance, accuracy, and latency.