Back to all rerankers

Cohere Rerank 3.5

Advanced reranking model with improved reasoning and multilingual capabilities for enterprise data. Excels in complex enterprise scenarios including Finance, E-commerce, and Hospitality across 100+ languages.

Leaderboard Rank
#7
of 8
ELO Rating
1403
#7
Win Rate
37.8%
#7
Accuracy (nDCG@10)
0.689
#1
Latency
492ms
#1

Model Information

Provider
Cohere
License
Proprietary
Price per 1M tokens
$0.050
Release Date
2024-12-02
Model Name
cohere-rerank-v3.5
Total Evaluations
2100

Performance Record

Wins793 (37.8%)
Losses1229 (58.5%)
Ties78 (3.7%)
Wins
Losses
Ties

Performance Overview

ELO ratings by dataset

Cohere Rerank 3.5's ELO performance varies across different benchmark datasets, showing its strengths in specific domains.

Cohere Rerank 3.5 - ELO by Dataset

Detailed Metrics

Dataset breakdown

Performance metrics across different benchmark datasets, including accuracy and latency percentiles.

SciFact

ELO 151346.3% WR162W-187L-1T

Accuracy Metrics

nDCG@5
0.868
nDCG@10
0.878
Recall@5
0.887
Recall@10
0.906

Latency Distribution

Mean
638ms
P50 (Median)
612ms
P90
819ms

MSMARCO

ELO 148836.0% WR126W-161L-63T

Accuracy Metrics

nDCG@5
0.990
nDCG@10
0.990
Recall@5
1.000
Recall@10
1.000

Latency Distribution

Mean
317ms
P50 (Median)
299ms
P90
320ms

business reports

ELO 147044.3% WR155W-192L-3T

Latency Distribution

Mean
395ms
P50 (Median)
324ms
P90
570ms

DBPedia

ELO 139036.9% WR129W-217L-4T

Accuracy Metrics

nDCG@5
0.691
nDCG@10
0.760
Recall@5
0.063
Recall@10
0.107

Latency Distribution

Mean
355ms
P50 (Median)
305ms
P90
523ms

FiQa

ELO 137834.6% WR121W-222L-7T

Accuracy Metrics

nDCG@5
0.121
nDCG@10
0.127
Recall@5
0.118
Recall@10
0.130

Latency Distribution

Mean
589ms
P50 (Median)
603ms
P90
913ms

PG

ELO 133528.6% WR100W-250L-0T

Latency Distribution

Mean
661ms
P50 (Median)
613ms
P90
792ms

Compare Models

See how it stacks up

Compare Cohere Rerank 3.5 with other top rerankers to understand the differences in performance, accuracy, and latency.