Back to all rerankers

Jina Reranker v2 Base Multilingual

Open-source 278M parameter cross-encoder with Flash Attention 2, designed for agentic RAG with function-calling awareness. Ranked highly on AirBench leaderboard at release with support for 100+ languages and code retrieval optimization.

Leaderboard Rank
#12
of 12
ELO Rating
1327
#12
Win Rate
28.2%
#12
Accuracy (nDCG@10)
0.080
#10
Latency
746ms
#9

Model Information

Provider
Jina AI
License
cc-by-nc-4.0
Price per 1M tokens
$0.045
Release Date
2024-06-25
Model Name
jina-reranker-v2-base-multilingual
Total Evaluations
3300

Performance Record

Wins931 (28.2%)
Losses2287 (69.3%)
Ties82 (2.5%)
Wins
Losses
Ties

Performance Overview

ELO ratings by dataset

Jina Reranker v2 Base Multilingual's ELO performance varies across different benchmark datasets, showing its strengths in specific domains.

Jina Reranker v2 Base Multilingual - ELO by Dataset

Detailed Metrics

Dataset breakdown

Performance metrics across different benchmark datasets, including accuracy and latency percentiles.

PG

ELO 139828.9% WR159W-390L-1T

Accuracy Metrics

nDCG@5
0.000
nDCG@10
0.000
Recall@5
0.000
Recall@10
0.000

Latency Distribution

Mean
1059ms
P50 (Median)
823ms
P90
1744ms

arguana

ELO 139637.5% WR206W-344L-0T

Accuracy Metrics

nDCG@5
0.314
nDCG@10
0.374
Recall@5
0.580
Recall@10
0.760

Latency Distribution

Mean
689ms
P50 (Median)
617ms
P90
834ms

MSMARCO

ELO 138134.7% WR191W-315L-44T

Accuracy Metrics

nDCG@5
0.000
nDCG@10
0.000
Recall@5
0.000
Recall@10
0.000

Latency Distribution

Mean
694ms
P50 (Median)
616ms
P90
911ms

DBPedia

ELO 132627.6% WR152W-367L-31T

Accuracy Metrics

nDCG@5
0.000
nDCG@10
0.000
Recall@5
0.000
Recall@10
0.000

Latency Distribution

Mean
671ms
P50 (Median)
614ms
P90
825ms

business reports

ELO 128120.2% WR111W-439L-0T

Accuracy Metrics

nDCG@5
0.000
nDCG@10
0.000
Recall@5
0.000
Recall@10
0.000

Latency Distribution

Mean
690ms
P50 (Median)
620ms
P90
824ms

FiQa

ELO 118120.4% WR112W-432L-6T

Accuracy Metrics

nDCG@5
0.105
nDCG@10
0.108
Recall@5
0.088
Recall@10
0.093

Latency Distribution

Mean
676ms
P50 (Median)
626ms
P90
837ms

Compare Models

See how it stacks up

Compare Jina Reranker v2 Base Multilingual with other top rerankers to understand the differences in performance, accuracy, and latency.