Back to all rerankers

Jina Reranker v2 Base Multilingual

Open-source 278M parameter cross-encoder with Flash Attention 2, designed for agentic RAG with function-calling awareness. Ranked highly on AirBench leaderboard at release with support for 100+ languages and code retrieval optimization.

Leaderboard Rank
#11
of 11
ELO Rating
1306
#11
Win Rate
28.5%
#11
Accuracy (nDCG@10)
0.193
#10
Latency
746ms
#9

Model Information

Provider
Jina AI
License
cc-by-nc-4.0
Price per 1M tokens
$0.045
Release Date
2024-06-25
Model Name
jina-reranker-v2-base-multilingual
Total Evaluations
3000

Performance Record

Wins856 (28.5%)
Losses2071 (69.0%)
Ties73 (2.4%)
Wins
Losses
Ties

Performance Overview

ELO ratings by dataset

Jina Reranker v2 Base Multilingual's ELO performance varies across different benchmark datasets, showing its strengths in specific domains.

Jina Reranker v2 Base Multilingual - ELO by Dataset

Detailed Metrics

Dataset breakdown

Performance metrics across different benchmark datasets, including accuracy and latency percentiles.

PG

ELO 140830.4% WR152W-347L-1T

Accuracy Metrics

nDCG@5
0.000
nDCG@10
0.000
Recall@5
0.000
Recall@10
0.000

Latency Distribution

Mean
1059ms
P50 (Median)
823ms
P90
1744ms

MSMARCO

ELO 139535.8% WR179W-281L-40T

Accuracy Metrics

nDCG@5
0.499
nDCG@10
0.539
Recall@5
0.680
Recall@10
0.800

Latency Distribution

Mean
694ms
P50 (Median)
616ms
P90
911ms

DBPedia

ELO 134628.2% WR141W-333L-26T

Accuracy Metrics

nDCG@5
0.128
nDCG@10
0.136
Recall@5
0.004
Recall@10
0.005

Latency Distribution

Mean
671ms
P50 (Median)
614ms
P90
825ms

business reports

ELO 125119.4% WR97W-403L-0T

Accuracy Metrics

nDCG@5
0.000
nDCG@10
0.000
Recall@5
0.000
Recall@10
0.000

Latency Distribution

Mean
690ms
P50 (Median)
620ms
P90
824ms

arguana

ELO 124536.2% WR181W-318L-1T

Accuracy Metrics

nDCG@5
0.314
nDCG@10
0.374
Recall@5
0.580
Recall@10
0.760

Latency Distribution

Mean
689ms
P50 (Median)
617ms
P90
834ms

FiQa

ELO 119321.2% WR106W-389L-5T

Accuracy Metrics

nDCG@5
0.105
nDCG@10
0.108
Recall@5
0.088
Recall@10
0.093

Latency Distribution

Mean
676ms
P50 (Median)
626ms
P90
837ms

Compare Models

See how it stacks up

Compare Jina Reranker v2 Base Multilingual with other top rerankers to understand the differences in performance, accuracy, and latency.