Jina Reranker v2 Base Multilingual
Open-source 278M parameter cross-encoder with Flash Attention 2, designed for agentic RAG with function-calling awareness. Ranked highly on AirBench leaderboard at release with support for 100+ languages and code retrieval optimization.
Model Information
- Provider
- Jina AI
- License
- cc-by-nc-4.0
- Price per 1M tokens
- $0.045
- Release Date
- 2024-06-25
- Model Name
- jina-reranker-v2-base-multilingual
- Total Evaluations
- 2100
Performance Record
Wins794 (37.8%)
Losses1242 (59.1%)
Ties64 (3.0%)
Wins
Losses
Ties
Performance Overview
ELO ratings by dataset
Jina Reranker v2 Base Multilingual's ELO performance varies across different benchmark datasets, showing its strengths in specific domains.
Jina Reranker v2 Base Multilingual - ELO by Dataset
Detailed Metrics
Dataset breakdown
Performance metrics across different benchmark datasets, including accuracy and latency percentiles.
PG
ELO 150747.1% WR165W-185L-0T
Latency Distribution
- Mean
- 994ms
- P50 (Median)
- 839ms
- P90
- 1436ms
MSMARCO
ELO 146933.7% WR118W-183L-49T
Accuracy Metrics
- nDCG@5
- 0.985
- nDCG@10
- 0.985
- Recall@5
- 1.000
- Recall@10
- 1.000
Latency Distribution
- Mean
- 1100ms
- P50 (Median)
- 1023ms
- P90
- 1642ms
FiQa
ELO 143539.7% WR139W-203L-8T
Accuracy Metrics
- nDCG@5
- 0.112
- nDCG@10
- 0.121
- Recall@5
- 0.105
- Recall@10
- 0.130
Latency Distribution
- Mean
- 2294ms
- P50 (Median)
- 1949ms
- P90
- 4906ms
SciFact
ELO 137740.0% WR140W-207L-3T
Accuracy Metrics
- nDCG@5
- 0.830
- nDCG@10
- 0.832
- Recall@5
- 0.871
- Recall@10
- 0.876
Latency Distribution
- Mean
- 1123ms
- P50 (Median)
- 1015ms
- P90
- 1285ms
business reports
ELO 137639.4% WR138W-208L-4T
Latency Distribution
- Mean
- 2191ms
- P50 (Median)
- 1237ms
- P90
- 5520ms
DBPedia
ELO 133926.9% WR94W-256L-0T
Accuracy Metrics
- nDCG@5
- 0.677
- nDCG@10
- 0.744
- Recall@5
- 0.064
- Recall@10
- 0.106
Latency Distribution
- Mean
- 763ms
- P50 (Median)
- 796ms
- P90
- 1021ms
Compare Models
See how it stacks up
Compare Jina Reranker v2 Base Multilingual with other top rerankers to understand the differences in performance, accuracy, and latency.