Back to all embeddings

Jina Embeddings v3

Features 570M parameters with five task-specific LoRA adapters for retrieval, clustering, and classification. Supports 89 languages with 30 optimized, processes up to 8,192 tokens, and allows dimension truncation to 32 via Matryoshka learning.

Leaderboard Rank
#9
of 13
ELO Rating
1491
#9
Win Rate
40.3%
#11
Accuracy (nDCG@10)
0.766
#8
Latency
213763ms
#13

Model Information

Provider
Jina AI
License
Open Source
Price per 1M tokens
$0.045
Release Date
2024-09-18
Model Name
jina-embeddings-v3
Total Evaluations
1918

Performance Record

Wins772 (40.3%)
Losses901 (47.0%)
Ties245 (12.8%)
Wins
Losses
Ties

Performance Overview

ELO ratings by dataset

Jina Embeddings v3's ELO performance varies across different benchmark datasets, showing its strengths in specific domains.

Jina Embeddings v3 - ELO by Dataset

Detailed Metrics

Dataset breakdown

Performance metrics across different benchmark datasets, including accuracy and latency percentiles.

ARCD

ELO 153047.1% WR113W-69L-58T

Accuracy Metrics

nDCG@5
0.888
nDCG@10
0.900
Recall@5
0.920
Recall@10
0.960

Latency Distribution

Mean
85941ms
P50 (Median)
84222ms
P90
98832ms

PG

ELO 150550.0% WR120W-115L-5T

Latency Distribution

Mean
155423ms
P50 (Median)
152315ms
P90
178736ms

MSMARCO

ELO 150444.6% WR107W-98L-35T

Accuracy Metrics

nDCG@5
1.000
nDCG@10
0.997
Recall@5
0.123
Recall@10
0.220

Latency Distribution

Mean
476020ms
P50 (Median)
466500ms
P90
547423ms

NorQuAD

ELO 149725.4% WR61W-68L-111T

Latency Distribution

Mean
45614ms
P50 (Median)
44702ms
P90
52456ms

FiQa

ELO 148442.5% WR102W-129L-9T

Accuracy Metrics

nDCG@5
0.645
nDCG@10
0.679
Recall@5
0.633
Recall@10
0.741

Latency Distribution

Mean
458812ms
P50 (Median)
449636ms
P90
527634ms

business reports

ELO 147238.8% WR93W-140L-7T

Latency Distribution

Mean
18149ms
P50 (Median)
17786ms
P90
20871ms

DBPedia

ELO 147237.4% WR89W-134L-15T

Accuracy Metrics

nDCG@5
0.616
nDCG@10
0.591
Recall@5
0.225
Recall@10
0.340

Latency Distribution

Mean
199515ms
P50 (Median)
195525ms
P90
229442ms

SciFact

ELO 146236.3% WR87W-148L-5T

Accuracy Metrics

nDCG@5
0.622
nDCG@10
0.661
Recall@5
0.695
Recall@10
0.800

Latency Distribution

Mean
270629ms
P50 (Median)
265216ms
P90
311223ms

Compare Models

See how it stacks up

Compare Jina Embeddings v3 with other top embeddings to understand the differences in performance, accuracy, and latency.