Jina Embeddings v3 vs Qwen3 Embedding 0.6B

Detailed comparison between Jina Embeddings v3 and Qwen3 Embedding 0.6B. See which embedding best meets your accuracy and performance needs.

Model Comparison

Jina Embeddings v3 takes the lead.

Both Jina Embeddings v3 and Qwen3 Embedding 0.6B are powerful embedding models designed to improve retrieval quality in RAG applications. However, their performance characteristics differ in important ways.

Why Jina Embeddings v3:

  • Jina Embeddings v3 has 13 higher ELO rating
  • Jina Embeddings v3 delivers better accuracy (nDCG@10: 0.766 vs 0.751)
  • Qwen3 Embedding 0.6B is 143701ms faster on average

Overview

Key metrics

ELO Rating

Overall ranking quality

Jina Embeddings v3

1491

Qwen3 Embedding 0.6B

1478

Win Rate

Head-to-head performance

Jina Embeddings v3

40.3%

Qwen3 Embedding 0.6B

37.3%

Accuracy (nDCG@10)

Ranking quality metric

Jina Embeddings v3

0.766

Qwen3 Embedding 0.6B

0.751

Average Latency

Response time

Jina Embeddings v3

213763ms

Qwen3 Embedding 0.6B

70062ms

Visual Performance Analysis

Performance

ELO Rating Comparison

Win/Loss/Tie Breakdown

Accuracy Across Datasets (nDCG@10)

Latency Distribution (ms)

Breakdown

How the models stack up

MetricJina Embeddings v3Qwen3 Embedding 0.6BDescription
Overall Performance
ELO Rating
1491
1478
Overall ranking quality based on pairwise comparisons
Win Rate
40.3%
37.3%
Percentage of comparisons won against other models
Pricing & Availability
Price per 1M tokens
$0.045
$0.010
Cost per million tokens processed
Release Date
2024-09-18
2025-06-06
Model release date
Accuracy Metrics
Avg nDCG@10
0.766
0.751
Normalized discounted cumulative gain at position 10
Performance Metrics
Avg Latency
213763ms
70062ms
Average response time across all datasets

Dataset Performance

By field

Comprehensive comparison of accuracy metrics (nDCG, Recall) and latency percentiles for each benchmark dataset.

PG

MetricJina Embeddings v3Qwen3 Embedding 0.6BDescription
Accuracy Metrics
Latency Metrics
Mean
155423ms
77697ms
Average response time
P50
152315ms
76143ms
50th percentile (median)
P90
178736ms
89352ms
90th percentile

business reports

MetricJina Embeddings v3Qwen3 Embedding 0.6BDescription
Accuracy Metrics
Latency Metrics
Mean
18149ms
15599ms
Average response time
P50
17786ms
15287ms
50th percentile (median)
P90
20871ms
17939ms
90th percentile

DBPedia

MetricJina Embeddings v3Qwen3 Embedding 0.6BDescription
Accuracy Metrics
nDCG@5
0.616
0.549
Ranking quality at top 5 results
nDCG@10
0.591
0.556
Ranking quality at top 10 results
Recall@5
0.225
0.216
% of relevant docs in top 5
Recall@10
0.340
0.350
% of relevant docs in top 10
Latency Metrics
Mean
199515ms
67654ms
Average response time
P50
195525ms
66301ms
50th percentile (median)
P90
229442ms
77802ms
90th percentile

FiQa

MetricJina Embeddings v3Qwen3 Embedding 0.6BDescription
Accuracy Metrics
nDCG@5
0.645
0.620
Ranking quality at top 5 results
nDCG@10
0.679
0.647
Ranking quality at top 10 results
Recall@5
0.633
0.590
% of relevant docs in top 5
Recall@10
0.741
0.680
% of relevant docs in top 10
Latency Metrics
Mean
458812ms
212205ms
Average response time
P50
449636ms
207961ms
50th percentile (median)
P90
527634ms
244036ms
90th percentile

SciFact

MetricJina Embeddings v3Qwen3 Embedding 0.6BDescription
Accuracy Metrics
nDCG@5
0.622
0.666
Ranking quality at top 5 results
nDCG@10
0.661
0.686
Ranking quality at top 10 results
Recall@5
0.695
0.723
% of relevant docs in top 5
Recall@10
0.800
0.783
% of relevant docs in top 10
Latency Metrics
Mean
270629ms
102019ms
Average response time
P50
265216ms
99979ms
50th percentile (median)
P90
311223ms
117322ms
90th percentile

MSMARCO

MetricJina Embeddings v3Qwen3 Embedding 0.6BDescription
Accuracy Metrics
nDCG@5
1.000
0.997
Ranking quality at top 5 results
nDCG@10
0.997
0.992
Ranking quality at top 10 results
Recall@5
0.123
0.122
% of relevant docs in top 5
Recall@10
0.220
0.215
% of relevant docs in top 10
Latency Metrics
Mean
476020ms
65717ms
Average response time
P50
466500ms
64403ms
50th percentile (median)
P90
547423ms
75575ms
90th percentile

NorQuAD

MetricJina Embeddings v3Qwen3 Embedding 0.6BDescription
Accuracy Metrics
Latency Metrics
Mean
45614ms
12763ms
Average response time
P50
44702ms
12508ms
50th percentile (median)
P90
52456ms
14677ms
90th percentile

ARCD

MetricJina Embeddings v3Qwen3 Embedding 0.6BDescription
Accuracy Metrics
nDCG@5
0.888
0.865
Ranking quality at top 5 results
nDCG@10
0.900
0.872
Ranking quality at top 10 results
Recall@5
0.920
0.880
% of relevant docs in top 5
Recall@10
0.960
0.900
% of relevant docs in top 10
Latency Metrics
Mean
85941ms
6841ms
Average response time
P50
84222ms
6704ms
50th percentile (median)
P90
98832ms
7867ms
90th percentile

Explore More

Compare more embeddings

See how all embedding models stack up. Compare OpenAI, Cohere, Jina AI, Voyage, and more. View comprehensive benchmarks, compare performance metrics, and find the perfect embedding for your RAG application.