Qwen3 Embedding 4B vs Cohere Embed v3

Detailed comparison between Qwen3 Embedding 4B and Cohere Embed v3. See which embedding best meets your accuracy and performance needs. If you want to compare these models on your data, try Agentset.

Model Comparison

Qwen3 Embedding 4B takes the lead.

Both Qwen3 Embedding 4B and Cohere Embed v3 are powerful embedding models designed to improve retrieval quality in RAG applications. However, their performance characteristics differ in important ways.

Why Qwen3 Embedding 4B:

  • Qwen3 Embedding 4B delivers better accuracy (nDCG@10: 0.705 vs 0.624)

Overview

Key metrics

ELO Rating

Overall ranking quality

Qwen3 Embedding 4B

1482

Cohere Embed v3

1472

Win Rate

Head-to-head performance

Qwen3 Embedding 4B

44.6%

Cohere Embed v3

42.8%

Accuracy (nDCG@10)

Ranking quality metric

Qwen3 Embedding 4B

0.705

Cohere Embed v3

0.624

Average Latency

Response time

Qwen3 Embedding 4B

29ms

Cohere Embed v3

7ms

Embedding Models Are Just One Piece of RAG

Agentset gives you a managed RAG pipeline with the top-ranked models and best practices baked in. No infrastructure to maintain, no embeddings to manage.

Trusted by teams building production RAG applications

5M+
Documents
1,500+
Teams
99.9%
Uptime

Visual Performance Analysis

Performance

ELO Rating Comparison

Win/Loss/Tie Breakdown

Accuracy Across Datasets (nDCG@10)

Latency Distribution (ms)

Breakdown

How the models stack up

MetricQwen3 Embedding 4BCohere Embed v3Description
Overall Performance
ELO Rating
1482
1472
Overall ranking quality based on pairwise comparisons
Win Rate
44.6%
42.8%
Percentage of comparisons won against other models
Pricing & Availability
Price per 1M tokens
$0.020
$0.100
Cost per million tokens processed
Dimensions
2560
1024
Vector embedding dimensions (lower is more efficient)
Release Date
2025-06-06
2024-02-07
Model release date
Accuracy Metrics
Avg nDCG@10
0.705
0.624
Normalized discounted cumulative gain at position 10
Performance Metrics
Avg Latency
29ms
7ms
Average response time across all datasets

Build RAG in Minutes, Not Months

Agentset gives you a complete RAG API with top-ranked embedding models and smart retrieval built in. Upload your data, call the API, and get accurate results from day one.

import { Agentset } from "agentset";

const agentset = new Agentset();
const ns = agentset.namespace("ns_1234");

const results = await ns.search(
  "What is multi-head attention?"
);

for (const result of results) {
  console.log(result.text);
}

Dataset Performance

By field

Comprehensive comparison of accuracy metrics (nDCG, Recall) and latency percentiles for each benchmark dataset.

business reports

MetricQwen3 Embedding 4BCohere Embed v3Description
Accuracy Metrics
nDCG@5
0.000
0.000
Ranking quality at top 5 results
nDCG@10
0.000
0.000
Ranking quality at top 10 results
Recall@5
0.000
0.000
% of relevant docs in top 5
Recall@10
0.000
0.000
% of relevant docs in top 10
Latency Metrics
Mean
29ms
7ms
Average response time
P50
29ms
7ms
50th percentile (median)
P90
29ms
7ms
90th percentile

DBPedia

MetricQwen3 Embedding 4BCohere Embed v3Description
Accuracy Metrics
nDCG@5
0.799
0.810
Ranking quality at top 5 results
nDCG@10
0.787
0.797
Ranking quality at top 10 results
Recall@5
0.061
0.062
% of relevant docs in top 5
Recall@10
0.119
0.122
% of relevant docs in top 10
Latency Metrics
Mean
26ms
7ms
Average response time
P50
26ms
7ms
50th percentile (median)
P90
26ms
7ms
90th percentile

FiQa

MetricQwen3 Embedding 4BCohere Embed v3Description
Accuracy Metrics
nDCG@5
0.838
0.806
Ranking quality at top 5 results
nDCG@10
0.836
0.800
Ranking quality at top 10 results
Recall@5
0.719
0.640
% of relevant docs in top 5
Recall@10
0.839
0.681
% of relevant docs in top 10
Latency Metrics
Mean
23ms
7ms
Average response time
P50
23ms
7ms
50th percentile (median)
P90
23ms
7ms
90th percentile

SciFact

MetricQwen3 Embedding 4BCohere Embed v3Description
Accuracy Metrics
nDCG@5
0.666
0.707
Ranking quality at top 5 results
nDCG@10
0.697
0.740
Ranking quality at top 10 results
Recall@5
0.782
0.784
% of relevant docs in top 5
Recall@10
0.891
0.898
% of relevant docs in top 10
Latency Metrics
Mean
38ms
8ms
Average response time
P50
38ms
8ms
50th percentile (median)
P90
38ms
8ms
90th percentile

MSMARCO

MetricQwen3 Embedding 4BCohere Embed v3Description
Accuracy Metrics
nDCG@5
0.974
0.961
Ranking quality at top 5 results
nDCG@10
0.954
0.942
Ranking quality at top 10 results
Recall@5
0.124
0.124
% of relevant docs in top 5
Recall@10
0.224
0.218
% of relevant docs in top 10
Latency Metrics
Mean
31ms
7ms
Average response time
P50
31ms
7ms
50th percentile (median)
P90
31ms
7ms
90th percentile

ARCD

MetricQwen3 Embedding 4BCohere Embed v3Description
Accuracy Metrics
nDCG@5
0.857
0.330
Ranking quality at top 5 results
nDCG@10
0.864
0.376
Ranking quality at top 10 results
Recall@5
0.940
0.380
% of relevant docs in top 5
Recall@10
0.960
0.520
% of relevant docs in top 10
Latency Metrics
Mean
25ms
7ms
Average response time
P50
25ms
7ms
50th percentile (median)
P90
25ms
7ms
90th percentile

Explore More

Compare more embeddings

See how all embedding models stack up. Compare OpenAI, Cohere, Jina AI, Voyage, and more. View comprehensive benchmarks, compare performance metrics, and find the perfect embedding for your RAG application.