Cohere Embed v3
Delivers state-of-the-art performance on MTEB and BEIR benchmarks for semantic search. Features compression capabilities and supports retrieval, classification, and clustering tasks.
Model Information
- Provider
- Cohere
- License
- Proprietary
- Price per 1M tokens
- $0.100
- Release Date
- 2024-02-07
- Model Name
- cohere-embed-v3
- Total Evaluations
- 1917
Performance Record
Wins786 (41.0%)
Losses915 (47.7%)
Ties216 (11.3%)
Wins
Losses
Ties
Performance Overview
ELO ratings by dataset
Cohere Embed v3's ELO performance varies across different benchmark datasets, showing its strengths in specific domains.
Cohere Embed v3 - ELO by Dataset
Detailed Metrics
Dataset breakdown
Performance metrics across different benchmark datasets, including accuracy and latency percentiles.
MSMARCO
ELO 151947.9% WR115W-82L-43T
Accuracy Metrics
- nDCG@5
- 1.000
- nDCG@10
- 0.996
- Recall@5
- 0.123
- Recall@10
- 0.218
Latency Distribution
- Mean
- 30494ms
- P50 (Median)
- 29884ms
- P90
- 35068ms
PG
ELO 151954.6% WR131W-101L-8T
Latency Distribution
- Mean
- 35998ms
- P50 (Median)
- 35278ms
- P90
- 41398ms
business reports
ELO 151152.1% WR125W-105L-10T
Latency Distribution
- Mean
- 4704ms
- P50 (Median)
- 4610ms
- P90
- 5410ms
SciFact
ELO 150751.2% WR123W-111L-6T
Accuracy Metrics
- nDCG@5
- 0.729
- nDCG@10
- 0.769
- Recall@5
- 0.788
- Recall@10
- 0.900
Latency Distribution
- Mean
- 41205ms
- P50 (Median)
- 40381ms
- P90
- 47386ms
DBPedia
ELO 149644.7% WR106W-110L-21T
Accuracy Metrics
- nDCG@5
- 0.634
- nDCG@10
- 0.619
- Recall@5
- 0.219
- Recall@10
- 0.353
Latency Distribution
- Mean
- 30356ms
- P50 (Median)
- 29749ms
- P90
- 34909ms
NorQuAD
ELO 148924.6% WR59W-75L-106T
Latency Distribution
- Mean
- 3703ms
- P50 (Median)
- 3629ms
- P90
- 4258ms
FiQa
ELO 148344.6% WR107W-130L-3T
Accuracy Metrics
- nDCG@5
- 0.641
- nDCG@10
- 0.650
- Recall@5
- 0.639
- Recall@10
- 0.678
Latency Distribution
- Mean
- 33241ms
- P50 (Median)
- 32576ms
- P90
- 38227ms
ARCD
ELO 13838.3% WR20W-201L-19T
Accuracy Metrics
- nDCG@5
- 0.349
- nDCG@10
- 0.398
- Recall@5
- 0.380
- Recall@10
- 0.520
Latency Distribution
- Mean
- 3093ms
- P50 (Median)
- 3031ms
- P90
- 3557ms
Compare Models
See how it stacks up
Compare Cohere Embed v3 with other top embeddings to understand the differences in performance, accuracy, and latency.