Qwen3 Reranker 8B
State-of-the-art 8B parameter cross-encoder reranker built on Qwen3 foundation model. Achieves 69.02 on MTEB-R and 81.22 on MTEB-Code benchmarks. Supports 32K context, 100+ languages, and instruction-following capabilities for task-specific optimization. If you want to compare the best rerankers for your data, try Agentset.
Model Information
- Provider
- Qwen
- License
- Open Source
- Price per 1M tokens
- $0.050
- Release Date
- 2025-06-06
- Model Name
- qwen3-8b
- Total Evaluations
- 3300
Performance Record
Rerankers Are Just One Piece of RAG
Agentset gives you a managed RAG pipeline with the top-ranked models and best practices baked in. No infrastructure to maintain, no reranking to configure.
Trusted by teams building production RAG applications
Performance Overview
ELO ratings by dataset
Qwen3 Reranker 8B's ELO performance varies across different benchmark datasets, showing its strengths in specific domains.
Qwen3 Reranker 8B - ELO by Dataset
Detailed Metrics
Dataset breakdown
Performance metrics across different benchmark datasets, including accuracy and latency percentiles.
DBPedia
Accuracy Metrics
- nDCG@5
- 0.000
- nDCG@10
- 0.000
- Recall@5
- 0.000
- Recall@10
- 0.000
Latency Distribution
- Mean
- 1673ms
- P50 (Median)
- 1673ms
- P90
- 1787ms
FiQa
Accuracy Metrics
- nDCG@5
- 0.114
- nDCG@10
- 0.118
- Recall@5
- 0.105
- Recall@10
- 0.110
Latency Distribution
- Mean
- 7242ms
- P50 (Median)
- 2278ms
- P90
- 2890ms
PG
Accuracy Metrics
- nDCG@5
- 0.000
- nDCG@10
- 0.000
- Recall@5
- 0.000
- Recall@10
- 0.000
Latency Distribution
- Mean
- 2567ms
- P50 (Median)
- 2579ms
- P90
- 2634ms
MSMARCO
Accuracy Metrics
- nDCG@5
- 0.000
- nDCG@10
- 0.000
- Recall@5
- 0.000
- Recall@10
- 0.000
Latency Distribution
- Mean
- 1728ms
- P50 (Median)
- 1624ms
- P90
- 1679ms
business reports
Accuracy Metrics
- nDCG@5
- 0.000
- nDCG@10
- 0.000
- Recall@5
- 0.000
- Recall@10
- 0.000
Latency Distribution
- Mean
- 1803ms
- P50 (Median)
- 1763ms
- P90
- 2097ms
arguana
Accuracy Metrics
- nDCG@5
- 0.492
- nDCG@10
- 0.519
- Recall@5
- 0.800
- Recall@10
- 0.880
Latency Distribution
- Mean
- 13109ms
- P50 (Median)
- 2812ms
- P90
- 3425ms
Build RAG in Minutes, Not Months
Agentset gives you a complete RAG API with top-ranked rerankers and embedding models built in. Upload your data, call the API, and get accurate results from day one.
import { Agentset } from "agentset";
const agentset = new Agentset();
const ns = agentset.namespace("ns_1234");
const results = await ns.search(
"What is multi-head attention?"
);
for (const result of results) {
console.log(result.text);
}Compare Models
See how it stacks up
Compare Qwen3 Reranker 8B with other top rerankers to understand the differences in performance, accuracy, and latency.