Gemini 2.5 Pro
1M token context window accommodates extensive retrieved document sets without chunking. Multimodal RAG processes up to 3,000 images, 60 minutes of video, and 8.4 hours of audio alongside text.
Model Information
- Provider
- License
- Proprietary
- Input Price per 1M
- $1.25
- Output Price per 1M
- $10.00
- Context Window
- 1049K
- Release Date
- 2025-06-17
- Model Name
- gemini-2.5-pro
- Total Evaluations
- 810
Performance Record
Wins287 (35.4%)
Losses402 (49.6%)
Ties121 (14.9%)
Wins
Losses
Ties
Performance Overview
ELO ratings by dataset
Gemini 2.5 Pro's ELO performance varies across different benchmark datasets, showing its strengths in specific domains.
Gemini 2.5 Pro - ELO by Dataset
Detailed Metrics
Dataset breakdown
Performance metrics across different benchmark datasets, including accuracy and latency percentiles.
PG
ELO 147840.4% WR109W-146L-15T
Quality Metrics
- Correctness
- 5.00
- Faithfulness
- 5.00
- Grounding
- 5.00
- Relevance
- 5.00
- Completeness
- 5.00
- Overall
- 5.00
Latency Distribution
- Mean
- 17834ms
- Min
- 11067ms
- Max
- 49308ms
MSMARCO
ELO 147745.9% WR124W-101L-45T
Quality Metrics
- Correctness
- 4.90
- Faithfulness
- 4.93
- Grounding
- 4.93
- Relevance
- 5.00
- Completeness
- 4.90
- Overall
- 4.93
Latency Distribution
- Mean
- 12449ms
- Min
- 7629ms
- Max
- 23066ms
SciFact
ELO 131020.0% WR54W-155L-61T
Quality Metrics
- Correctness
- 4.73
- Faithfulness
- 4.80
- Grounding
- 4.80
- Relevance
- 4.73
- Completeness
- 4.57
- Overall
- 4.73
Latency Distribution
- Mean
- 15314ms
- Min
- 8817ms
- Max
- 35365ms
Compare Models
See how it stacks up
Compare Gemini 2.5 Pro with other top llms to understand the differences in performance, accuracy, and latency.