Back to all LLMs

Claude Sonnet 4.6

Approaches Opus-level performance at Sonnet pricing. Strong coding, creative writing, and instruction-following capabilities. Default model on claude.ai. Balanced performance and cost for RAG applications with strong grounding and faithfulness. If you want to compare the best LLMs for your data, try Agentset.

Leaderboard Rank
#3
of 14
ELO Rating
1649
#3
Win Rate
58.2%
#3
Latency
9498ms
#5

Model Information

Provider
Anthropic
License
Proprietary
Input Price per 1M
$3.00
Output Price per 1M
$15.00
Context Window
200K
Release Date
2026-02-17
Model Name
claude-sonnet-4.6
Total Evaluations
1170

Performance Record

Wins681 (58.2%)
Losses260 (22.2%)
Ties229 (19.6%)
Wins
Losses
Ties

LLMs Are Just One Piece of RAG

Agentset gives you a managed RAG pipeline with the top-ranked models and best practices baked in. No infrastructure to maintain, no LLM orchestration to manage.

Trusted by teams building production RAG applications

5M+
Documents
1,500+
Teams
99.9%
Uptime

Performance Overview

ELO ratings by dataset

Claude Sonnet 4.6's ELO performance varies across different benchmark datasets, showing its strengths in specific domains.

Claude Sonnet 4.6 - ELO by Dataset

Detailed Metrics

Dataset breakdown

Performance metrics across different benchmark datasets, including accuracy and latency percentiles.

MSMARCO

ELO 172571.3% WR278W-53L-59T

Quality Metrics

Correctness
4.97
Faithfulness
5.00
Grounding
5.00
Relevance
5.00
Completeness
4.93
Overall
4.98

Latency Distribution

Mean
5785ms
Min
2066ms
Max
8195ms

PG

ELO 161652.8% WR206W-158L-26T

Quality Metrics

Correctness
5.00
Faithfulness
5.00
Grounding
5.00
Relevance
5.00
Completeness
5.00
Overall
5.00

Latency Distribution

Mean
12740ms
Min
8720ms
Max
20930ms

SciFact

ELO 160550.5% WR197W-49L-144T

Quality Metrics

Correctness
4.83
Faithfulness
4.87
Grounding
4.87
Relevance
5.00
Completeness
4.77
Overall
4.87

Latency Distribution

Mean
9969ms
Min
2886ms
Max
19276ms

Build RAG in Minutes, Not Months

Agentset gives you a complete RAG API with top-ranked LLMs and smart retrieval built in. Upload your data, call the API, and get grounded answers from day one.

import { Agentset } from "agentset";

const agentset = new Agentset();
const ns = agentset.namespace("ns_1234");

const results = await ns.search(
  "What is multi-head attention?"
);

for (const result of results) {
  console.log(result.text);
}

Compare Models

See how it stacks up

Compare Claude Sonnet 4.6 with other top llms to understand the differences in performance, accuracy, and latency.