Claude Sonnet 4 (Nonthinking)

Claude Sonnet 4 (Nonthinking) is a model from Anthropic, released May 22, 2025. Its best result is #63 of 151 on LegalBench.

Release Date: May 22, 2025

Developer Anthropic ย ๐Ÿ‡บ๐Ÿ‡ธ
Context Window 200k
Max Output Tokens 64k
Token Costs (in/out) $3.00/15.00
Weights Private
Input Modalities

Accuracy

66.93 %

Avg. Cost (In/Out)

$ 3.00 / $ 15.00

Latency

11.72 s

Vals Index
BenchmarksAccuracyRankings

33.94%

ยฑ1.91
84/109

72.41%

ยฑ1.93
90/111

62.47%

ยฑ0.96
54/98

69.62%

ยฑ0.90
99/145

69.44%

ยฑ2.31
98/138

59.67%

ยฑ1.17
108/143

82.95%

ยฑ0.41
63/151

79.43%

ยฑ0.37
97/138

72.39%

ยฑ1.07
64/93
Proprietary BenchmarksAcademic BenchmarksIndustry Partners
Vals
Default Provider : Anthropic
Temperature: Default
Top P: Default
Top K: Default
Max Output Tokens: 64,000

Updates

May 25, 2025

We just evaluated Claude Sonnet 4 (Nonthinking) on all benchmarks!

Stay tuned for evaluations of Sonnet 4โ€™s thinking variant, as well as Opus 4!