Anthropic’s latest model, Claude Sonnet 4.6, debuts at #1 on our Vals Index and #1 on the Vals Multimodal Index, evaluated across 17 benchmarks. Key takeaways:

• Claude Sonnet 4.6 takes first place on both Finance Agent (63.3%) and Tax Eval v2 (77.1%), demonstrating strong domain expertise in finance and tax.
• It takes first place on Terminal Bench 2 (59.55%), beating out Claude Opus 4.5 (Thinking) and Claude Opus 4.6 (Thinking). It is also #3 on SWE-bench (76.2%) and #2 on ProofBench (45.0%), showing competitive performance on agentic coding and formal mathematics.
• On knowledge benchmarks, Sonnet 4.6 scores 92.3% on AIME, 87.3% on MMLU Pro (#5), and 85.6% on GPQA.
• The model finishes top 10 on 13 of 17 benchmarks, with particularly strong results across finance and legal domains including #6 on CaseLaw and #7 on Mortgage Tax.

We evaluated Qwen 3.5 Plus on the Vals Index. Here are the key takeaways:

• Qwen 3.5 Plus places #10 overall on Vals Index (57.1% accuracy), and #3 among open-weight models.
• The model is strongest on financial tasks: it places #6 on our Corp Fin (v2) and #8 on our Finance Agent subsets.
• It is still weaker on legal and coding depth in this index mix, placing #25 on our Case Law (v2) and #17 on our SWE-bench subsets.
• It lands #11 on Terminal-Bench 2.0, which keeps it competitive on agentic coding tasks.

Just a day after the release of GLM 5, another elite open-weight coding model has been publicly released. Here are our key takeaways from benchmarking MiniMax-M2.5 on the Vals Index:

• MiniMax-M2.5 excels on (the vals index split of) SWE-bench, placing first among open-weight models. It places second among open-weight models on Terminal Bench 2, behind GLM 5.
• MiniMax-M2.5 struggles on legal and financial tasks, scoring relatively low on our “CorpFin” and “CaseLaw” tasks.

We ran all benchmarks on the “lightning” endpoint, which offers extra speed for twice the price of the standard endpoint. We used temperature 1, a top p of 0.9, and a max output tokens of 196,608.

Congrats to Minimax on the release!

We continue to find strong results for GLM 5 across the remainder of our benchmarks, often exceeding the performance of the previous open-weight champion, Kimi K2.5. Here are our key takeaways:

• The model excels on our IOI benchmark, beating Kimi by almost 5% (but taking almost twice as long to run)
• The model struggles on our private CaseLaw and TaxEval benchmarks, placing 50th and 48th, respectively

See our twitter post for the hyperparameters we used for evaluation. Congrats again to the team at z.AI on the release!