Claude 3.7 Sonnet

Claude 3.7 Sonnet (Thinking)

Gemini 2.0 Pro Exp

Gemini 2.0 Flash (001)

o3 Mini

Gemini 2.0 Flash Thinking Exp

DeepSeek R1

DeepSeek V3

o1

Grok 2

Gemini 2.0 Flash Exp

Llama 3.3 Instruct Turbo (70B)

GPT 4o (2024-11-20)

Mistral Large Latest

Claude 3.5 Sonnet Latest

Claude 3.5 Haiku Latest

Gemini 1.5 Flash (002)

Gemini 1.5 Pro (002)

Mistral Small Latest

o1 Preview

o1 Mini

Jamba 1.5 Large

Jamba 1.5 Mini

GPT 4o (2024-08-06)

Llama 3.1 Instruct Turbo (8B)

Llama 3.1 Instruct Turbo (70B)

Llama 3.1 Instruct Turbo (405B)

GPT 4o Mini

Claude 3.5 Sonnet

Gemini 1.5 Flash (001)

Command R

Command R+

Llama 3 (8B)

Llama 3 (70B)

Qwen 2.5 Instruct Turbo (7B)

Qwen 2.5 Instruct Turbo (72B)

GPT 4 Turbo

DBRX Instruct

Command

Claude 3 Opus

Claude 3 Sonnet

Gemma 2 (27B)

Gemma 2 (9B)

Mixtral Instruct (8x22B)

Gemini 1.0 Pro 002

Mixtral (8x7B)

Mistral (7B)

Llama 2 (7B)

Llama 2 (13B)

Llama 2 (70B)

Falcon (7B)

Falcon (40B)

GPT 3.5