Released Date: 3/24/2025

Avg. Accuracy:

74.7%

Latency:

21.58s

Performance by Benchmark

Benchmarks

Accuracy

Rankings

CorpFin

60.9%

( 5 / 25 )

CaseLaw

86.2%

( 1 / 44 )

ContractLaw

64.7%

( 33 / 51 )

TaxEval

75.2%

( 7 / 31 )

Math500

88.6%

( 6 / 27 )

AIME

52.2%

( 6 / 23 )

MGSM

92.0%

( 7 / 25 )

LegalBench

79.9%

( 4 / 49 )

MedQA

82.0%

( 13 / 29 )

GPQA

61.1%

( 7 / 24 )

MMLU Pro

78.9%

( 5 / 24 )

Academic Benchmarks
Proprietary Benchmarks (contact us to get access)

Cost Analysis

Input Cost

$1.20 / M Tokens

Output Cost

$1.20 / M Tokens

Input Cost (per char)

$0.29 / M chars

Output Cost (per char)

$0.35 / M chars

Join our mailing list to receive benchmark updates on

Stay up to date as new benchmarks and models are released.