Powerful model for highly complex tasks.

Released Date: 2/29/2024

Avg. Accuracy:

70.6%

Latency:

6.52s

Performance by Benchmark

Benchmarks

Accuracy

Rankings

LegalBench

77.5%

( 11 / 24 )

CorpFin

62.7%

( 12 / 26 )

CaseLaw

80.2%

( 9 / 18 )

ContractLaw

74.0%

( 2 / 25 )

TaxEval

58.4%

( 8 / 25 )

Cost Analysis

Input Cost

$15.00 / M Tokens

Output Cost

$75.00 / M Tokens

Cost Per Test

$0.01 / 100 tests

Join our mailing list to receive benchmark updates on

Stay up to date as new benchmarks and models are released.