Released date

Model

Last Updated 12/17/2024

Points to the most recent snapshot of the o1 model: o1-2024-12-17

Released Date: 12/17/2024

Avg. Accuracy:

81.5%

Latency:

14.47s

Performance by Benchmark

Benchmarks

Accuracy

Rankings

LegalBench

77.6%

( 15 / 43 )

77.6%

15 / 43

CaseLaw

81.9%

( 8 / 39 )

81.9%

8 / 39

ContractLaw

72.7%

( 6 / 47 )

72.7%

6 / 47

TaxEval

78.6%

( 1 / 25 )

78.6%

1 / 25

MedQA

96.5%

( 1 / 24 )

96.5%

1 / 24

Academic Benchmarks

Proprietary Benchmarks (contact us to get access)

Cost Analysis

Input Cost

$15.00 / M Tokens

Output Cost

$60.00 / M Tokens

Input Cost (per char)

$3.27 / M chars

Output Cost (per char)

N/A

Overview

OpenAI o1 is the production-ready version of their previously released o1-preview. OpenAI claims it generally has lower latency than its predecessor. Unlike o1-preview, it also supports system prompts and temperature.

It also supports a new “reasoning effort” parameter, which allows users to control the level of reasoning the model will do.

Key Specifications

Context Window: 200,000 tokens
Output Limit: 100,000 tokens
Training Cutoff: October 2023
Pricing:
- Input: $15.00 per million tokens
- Cached Input: $7.50 per million tokens
- Output: $60.00 per million tokens

Performance by Benchmark

Cost Analysis

Overview

Key Specifications

Join our mailing list to receive benchmark updates on