openai/gpt-4-turbo GPT 4 Turbo

The latest GPT-4 Turbo model with vision capabilities. Vision requests can now use JSON mode and function calling. Currently points to gpt-4-turbo-2024-04-09.

Released Date: 4/9/2024

Avg. Accuracy:

77.1%

Latency:

5.57s

Performance by Benchmark

Benchmarks

Accuracy

Rankings

LegalBench

78.0%

( 13 / 43 )

CaseLaw

77.9%

( 17 / 39 )

ContractLaw

71.8%

( 8 / 47 )

MedQA

80.8%

( 13 / 24 )

Academic Benchmarks
Proprietary Benchmarks (contact us to get access)

Cost Analysis

Input Cost

$10.00 / M Tokens

Output Cost

$30.00 / M Tokens

Input Cost (per char)

$2.06 / M chars

Output Cost (per char)

$6.21 / M chars

Overview

GPT-4 Turbo was the previous flagship model, before the release of GPT-4o. Although it still provides strong performance, generally, GPT-4o is preferred.

Key Specifications

  • Context Window: 128,000 tokens
  • Output Limit: 4,096 tokens
  • Training Cutoff: December 2023
  • Pricing:
    • Input: $10.00 per million tokens
    • Output: $30.00 per million tokens

Performance Highlights

  • Vision Capabilities: Can analyze and reason about images
  • Complex Reasoning: Excels at multi-step problem solving
  • Function Calling: Enhanced API capabilities including JSON mode
  • Consistency: High reliability across diverse task types

Benchmark Results

Strong performance across our benchmarks:

  • TaxEval: High accuracy in tax reasoning tasks
  • LegalBench: Superior performance in legal analysis
  • ContractLaw: Excellent at contract interpretation
  • CaseLaw: Strong understanding of legal precedents

Use Case Recommendations

Best suited for:

  • Complex legal analysis
  • Vision-based tasks

Limitations

  • No longer the most recent model from OpenAI - newer models are preferred.
  • Shorter output limit compared to some competitors
  • Higher costs for similar performance to GPT-4o

Comparison with Other Models

  • Generally, less performance than GPT-4o at a higher cost.
  • Comparable performance to Claude 3 Opus
  • Higher cost than Gemini Pro 1.5
  • Better vision capabilities than most competitors
Join our mailing list to receive benchmark updates on

Stay up to date as new benchmarks and models are released.