Llama 2 Reference Model, 70B parameters with FP16 quantization.
Released Date: 7/18/2023
Avg. Accuracy:
59.5%Latency:
7.23sPerformance by Benchmark
Benchmarks
Accuracy
Rankings
Academic Benchmarks
Proprietary Benchmarks (contact us to get access)
Cost Analysis
Input Cost
$0.90 / M Tokens
Output Cost
$0.90 / M Tokens
Input Cost (per char)
$0.00 / M chars
Output Cost (per char)
$0.04 / M chars