Meta: Llama 3 70B Instruct
meta-llama/llama-3-70b-instruct
For $1, you can send approximately:
~114messages
How do we get this number?
One message = ~7,000 input tokens + ~7,000 output tokens
Input cost per message7,000 x $0.51/M = $0.003570
Output cost per message7,000 x $0.74/M = $0.005180
Total cost per message$0.008750
Messages for $1114.29
Context window
8k
tokens
Max response
8k
tokens
Input price
$0.51
per million tokens
Output price
$0.74
per million tokens
Modalities
Input:textOutput:text
Description
Meta's latest class of model (Llama 3) launched with a variety of sizes & flavors. This 70B instruct-tuned version was optimized for high quality dialogue usecases. It has demonstrated strong...