Meta: Llama 3 8B Instruct
meta-llama/llama-3-8b-instruct
For $1, you can send approximately:
~2.0kmessages
How do we get this number?
One message = ~7,000 input tokens + ~7,000 output tokens
Input cost per message7,000 x $0.03/M = $0.000210
Output cost per message7,000 x $0.04/M = $0.000280
Total cost per message$0.000490
Messages for $12040.82
Context window
8k
tokens
Max response
16k
tokens
Input price
$0.03
per million tokens
Output price
$0.04
per million tokens
Modalities
Input:textOutput:text
Description
Meta's latest class of model (Llama 3) launched with a variety of sizes & flavors. This 8B instruct-tuned version was optimized for high quality dialogue usecases. It has demonstrated strong...