Meta: Llama 3.1 70B Instruct
meta-llama/llama-3.1-70b-instruct
For $1, you can send approximately:
~179messages
How do we get this number?
One message = ~7,000 input tokens + ~7,000 output tokens
Input cost per message7,000 x $0.40/M = $0.002800
Output cost per message7,000 x $0.40/M = $0.002800
Total cost per message$0.005600
Messages for $1178.57
Context window
131k
tokens
Max response
0
tokens
Input price
$0.40
per million tokens
Output price
$0.40
per million tokens
Modalities
Input:textOutput:text
Description
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong...