infery
← All models

Llama 3.1 8B Instruct

llama-3.1-8b-instruct

Chat & Textby Meta

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. 131,072 token context window, maximum output of 16,384 tokens. Higher uptime with 5 providers. Includes independent benchmarks from Artificial Analysis.

chatstreamingtoolsjson mode

Details

Accepts
text
Context window
16K tokens

Pricing

Input
6.25 cr / 1M tokens
Output
10 cr / 1M tokens
Cached input
3.13 cr / 1M tokens

Prices in credits (1 credit = $0.01).

Data schema

approximate

Input

FieldTypeDescription
promptrequiredstringThe text prompt.

Output

FieldTypeDescription
textstringGenerated text (choices[0].message.content).