Meta
Meta Llama 3.1 8B Instruct
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to...
- Context window
- 131Ktokens
- Max output
- 118Ktokens
- Input
- $0.05/ 1M
- Output
- $0.08/ 1M
Quick start
from openai import OpenAI
client = OpenAI(
base_url="https://neurongate.net/v1",
api_key="sk-ng-your-api-key",
)
completion = client.chat.completions.create(
model="meta-llama/llama-3.1-8b-instruct",
messages=[{"role": "user", "content": "Hello!"}],
)
print(completion.choices[0].message.content)Cost
| Example request | Tokens | Cost |
|---|---|---|
| Short prompt | 1K in | $0.00005 |
| Typical chat turn | 1K in · 500 out | $0.00009 |
| Document analysis | 10K in · 2K out | $0.00066 |
| Long context | 100K in · 10K out | $0.0058 |
Prices in USD. Billed per token actually used, from a balance prepaid in USDT, USDC, ETH or BTC.
Frequently asked questions
What is Meta Llama 3.1 8B Instruct?
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to...
How much does Meta Llama 3.1 8B Instruct cost?
Meta Llama 3.1 8B Instruct is priced at $0.05 per 1 million input tokens and $0.08 per 1 million output tokens when accessed via NeuronGate. You pay per token — no subscriptions required. Top up with crypto (USDT, USDC, ETH, BTC).
Does Meta Llama 3.1 8B Instruct support streaming?
Yes, Meta Llama 3.1 8B Instruct supports streaming responses via NeuronGate's API. Use the standard "stream": true parameter in your request.
What is the context window of Meta Llama 3.1 8B Instruct?
Meta Llama 3.1 8B Instruct has a context window of 131K tokens (~98K words). Maximum output is 118K tokens.
Does Meta Llama 3.1 8B Instruct support function calling (tools)?
Yes, Meta Llama 3.1 8B Instruct supports function calling / tool use via NeuronGate's standard API.
How do I use Meta Llama 3.1 8B Instruct with NeuronGate?
Create a NeuronGate account, top up your balance with crypto, generate an API key, and use the model id meta-llama/llama-3.1-8b-instruct in your requests. NeuronGate uses the OpenAI-compatible API format — set your base URL to https://neurongate.net/v1.