NVIDIA
Llama 3.1 Nemotron 70B
- Context window
- 131Ktokens
- Max output
- 16Ktokens
- Input
- $0.12/ 1M
- Output
- $0.30/ 1M
Quick start
from openai import OpenAI
client = OpenAI(
base_url="https://neurongate.net/v1",
api_key="sk-ng-your-api-key",
)
completion = client.chat.completions.create(
model="nvidia/llama-3.1-nemotron-70b-instruct",
messages=[{"role": "user", "content": "Hello!"}],
)
print(completion.choices[0].message.content)Cost
| Example request | Tokens | Cost |
|---|---|---|
| Short prompt | 1K in | $0.00012 |
| Typical chat turn | 1K in · 500 out | $0.00027 |
| Document analysis | 10K in · 2K out | $0.0018 |
| Long context | 100K in · 10K out | $0.015 |
Prices in USD. Billed per token actually used, from a balance prepaid in USDT, USDC, ETH or BTC.
Frequently asked questions
What is Llama 3.1 Nemotron 70B?
Llama 3.1 Nemotron 70B is an AI language model from NVIDIA, available through NeuronGate's OpenAI-compatible API.
How much does Llama 3.1 Nemotron 70B cost?
Llama 3.1 Nemotron 70B is priced at $0.12 per 1 million input tokens and $0.3 per 1 million output tokens when accessed via NeuronGate. You pay per token — no subscriptions required. Top up with crypto (USDT, USDC, ETH, BTC).
Does Llama 3.1 Nemotron 70B support streaming?
Yes, Llama 3.1 Nemotron 70B supports streaming responses via NeuronGate's API. Use the standard "stream": true parameter in your request.
What is the context window of Llama 3.1 Nemotron 70B?
Llama 3.1 Nemotron 70B has a context window of 131K tokens (~98K words). Maximum output is 16K tokens.
Does Llama 3.1 Nemotron 70B support function calling (tools)?
Yes, Llama 3.1 Nemotron 70B supports function calling / tool use via NeuronGate's standard API.
How do I use Llama 3.1 Nemotron 70B with NeuronGate?
Create a NeuronGate account, top up your balance with crypto, generate an API key, and use the model id nvidia/llama-3.1-nemotron-70b-instruct in your requests. NeuronGate uses the OpenAI-compatible API format — set your base URL to https://neurongate.net/v1.