Nemotron 3.5 Lightning

NVIDIA Nemotron 3.5 Lightning is an open mixture-of-experts model from NVIDIA with 3B active parameters out of 30B total, suited for high-throughput agentic workloads and specialised tasks. NVIDIA Open High-Throughput MoE, with a 1M token context window.

POST/v1/ai/chat

$0.01/call

Overview

Property	Value
Model ID	`nvidia/nemotron-3.5-lightning`
Context Window	1,000,000 tokens
Max Output	131,072 tokens
Input Price	$0.12 / 1M tokens
Output Price	$0.30 / 1M tokens

Usage

const res = await fetch('https://api.yepapi.com/v1/ai/chat', {
  method: 'POST',
  headers: {
    'x-api-key': 'YOUR_API_KEY',
    'Content-Type': 'application/json',
  },
  body: JSON.stringify({
    model: 'nvidia/nemotron-3.5-lightning',
    messages: [{ role: 'user', content: 'Extract all function names and their docstrings from this Python file as JSON.' }],
  }),
});
const { data } = await res.json();
console.log(data.message.content);

curl -X POST https://api.yepapi.com/v1/ai/chat \
  -H "x-api-key: YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model": "nvidia/nemotron-3.5-lightning", "messages": [{"role": "user", "content": "Extract all function names and their docstrings from this Python file as JSON."}]}'

Request Body

Parameter	Type	Required	Description	Default
`model`	`string`	Yes	Model ID (e.g. `nvidia/nemotron-3.5-lightning`)	—
`messages`	`Message[]`	Yes	Array of `{ role, content }` objects	—
`maxTokens`	`number`	No	Maximum tokens in the response	Model default
`temperature`	`number`	No	Sampling temperature (0.0–2.0)	`1.0`
`topP`	`number`	No	Nucleus sampling threshold	`1.0`
`frequencyPenalty`	`number`	No	Penalize repeated tokens	`0`
`presencePenalty`	`number`	No	Penalize tokens already present	`0`
`stream`	`boolean`	No	Enable SSE streaming	`false`

Info

All AI models use the /v1/ai/chat endpoint. Specify the model with the model field.

Response

{
  "ok": true,
  "data": {
    "model": "nvidia/nemotron-3.5-lightning",
    "message": {
      "role": "assistant",
      "content": "[{\"name\": \"load_config\", \"doc\": \"Read and validate the YAML config.\"}, {\"name\": \"run\", \"doc\": \"Execute the pipeline end to end.\"}]"
    },
    "usage": {
      "promptTokens": 16,
      "completionTokens": 245,
      "totalTokens": 261
    }
  }
}

Streaming

Set "stream": true to receive Server-Sent Events. Each chunk contains a delta object:

data: {"delta":{"content":"Use"},"model":"nvidia/nemotron-3.5-lightning","index":0}
data: [DONE]

Under the Hood

We handle auth, billing, and response normalization — you just send messages.