TokenReply

Loading…

Reload

nvidia/nemotron-3.5-lightning-30b-a3b

NvidiaFree
Availability100.0%
Available

Samples: 16

Latency365 ms
Output speed102.1 tok/s
Per request
$0.00
Route
Default
Roleplay

No matching public benchmark is available for this model.

Not measured

Routes

Ability score divided by token cost, ranked across measured model routes. Cost uses equal input and output token counts; higher is better value.

Use this model
Default$0.00Per request——Not measuredNot measuredUse this model
curl --fail-with-body 'https://api.tokenreply.com/v1/chat/completions' \
  -H "Authorization: Bearer $TOKENREPLY_API_KEY" \
  -H 'Content-Type: application/json' \
  --data '{
  "model": "nvidia/nemotron-3.5-lightning-30b-a3b",
  "messages": [
    {
      "role": "user",
      "content": "Reply with hello."
    }
  ]
}'

More Nvidia models