TokenReply

Loading…

Reload

JanitorAI API: proxy setup with TokenReply

TokenReply works with JanitorAI out of the box as a proxy. One key reaches free models and paid models, and cached chat history makes long roleplay chats cheaper. Paste the three values below into a JanitorAI proxy configuration and you are ready.

Last checked · Sources: JanitorAI's proxy quickstart and error help; TokenReply requests sent with JanitorAI-style settings

Proxy URL (full endpoint)
https://api.tokenreply.com/v1/chat/completions
API Key
sk-…
Model Name
An exact model ID

Step 1: Create an account and an API key

  1. Create a free TokenReply account. Free models work right away, no payment needed.
  2. Create an API key on the API keys page (walkthrough) and copy the value that starts with sk-.

Step 2: Add TokenReply as a proxy in JanitorAI

  1. Open any chat on JanitorAI, select the gear icon at the top right, then API Settings.
  2. Choose the proxy option and select Add Configuration.
  3. Config Name: any name, for example TokenReply.
  4. Model Name: an exact model ID from the list below, for example deepseek-v4-flash. Type it without spaces.
  5. Proxy URL: https://api.tokenreply.com/v1/chat/completions. Use the full endpoint, not just the base URL.
  6. API Key: your sk- key, with no spaces before or after it.
  7. Custom Prompt: optional. Leave it empty unless you already use one.
  8. Select Add, then Save Settings, then refresh the page. JanitorAI only loads the new configuration after a refresh.
  9. Send a short test message in a chat with a character that allows proxies.

Step 3: Pick a model for roleplay

These model IDs answered in character with JanitorAI's usual settings when we tested them. Prices and tiers below are read live from the catalog. Copy the ID exactly into Model Name; make one configuration per model to switch quickly.

Read from the live catalog when this page opens.

Access: Free models work on every account at no charge. Models of the week (Weekly Featured) allow 40 calls a day on Default and Trial accounts and have no daily cap on Plus. Plus models need a Plus subscription; calling them without one returns 403.

Free to try

Free models cost nothing per message and work on every account, subject to availability and rate limits.

Model IDAccessInput / 1MCached input / 1MOutput / 1M
nvidia/nemotron-3-ultra-550b-a55bFreeFreeFreeFree
grok-4.20-fastFreeFreeFreeFree
nemotron-3.5-super-vl-freeFreeFreeFreeFree
gemma-4-31b-itFreeFreeFreeFree

Low cost

Well under a cent for a typical long-chat message, and cheaper still when the chat history is cached.

Model IDAccessInput / 1MCached input / 1MOutput / 1M
deepseek-v4-flashModels of the week$0.22$0.007$0.66
mimo-v2.5-proModels of the week$0.217$0.0018$0.435
minimax-m2.5Models of the week$0.09$0.009$0.36
glm-5.3-flashPlus$0.075$0.015$0.25
gemini-2.5-flashModels of the week$0.15$0.015$1.25

Balanced

Stronger writing and memory for long stories at a moderate price per message.

Model IDAccessInput / 1MCached input / 1MOutput / 1M
kimi-k2.7Models of the week$0.475$0.095$2
glm-5.2Models of the week$0.7$0.13$2.2
glm-5.3Plus$0.7$0.13$2.2
deepseek-v4-proPlus$0.66$0.022$1.98
mimo-v2.6-proPlus$0.217$0.0018$0.435

Premium

The most capable models for complex characters and long arcs. Plus accounts only.

Model IDAccessInput / 1MCached input / 1MOutput / 1M
claude-sonnet-5Plus$0.6$0.06$3
claude-opus-4-8Plus$1.5$0.15$7.5
claude-opus-5Plus$1.5$0.15$7.5

Recommended JanitorAI settings

Generation settings that work well with TokenReply

SettingRecommended valueWhy
Text streamingOnText appears as it is written, and long replies are not cut off by the timeout described below.
Temperature0.8 to 1.0 to startHigher values are accepted, and TokenReply adjusts sampling values a model's provider would reject, so JanitorAI's defaults do not cause errors.
Max new tokens600 to 1000Long enough for a full roleplay reply. Avoid 0 or extreme values: a few models reject them with a 400 error.
Context size16k to 32k tokens for most chatsEvery message resends the chat up to this size, so a larger context costs more per message. Cache makes the repeated part cheaper.

Timeouts: keep streaming on

A reply that is sent all at once (streaming off) must finish within about 2 minutes, or the connection ends with a timeout error and nothing is shown. With text streaming on, long replies keep arriving until they are complete. If you use a VPN and replies stop after about two minutes even with streaming on, the VPN may be closing long connections; try without it or with a lower Max new tokens.

What does one message cost?

Read from the live catalog when this page opens.

Example: one message in a long chat sends 16,000 tokens (character, memory and history) and gets 800 tokens back. With cache, 12,000 of the 16,000 input tokens are the unchanged part of the chat and are billed at the cached input price. Free models cost nothing.

Model IDPer messagePer message with cache100 messages with cache
deepseek-v4-flash$0.00405$0.00149$0.149
mimo-v2.5-pro$0.00383$0.00124$0.124
glm-5.3-flash$0.0014$0.00068$0.068
kimi-k2.7$0.0092$0.00464$0.464
glm-5.2$0.013$0.00612$0.612
deepseek-v4-pro$0.0121$0.00449$0.449
claude-sonnet-5$0.012$0.00552$0.552
claude-opus-4-8$0.03$0.0138$1.38

Prices use the cheapest available route, as on the models page. Actual cost depends on your context size, reply length and how much of the chat is cached.

Free models cost nothing per message. Weekly Featured models (labeled Models of the week) allow 40 calls a day on Default and Trial accounts, plus 10 more on days you check in. Plus ($5 a month, with $5 of usage included) unlocks Plus models and removes that daily cap. Details are in plans and tiers.

Troubleshooting

SymptomWhat it usually meansWhat to do
A network error occurred or Network ErrorThe Proxy URL is not the full endpoint, or the page was not refreshed after saving.Set Proxy URL to exactly https://api.tokenreply.com/v1/chat/completions, select Save Settings and refresh the page.
401 Invalid tokenThe key is incomplete, revoked, or pasted with spaces.Copy the key again from the API keys page and paste it into API Key without spaces.
401 Token not providedThe API Key field is empty.Paste your sk- key, save and refresh.
503 No upstream channel is available for this modelThe model ID is misspelled, has a trailing space, or is not in the catalog.Copy the exact ID from the list on this page or the models page into Model Name.
400 The request failed with status code 400Usually Max new tokens is 0 or very large, or the chat is longer than the model's context window.Set Max new tokens to 600 to 1000 and lower the context size, then send the message again.
403 or not permitted for a modelYour account tier does not include that model.Pick a Free or Weekly Featured model, or upgrade to Plus. The tier of every model is shown on the models page.
429 Too Many RequestsA rate limit or the daily Weekly Featured allowance was reached.Wait a moment before retrying, or switch to another model. Plus has no daily Weekly Featured cap.
502 or Service temporarily unavailableThe model is busy right now.Retry the message. If it keeps failing, switch to another model from the list above and check status.
The reply stops mid-sentenceThe reply reached Max new tokens.Raise Max new tokens, or ask the character to continue.
Nothing appears after about 2 minutesStreaming is off and the reply took longer than the timeout.Turn on text streaming, or lower Max new tokens.
The old model is still used after savingJanitorAI has not reloaded the configuration.Refresh the page, open API Settings and check which configuration is active.

Frequently asked questions

What is the JanitorAI proxy URL for TokenReply?

https://api.tokenreply.com/v1/chat/completions. JanitorAI needs the full chat completions endpoint. Apps such as SillyTavern ask for the base URL https://api.tokenreply.com/v1 instead.

Which model should I use on JanitorAI?

Start with a free model such as grok-4.20-fast or nvidia/nemotron-3-ultra-550b-a55b. For better writing at a low price, deepseek-v4-flash and mimo-v2.5-pro are good choices; claude-sonnet-5 is the premium pick on Plus.

Is there a free JanitorAI API?

Yes. Free models cost nothing per message on every TokenReply account, within rate limits. The current list is in the free AI API guide.

Why are long JanitorAI chats expensive, and how does cache help?

JanitorAI resends the character and the chat history with every message, so a long chat sends thousands of tokens each time. On models with a cached input price, the repeated part is billed at that lower rate.

How do I pay for paid models?

Add balance on the top-up page (how to top up) and pay as you go, or subscribe to Plus for $5 a month, which includes $5 of usage and unlocks Plus models. Free models never need a balance.

Do I need to refresh JanitorAI after changing settings?

Yes. Save the configuration, then refresh the page before sending a message.

Resources

Related

Ready to try it?