Samples: 16
DeepSeek V4 Flash, pinned to the 0731 release.
Roleplay combines public evaluations of emotional understanding, creative writing and story-related skills. It is a comparative reference, not a direct roleplay test.
Each benchmark is rescaled to 1–10 within its own leaderboard. We average results from the same publisher first, then give each publisher equal weight. Only verified model matches are included.
Creative Writing v3
deepseek-ai/DeepSeek-V4-Flash-0731: 1,441.3
145 Models · 2026-10-25
LiveBench · Story constraint following
deepseek-v4-flash-0731: 70.5
71 Models · 2026-10-25
LiveBench · Theory of mind
deepseek-v4-flash-0731: 86.54
71 Models · 2026-10-25
Ability score divided by token cost, ranked across measured model routes. Cost uses equal input and output token counts; higher is better value.
| Use this model | ||||||
|---|---|---|---|---|---|---|
| upstart | $0.22 | $0.66 | $0.007 | 7.2/10 | 9.2/10 | Plans and tiers |
| deepseek_official | $0.44 | $1.32 | $0.014 | 7.2/10 | 8.1/10 | Plans and tiers |
| Default | $0.44 | $1.32 | $0.014 | 7.2/10 | 8.1/10 | Use this model |
curl --fail-with-body 'https://api.tokenreply.com/v1/chat/completions' \
-H "Authorization: Bearer $TOKENREPLY_API_KEY" \
-H 'Content-Type: application/json' \
--data '{
"model": "deepseek-v4-flash-0731",
"messages": [
{
"role": "user",
"content": "Reply with hello."
}
]
}'