Where to edit model so that no_think is the default
#6016
Answered
by
wellkilo
cameronj86
asked this question in
Get Help
Replies: 1 comment
|
On current Jan builds you can make this a per-model default from the chat input:
Jan persists that choice in the model's settings and, for llama.cpp models, sends this on each request: Auto omits the option and lets the model's chat template decide; On sends true. If your older Jan version does not have that Reasoning menu, /no_think is only a per-prompt soft switch for Qwen-style templates. In that case update Jan, or set chat_template_kwargs.enable_thinking=false in the API request/model configuration if your backend exposes it. The current default is auto, and the three persisted choices are defined in predefined.ts. The request mapping is in custom-chat-transport.ts. |
0 replies
Answer selected by
cameronj86
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
On current Jan builds you can make this a per-model default from the chat input:
Jan persists that choice in the model's settings and, for llama.cpp models, sends this on each request:
Auto omits the option and lets the model's chat template decide; On sends true.
If your older Jan version does not have that Reasoning menu, /no_think is only a per-prompt soft switch for Qwen-style templates. In that case update Jan, or set chat_template_kwargs.enable_thinking=false in the API request/model configuration if your backend exposes it.
The current default is auto…