How to make this model work with Claude Code for local deployment?
Thank you for you guys release this fantastic model.
I have tried Claude Code -> Claude Code Router -> VLLM config, use
"vllm serve ./ --served-model-name KAT-Dev-72B-Exp --max-num-seq 1 --t
ensor-parallel-size 4 --host 0.0.0.0 --port 8000 --gpu-memory-utilization 0.975 --enable-auto-tool-choice --tool-call-parser hermes"
or
"vllm serve ./ --served-model-name KAT-Dev-72B-Exp --max-num-seq 1 --t
ensor-parallel-size 4 --host 0.0.0.0 --port 8000 --gpu-memory-utilization 0.975 --enable-auto-tool-choice --tool-call-parser qwen3_coder"
then try /init in Claude code, the response are all something like
"Let me start by checking if there's already a CLAUDE.md file in the repository: <{"name": "Bash", "arguments": {"command": "ls -la", "description": "Check for existing CLAUDE.md file"}}>"
no tool call triggered with in Claude Code cli
Looking solution for this use case ... appreciate for any kind of solution
Hi! KAT-Dev-72B-Exp was trained exclusively with the SWE-agent scaffold. It uses the XMLFunctionCallingParser(https://swe-agent.com/latest/reference/parsers/#sweagent.tools.parsing.XMLFunctionCallingParser)
as its tool-calling format.
As a result, this model does not support the Claude Code CLI.
If you’d like to use our model with Claude Code, please try the Kat-Coder model instead — its API is currently available for free at https://www.streamlake.ai/document/DOC/mg6k6nlp8j6qxicx4c9
. Kat-Coder was optimized during training for multiple scaffolds and is better suited for real-world programming scenarios.
Hope this clarifies your question!
Hi! KAT-Dev-72B-Exp was trained exclusively with the SWE-agent scaffold. It uses the XMLFunctionCallingParser(https://swe-agent.com/latest/reference/parsers/#sweagent.tools.parsing.XMLFunctionCallingParser)
as its tool-calling format.As a result, this model does not support the Claude Code CLI.
If you’d like to use our model with Claude Code, please try the Kat-Coder model instead — its API is currently available for free at https://www.streamlake.ai/document/DOC/mg6k6nlp8j6qxicx4c9
. Kat-Coder was optimized during training for multiple scaffolds and is better suited for real-world programming scenarios.Hope this clarifies your question!
Appreciate for your response, it is clear now.
It seems KAT-Code is the real solution, eagerly awaiting its open-source release. Tears streaming down my face.