Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,57 @@
+---
+language:
+- en
+- zh
+library_name: transformers
+license: mit
+pipeline_tag: text-generation
+---
+
+# GLM-4.6-FP8
+
+<div align="center">
+<img src=https://raw.githubusercontent.com/zai-org/GLM-4.5/refs/heads/main/resources/logo.svg width="15%"/>
+</div>
+<p align="center">
+    👋 Join our <a href="https://discord.gg/QR7SARHRxK" target="_blank">Discord</a> community.
+    <br>
+    📖 Check out the GLM-4.6 <a href="https://z.ai/blog/glm-4.6" target="_blank">technical blog</a>, <a href="https://arxiv.org/abs/2508.06471" target="_blank">technical report(GLM-4.5)</a>, and <a href="https://zhipu-ai.feishu.cn/wiki/Gv3swM0Yci7w7Zke9E0crhU7n7D" target="_blank">Zhipu AI technical documentation</a>.
+    <br>
+    📍 Use GLM-4.6 API services on <a href="https://docs.z.ai/guides/llm/glm-4.6">Z.ai API Platform. </a>
+    <br>
+    👉 One click to <a href="https://chat.z.ai">GLM-4.6</a>.
+</p>
+
+## Model Introduction
+
+Compared with GLM-4.5, **GLM-4.6**  brings several key improvements:
+
+* **Longer context window:** The context window has been expanded from 128K to 200K tokens, enabling the model to handle more complex agentic tasks.
+* **Superior coding performance:** The model achieves higher scores on code benchmarks and demonstrates better real-world performance in applications such as Claude Code、Cline、Roo Code and Kilo Code, including improvements in generating visually polished front-end pages.
+* **Advanced reasoning:** GLM-4.6 shows a clear improvement in reasoning performance and supports tool use during inference, leading to stronger overall capability.
+* **More capable agents:** GLM-4.6 exhibits stronger performance in tool using and search-based agents, and integrates more effectively within agent frameworks.
+* **Refined writing:** Better aligns with human preferences in style and readability, and performs more naturally in role-playing scenarios.
+
+We evaluated GLM-4.6 across eight public benchmarks covering agents, reasoning, and coding. Results show clear gains over GLM-4.5, with GLM-4.6 also holding competitive advantages over leading domestic and international models such as **DeepSeek-V3.1-Terminus** and **Claude Sonnet 4**.
+
+![bench](https://raw.githubusercontent.com/zai-org/GLM-4.5/refs/heads/main/resources/bench_glm46.png)
+
+## Inference
+
+**Both GLM-4.5 and GLM-4.6 use the same inference method.**
+
+you can check our [github](https://github.com/zai-org/GLM-4.5) for more detail.
+
+## Recommended Evaluation Parameters
+
+For general evaluations, we recommend using a **sampling temperature of 1.0**.
+
+For **code-related evaluation tasks** (such as LCB), it is further recommended to set:
+
+- `top_p = 0.95`
+- `top_k = 40`
+
+## Evaluation
+
+- For tool-integrated reasoning, please refer to [this doc](https://github.com/zai-org/GLM-4.5/blob/main/resources/glm_4.6_tir_guide.md).
+- For search benchmark, we design a specific format for searching toolcall in thinking mode to support search agent, please refer to [this](https://github.com/zai-org/GLM-4.5/blob/main/resources/trajectory_search.json). for the detailed template.

chat_template.jinja

@@ -0,0 +1,103 @@
+[gMASK]<sop>
+{%- if tools -%}
+<|system|>
+# Tools
+
+You may call one or more functions to assist with the user query.
+
+You are provided with function signatures within <tools></tools> XML tags:
+<tools>
+{% for tool in tools %}
+{{ tool | tojson(ensure_ascii=False) }}
+{% endfor %}
+</tools>
+
+For each function call, output the function name and arguments within the following XML format:
+<tool_call>{function-name}
+<arg_key>{arg-key-1}</arg_key>
+<arg_value>{arg-value-1}</arg_value>
+<arg_key>{arg-key-2}</arg_key>
+<arg_value>{arg-value-2}</arg_value>
+...
+</tool_call>{%- endif -%}
+{%- macro visible_text(content) -%}
+    {%- if content is string -%}
+        {{- content }}
+    {%- elif content is iterable and content is not mapping -%}
+        {%- for item in content -%}
+            {%- if item is mapping and item.type == 'text' -%}
+                {{- item.text }}
+            {%- elif item is string -%}
+                {{- item }}
+            {%- endif -%}
+        {%- endfor -%}
+    {%- else -%}
+        {{- content }}
+    {%- endif -%}
+{%- endmacro -%}
+{%- set ns = namespace(last_user_index=-1) %}
+{%- for m in messages %}
+    {%- if m.role == 'user' %}
+        {% set ns.last_user_index = loop.index0 -%}
+    {%- endif %}
+{%- endfor %}
+{% for m in messages %}
+{%- if m.role == 'user' -%}<|user|>
+{{ visible_text(m.content) }}
+{{- '/nothink' if (enable_thinking is defined and not enable_thinking and not visible_text(m.content).endswith("/nothink")) else '' -}}
+{%- elif m.role == 'assistant' -%}
+<|assistant|>
+{%- set reasoning_content = '' %}
+{%- set content = visible_text(m.content) %}
+{%- if m.reasoning_content is string %}
+    {%- set reasoning_content = m.reasoning_content %}
+{%- else %}
+    {%- if '</think>' in content %}
+        {%- set reasoning_content = content.split('</think>')[0].rstrip('\n').split('<think>')[-1].lstrip('\n') %}
+        {%- set content = content.split('</think>')[-1].lstrip('\n') %}
+    {%- endif %}
+{%- endif %}
+{%- if loop.index0 > ns.last_user_index and reasoning_content -%}
+{{ '\n<think>' + reasoning_content.strip() +  '</think>'}}
+{%- else -%}
+{{ '\n<think></think>' }}
+{%- endif -%}
+{%- if content.strip() -%}
+{{ '\n' + content.strip() }}
+{%- endif -%}
+{% if m.tool_calls %}
+{% for tc in m.tool_calls %}
+{%- if tc.function %}
+    {%- set tc = tc.function %}
+{%- endif %}
+{{ '\n<tool_call>' + tc.name }}
+{% set _args = tc.arguments %}
+{% for k, v in _args.items() %}
+<arg_key>{{ k }}</arg_key>
+<arg_value>{{ v | tojson(ensure_ascii=False) if v is not string else v }}</arg_value>
+{% endfor %}
+</tool_call>{% endfor %}
+{% endif %}
+{%- elif m.role == 'tool' -%}
+{%- if m.content is string -%}
+{%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+    {{- '<|observation|>' }}
+{%- endif %}
+{{- '\n<tool_response>\n' }}
+{{- m.content }}
+{{- '\n</tool_response>' }}
+{%- else -%}
+<|observation|>{% for tr in m.content %}
+
+<tool_response>
+{{ tr.output if tr.output is defined else tr }}
+</tool_response>{% endfor -%}
+{% endif -%}
+{%- elif m.role == 'system' -%}
+<|system|>
+{{ visible_text(m.content) }}
+{%- endif -%}
+{%- endfor -%}
+{%- if add_generation_prompt -%}
+    <|assistant|>{{- '\n<think></think>' if (enable_thinking is defined and not enable_thinking) else '' -}}
+{%- endif -%}

config.json

@@ -0,0 +1,43 @@
+{
+  "architectures": [
+    "Glm4MoeForCausalLM"
+  ],
+  "attention_bias": true,
+  "attention_dropout": 0.0,
+  "eos_token_id": [
+    151329,
+    151336,
+    151338
+  ],
+  "first_k_dense_replace": 3,
+  "head_dim": 128,
+  "hidden_act": "silu",
+  "hidden_size": 5120,
+  "initializer_range": 0.02,
+  "intermediate_size": 12288,
+  "max_position_embeddings": 202752,
+  "model_type": "glm4_moe",
+  "moe_intermediate_size": 1536,
+  "n_group": 1,
+  "n_routed_experts": 160,
+  "n_shared_experts": 1,
+  "norm_topk_prob": true,
+  "num_attention_heads": 96,
+  "num_experts_per_tok": 8,
+  "num_hidden_layers": 92,
+  "num_key_value_heads": 8,
+  "num_nextn_predict_layers": 1,
+  "pad_token_id": 151329,
+  "partial_rotary_factor": 0.5,
+  "rms_norm_eps": 1e-05,
+  "rope_scaling": null,
+  "rope_theta": 1000000,
+  "routed_scaling_factor": 2.5,
+  "tie_word_embeddings": false,
+  "topk_group": 1,
+  "torch_dtype": "bfloat16",
+  "transformers_version": "4.54.0",
+  "use_cache": true,
+  "use_qk_norm": true,
+  "vocab_size": 151552
+}

generation_config.json

@@ -0,0 +1,11 @@
+{
+  "_from_model_config": true,
+  "eos_token_id": [
+    151329,
+    151336,
+    151338
+  ],
+  "temperature": 1.0,
+  "pad_token_id": 151329,
+  "transformers_version": "4.54.0"
+}

model-00001-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:792e4fc6b8e4d2a80621c5293cbe8f3f224c992d0a8ef063336c7101ffb93ab2
+size 1877199768

model-00002-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6dbab970e29d8fa7702f18eb66f79c01ccf281fdf67aa771b9f5b31cfa5cea94
+size 325307112

model-00003-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:83f8b33ea59f013c8a841e33c4048c715c0b03fb01ee613b97ea7bd74edd950c
+size 325307112

model-00004-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d75ef26d0a512f49da588bc48b34803e177c97548f93433d945b157e57b279c1
+size 3941942552

model-00005-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:67404a14a1cc5fcaf7e43a37e4f528d72ff0b7f6b94cc75eda88487e1a2fde64
+size 3941942552

model-00006-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:def0745e82451676a2f559ee82c3b64bba143eb892e0f5342876a6b625398f89
+size 3941942552

model-00007-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:59c7a39c12f940822cc71219221dd6e6db2152dd7a0fca9e09032ba2d8b76d8e
+size 3941942552

model-00008-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:809a46b2407e77d5c402ce8c4addda1755d5ee010baf917896249a92d3950c9b
+size 3941942552

model-00009-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:00f6c14f9255342e68d2a1dac7100336a07f3969506f7e868f4b06b0e9207322
+size 3941942552

model-00010-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cb1a035e85a2cead00949b7897ce3c8517f1f32a072624d812eb3c927721baef
+size 3941942552

model-00011-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b558e5c2b9f22a1dd3add3fb74828b2bcdd9fb04b683a0b49d53ee21d8c261a0
+size 3941943536

model-00012-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4360c5ad4b0bf089cf0991f5d1234264b8194b239ec5df9233701777ea44b7be
+size 3941943536

model-00013-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e1213d84e0061ec6963b099b76dbbcc895509e8e5099ca171d634c502d55ba52
+size 3941943536

model-00014-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a71970c0adbcbe333c2d2fddbbc0e27dd1fae877f480b407a2c3044521e03b23
+size 3941943536

model-00015-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b0b7cb187b9644504f5b4ffcfdf1db181d2ff0f99a5a70b3835f97dfb6e922c7
+size 3941943536

model-00016-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9cd6921f2fd7ed226fcda639b03e8293725440e03495c34b04ed4373d77451cd
+size 3941943536

model-00017-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e43f1ae28d72e0487d39a125e4593d58527a8447fbb961c4ddcfe498144033e2
+size 3941943536

model-00018-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0df123959b5917759f12c03c2b8813c9e00dee9bf4fd14ee1c42d9c49e92c47c
+size 3941943536

model-00019-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9a8c8c4fc764fbcce316a59de9e862ad1e5b289a5350deec408a05efdc5fa4b0
+size 3941943536

model-00020-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e389a315ca8dd1ec1e5b5dfd363b5313179ee438f475f85a7d14cc9a802a6055
+size 3941943536

model-00021-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bcefb72e78bd4b0d4ac7275551ea96af0739574b9a56dd8b9d2c2e84c87faf78
+size 3941943536

model-00022-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a06c02892eb0d93ad39f082c920d0587d5c2be070e0912395b29ad1379567038
+size 3941943536

model-00023-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:862d0456fd272189d65fc09c5b9888337efa066d881352bca2365db1e5350c6e
+size 3941943536

model-00024-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1cf520b647b1b7adbd0fb33c7d02fb969907575c7893b4bedd57c96d7b3d883a
+size 3941943536

model-00025-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0a66a852ff2bf51eb1bf88620c7664f428899cd88618e7bb0306112cc1791fbb
+size 3941943536

model-00026-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a850f74a0948773c497feb9cf50e887fabe03eb372c37b894d283fb8ae05047a
+size 3941943536

model-00027-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dbd77174221f3284c6d0c401c09d9e721f04663fead02d5d32b1f9e7e4b0b078
+size 3941943536

model-00028-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e8b6004f6572455d234ac82602c8733c515efde70f92cd36b9bcd8471d43af87
+size 3941943536

model-00029-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:72f254cbcdb9b30d7e8ee27d8961a08e560c09a8aa6aa93cc28ef7261b178d72
+size 3941943536

model-00030-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8ffcaf23d3adb8f57cf45af3f8029c8e04bb755355aa45ea337cc52541ddad50
+size 3941943536

model-00031-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6b3fb01326e67340e73807e98b1b32f00434d4645aa494d08f3534b6a6559bfb
+size 3941943536

model-00032-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:179b66d37cebac7d16e495bc3b818f4dcf905567b51966ea4c31eb3e2ffc96db
+size 3941943536

model-00033-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4d0424954737a9b0e537f9c258c26f7602c2d45a0790a6708a2b6f9205719ef5
+size 3941943536

model-00034-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:17826f12a95cb2fd4b2395976145cba948b08d3254828154f042d4f0c4e0ec6e
+size 3941943536

model-00035-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:15d2883ad4ce8e824ae2643664f26e443cc1d0211b3a959b3500ec382442cc35
+size 3941943536

model-00036-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:790ed51498aa9c7bd89cf5a6c992a7e5f1a4c11fbf7442109861dee4ee1da545
+size 3941943536

model-00037-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2e6e93031b97c013bd788fc2cc50c0f63e27467d385c2ebe5fac868bfcb702e9
+size 3941943536

model-00038-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:36817ddbedc45efa0d1456380efa0da082230e8f17fc4bd9a3371d6483d2a269
+size 3941943536

model-00039-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1c055d384cccbb058ffb1340aa8257dd6fe7dd3e36d6b42ddbdfb376ef913a92
+size 3941943536

model-00040-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0f915a463515c2dc598384977f87fe13c7bbba1472f6805ed8a95ee0db7ba189
+size 3941943536

model-00041-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d3b189147fae2fc8687d7ca6fd8fd18cd0e0c06b4e2503b8e5e756eda9e514c0
+size 3941943536

model-00042-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:edbfcb70d09a5e6ad08656fd99eb295a980b7ba620194779f83d6bec4c0bb398
+size 3941943536

model-00043-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6b7ca94fef251671134ac6dba9caff54575cf642559ef9c6d454360b3de8c3a9
+size 3941943536

model-00044-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ee218d7ef8992c0240971a42f34bdeeb8db671150e827987cfb261c29bf31101
+size 3941943536

model-00045-of-00092.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:79d6a523ee12a52e3e7478c1aa0de766e958d86bfab42a31e71ab2437dabe238
+size 3941943536