Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,70 @@
+---
+tags:
+- unsloth
+base_model:
+- zai-org/GLM-4.5-Air
+license: mit
+language:
+- en
+- zh
+pipeline_tag: text-generation
+library_name: transformers
+---
+> [!NOTE]
+>  Includes Unsloth **chat template fixes**! <br> For `llama.cpp`, use `--jinja`
+>
+
+<div>
+<p style="margin-top: 0;margin-bottom: 0;">
+    <em><a href="https://docs.unsloth.ai/basics/unsloth-dynamic-v2.0-gguf">Unsloth Dynamic 2.0</a> achieves superior accuracy & outperforms other leading quants.</em>
+  </p>
+  <div style="display: flex; gap: 5px; align-items: center; ">
+    <a href="https://github.com/unslothai/unsloth/">
+      <img src="https://github.com/unslothai/unsloth/raw/main/images/unsloth%20new%20logo.png" width="133">
+    </a>
+    <a href="https://discord.gg/unsloth">
+      <img src="https://github.com/unslothai/unsloth/raw/main/images/Discord%20button.png" width="173">
+    </a>
+    <a href="https://docs.unsloth.ai/">
+      <img src="https://raw.githubusercontent.com/unslothai/unsloth/refs/heads/main/images/documentation%20green%20button.png" width="143">
+    </a>
+  </div>
+</div>
+
+
+# GLM-4.5-Air
+
+<div align="center">
+<img src=https://raw.githubusercontent.com/zai-org/GLM-4.5/refs/heads/main/resources/logo.svg width="15%"/>
+</div>
+<p align="center">
+    👋 Join our <a href="https://discord.gg/QR7SARHRxK" target="_blank">Discord</a> community.
+    <br>
+    📖 Check out the GLM-4.5 <a href="https://z.ai/blog/glm-4.5" target="_blank">technical blog</a>.
+    <br>
+    📍 Use GLM-4.5 API services on <a href="https://docs.z.ai/guides/llm/glm-4.5">Z.ai API Platform (Global)</a> or <br> <a href="https://docs.bigmodel.cn/cn/guide/models/text/glm-4.5">Zhipu AI Open Platform (Mainland China)</a>.
+    <br>
+    👉 One click to <a href="https://chat.z.ai">GLM-4.5</a>.
+</p>
+  
+## Model Introduction
+
+The **GLM-4.5** series models are foundation models designed for intelligent agents. GLM-4.5 has **355** billion total parameters with **32** billion active parameters, while GLM-4.5-Air adopts a more compact design with **106** billion total parameters and **12** billion active parameters. GLM-4.5 models unify reasoning, coding, and intelligent agent capabilities to meet the complex demands of intelligent agent applications.
+
+Both GLM-4.5 and GLM-4.5-Air are hybrid reasoning models that provide two modes: thinking mode for complex reasoning and tool usage, and non-thinking mode for immediate responses.
+
+We have open-sourced the base models, hybrid reasoning models, and FP8 versions of the hybrid reasoning models for both GLM-4.5 and GLM-4.5-Air. They are released under the MIT open-source license and can be used commercially and for secondary development.
+
+As demonstrated in our comprehensive evaluation across 12 industry-standard benchmarks, GLM-4.5 achieves exceptional performance with a score of **63.2**, in the **3rd** place among all the proprietary and open-source  models. Notably, GLM-4.5-Air delivers competitive results at **59.8** while maintaining superior efficiency.
+
+![bench](https://raw.githubusercontent.com/zai-org/GLM-4.5/refs/heads/main/resources/bench.png)
+
+For more eval results, show cases, and technical details, please visit
+our [technical blog](https://z.ai/blog/glm-4.5). The technical report will be released soon.
+
+
+The model code, tool parser and reasoning parser can be found in the implementation of [transformers](https://github.com/huggingface/transformers/tree/main/src/transformers/models/glm4_moe), [vLLM](https://github.com/vllm-project/vllm/blob/main/vllm/model_executor/models/glm4_moe_mtp.py) and [SGLang](https://github.com/sgl-project/sglang/blob/main/python/sglang/srt/models/glm4_moe.py).
+
+## Quick Start
+
+Please refer our [github page](https://github.com/zai-org/GLM-4.5) for more detail.

chat_template.jinja

@@ -0,0 +1,103 @@
+[gMASK]<sop>
+{%- if tools -%}
+<|system|>
+# Tools
+
+You may call one or more functions to assist with the user query.
+
+You are provided with function signatures within <tools></tools> XML tags:
+<tools>
+{% for tool in tools %}
+{{ tool | tojson(ensure_ascii=False) }}
+{% endfor %}
+</tools>
+
+For each function call, output the function name and arguments within the following XML format:
+<tool_call>{function-name}
+<arg_key>{arg-key-1}</arg_key>
+<arg_value>{arg-value-1}</arg_value>
+<arg_key>{arg-key-2}</arg_key>
+<arg_value>{arg-value-2}</arg_value>
+...
+</tool_call>{%- endif -%}
+{%- macro visible_text(content) -%}
+    {%- if content is string -%}
+        {{- content }}
+    {%- elif content is iterable and content is not mapping -%}
+        {%- for item in content -%}
+            {%- if item is mapping and item.type == 'text' -%}
+                {{- item.text }}
+            {%- elif item is string -%}
+                {{- item }}
+            {%- endif -%}
+        {%- endfor -%}
+    {%- else -%}
+        {{- content }}
+    {%- endif -%}
+{%- endmacro -%}
+{%- set ns = namespace(last_user_index=-1) %}
+{%- for m in messages %}
+    {%- if m.role == 'user' %}
+        {% set ns.last_user_index = loop.index0 -%}
+    {%- endif %}
+{%- endfor %}
+{% for m in messages %}
+{%- if m.role == 'user' -%}<|user|>
+{{ visible_text(m.content) }}
+{{- '/nothink' if (enable_thinking is defined and not enable_thinking and not visible_text(m.content).endswith("/nothink")) else '' -}}
+{%- elif m.role == 'assistant' -%}
+<|assistant|>
+{%- set reasoning_content = '' %}
+{%- set content = visible_text(m.content) %}
+{%- if m.reasoning_content is string %}
+    {%- set reasoning_content = m.reasoning_content %}
+{%- else %}
+    {%- if '</think>' in content %}
+        {%- set reasoning_content = ((content.split('</think>')|first).rstrip('\n').split('<think>')|last).lstrip('\n') %}
+        {%- set content = (content.split('</think>')|last).lstrip('\n') %}
+    {%- endif %}
+{%- endif %}
+{%- if loop.index0 > ns.last_user_index and reasoning_content -%}
+{{ '\n<think>' + reasoning_content.strip() +  '</think>'}}
+{%- else -%}
+{{ '\n<think></think>' }}
+{%- endif -%}
+{%- if content.strip() -%}
+{{ '\n' + content.strip() }}
+{%- endif -%}
+{% if m.tool_calls %}
+{% for tc in m.tool_calls %}
+{%- if tc.function %}
+    {%- set tc = tc.function %}
+{%- endif %}
+{{ '\n<tool_call>' + tc.name }}
+{% set _args = tc.arguments %}
+{% for k, v in _args.items() %}
+<arg_key>{{ k }}</arg_key>
+<arg_value>{{ v | tojson(ensure_ascii=False) if v is not string else v }}</arg_value>
+{% endfor %}
+</tool_call>{% endfor %}
+{% endif %}
+{%- elif m.role == 'tool' -%}
+{%- if m.content is string -%}
+{%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+    {{- '<|observation|>' }}
+{%- endif %}
+{{- '\n<tool_response>\n' }}
+{{- m.content }}
+{{- '\n</tool_response>' }}
+{%- else -%}
+<|observation|>{% for tr in m.content %}
+
+<tool_response>
+{{ tr.output if tr.output is defined else tr }}
+</tool_response>{% endfor -%}
+{% endif -%}
+{%- elif m.role == 'system' -%}
+<|system|>
+{{ visible_text(m.content) }}
+{%- endif -%}
+{%- endfor -%}
+{%- if add_generation_prompt -%}
+    <|assistant|>{{- '\n<think></think>' if (enable_thinking is defined and not enable_thinking) else '' -}}
+{%- endif -%}

config.json

@@ -0,0 +1,44 @@
+{
+  "architectures": [
+    "Glm4MoeForCausalLM"
+  ],
+  "attention_bias": true,
+  "attention_dropout": 0.0,
+  "eos_token_id": [
+    151329,
+    151336,
+    151338
+  ],
+  "first_k_dense_replace": 1,
+  "head_dim": 128,
+  "hidden_act": "silu",
+  "hidden_size": 4096,
+  "initializer_range": 0.02,
+  "intermediate_size": 10944,
+  "max_position_embeddings": 131072,
+  "model_type": "glm4_moe",
+  "moe_intermediate_size": 1408,
+  "n_group": 1,
+  "n_routed_experts": 128,
+  "n_shared_experts": 1,
+  "norm_topk_prob": true,
+  "num_attention_heads": 96,
+  "num_experts_per_tok": 8,
+  "num_hidden_layers": 46,
+  "num_key_value_heads": 8,
+  "num_nextn_predict_layers": 1,
+  "pad_token_id": 151330,
+  "partial_rotary_factor": 0.5,
+  "rms_norm_eps": 1e-05,
+  "rope_scaling": null,
+  "rope_theta": 1000000,
+  "routed_scaling_factor": 1.0,
+  "tie_word_embeddings": false,
+  "topk_group": 1,
+  "torch_dtype": "bfloat16",
+  "transformers_version": "4.54.1",
+  "unsloth_fixed": true,
+  "use_cache": true,
+  "use_qk_norm": false,
+  "vocab_size": 151552
+}

generation_config.json

@@ -0,0 +1,10 @@
+{
+  "_from_model_config": true,
+  "eos_token_id": [
+    151329,
+    151336,
+    151338
+  ],
+  "pad_token_id": 151329,
+  "transformers_version": "4.54.0"
+}

model-00001-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bf40ee4cfb4064cc3bdebddc5eb84808815b3908ad40611e1825e7f8d8bd56f2
+size 2970138176

model-00002-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5df5534eec7264f9a87204715bb81d5bfd55849e1fd0fa0af118e2e0ca67d01f
+size 4683035216

model-00003-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e621684a989e629eb35c884da0c8961c245b157758bb950c8f36a789689b3603
+size 4683035216

model-00004-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1d2e2d1028484c15add591acf12e393a492f1adcfae16a09413fdb0d14cd3c7d
+size 4683035216

model-00005-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:701af98fe4f9b04c0e2b81a892bae644e78c49c967ef882cea53a8e8c7bc73d8
+size 4683035216

model-00006-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:15d64fea65939fcd4b92e6ab0b7a6b6b7870957d7c6cd052fad0b32a38dd1d26
+size 4683035216

model-00007-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4ba688b9f983776c155d21754f429af741963c0e9a54c50361eb323afe603b4d
+size 4683035216

model-00008-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cd56cf39c66f2ac667237ad3e4f0fc93d12d63f6a15c5af91c25ac2d59229aaf
+size 4683035216

model-00009-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c3d7f37b7723baeb39f9127c58c18808711904554fc762fb00ab4ee5188eefe6
+size 4683035216

model-00010-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3e9e60dd8c68a3c4305baf4430a5dbb602ab6a07175c62972c94533ba34f4686
+size 4683035216

model-00011-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:96dec0a131067829287e5531022c1614250de3e3699629bccbcbab727b6c3316
+size 4683035616

model-00012-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8c09b419e56149d209626e3c2da88c868edb2f41821e4c32b796a52dea292135
+size 4683035616

model-00013-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bda1bd4f1f303327954665261198f6c9e0f89758b1e3469d01ace18c171bd46c
+size 4683035616

model-00014-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e1243e0d0c443b50704b6b4d0d1642b24d6aca2f20db81bbd8fa3aaf9afdfd39
+size 4683035616

model-00015-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:18e46a491c1631a6f61b5cb0e490b952d877242152e9fca4e1cd265db2a6cdf2
+size 4683035616

model-00016-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fdabf61b71c200bf0b3b443b89f20e09129ef45a4eb53680724a74f710ac1e7b
+size 4683035616

model-00017-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c29ae88bbbb1008081488a53d869159df43513f3250efcc14478be2c8574c8b2
+size 4683035616

model-00018-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c85906cfba9319dd4f5ea45190a4115249e0bc092f9a5364ac37decb7261fba8
+size 4683035616

model-00019-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ce53f6795024b6dd01939a3781ef2798aa6706cdc2791663bdb5a2a2123e9533
+size 4683035616

model-00020-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:44fb25c231b3064b1c42617f0b0ba6febd78dc673db72516c003766f8595d3d8
+size 4683035616

model-00021-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1e4dc2f2ca6f192a44a842845591b1cd4ec7f104fbebed8f95c4ebafeddedd4b
+size 4683035616

model-00022-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f97ac4eeed0c452d672ea9294940261a5302a8e9fdcedc5bd6afd95a481134e8
+size 4683035616

model-00023-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7eac740c84803cf4aa648589ef653fbabb061202cad838e58400aa6d3a9d1a57
+size 4683035616

model-00024-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b4f5ea9831d1d791a09b67ae1907b9d04a4aec7891e3a06b2061faf46c111fe3
+size 4683035616

model-00025-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d0c5f160a451b604603bca502c98d53b2de85526afbd86340d0376ea4f20b2c7
+size 4683035616

model-00026-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3e024ae4836ab68412f7aba85708ca84c6d7d6494792d15711505278b2431af9
+size 4683035616

model-00027-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ea2d70cefbbae4c9a1b4fb9fea921125415df2cd90bd959726e1acd5f60e1ccc
+size 4683035616

model-00028-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5ccac189bb1536d2f3af4670f8009a4344c1141b4002d03b4a0236d63048a787
+size 4683035616

model-00029-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b326f31362528b83655e0d13c30e4484560976a0c2a56d349213db7be37f1a79
+size 4683035616

model-00030-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6b8c1d982a8613050cbbb4bccee9b3b9fed114b5c4bdc3caacd2406bffbadd12
+size 4683035616

model-00031-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:665ec1bd1bed6820aa2d09ba82d583a9ef304f64b9b9cdac30caaac8792023c5
+size 4683035616

model-00032-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6dc765c6d5d2265a4f5cab5ea78d8770d4b666c8df78dd240a4c0ee3f54ee8f6
+size 4683035616

model-00033-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b9044129e80741207d2156f93f0f6e736455c404772d371abe3d2895df72bf2c
+size 4683035616

model-00034-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2588930866ddef08c7e310df044deb0e2ae0ae4ada5a80319fc87b60e9e33914
+size 4683035616

model-00035-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:85a67bf4c828c51601ae5a54ecbc030e6e4eb89ff5e29361797b764f3778008b
+size 4683035616

model-00036-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:398234ceda03cf27e800c659df7086c3377c0a86df621c0773cd11d800204a28
+size 4683035616

model-00037-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8fb25fbfe67387390e13c58a5e712b5f7f83c3922dda426b26c5c9be1fe4f01c
+size 4683035616

model-00038-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:da9eb496ce1fee40dd02fdc8491515270c839730b7562fc8c593a45560e97efe
+size 4683035616

model-00039-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c51db4b6e32fcd495c37ea7e6874ad71a176bd8d593500664dbe57522181e21b
+size 4683035616

model-00040-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8ab61c5a5dd731ec385f0fe8b9a00c14ab21aaf1de7f0ef3097e6b4920bde347
+size 4683035616

model-00041-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2ebee4e911c738b3cfdd77540553413267d7ab646e34e223dec5daf7334324ef
+size 4683035616

model-00042-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bccab153b1b90f1f510b45ac3c8524772d67c21e349a4303197a794b85b5d248
+size 4683035616

model-00043-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5a958b0b38d2a7c9e6a89b3123aa341eadf6ed6f730c0395b75d08f2bedb07b4
+size 4683035616

model-00044-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:345a64163ebfbd5aa119e8618afcfa5a07e1442deeb6776ee93c70c8d136c185
+size 4683035616

model-00045-of-00047.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:13a9eef0444c4d25401c8e7008cc693a0a8a3eb2ae2a15620a76ef7f2a2a235a
+size 4683035616