Hugging Face's logo

numen-tech
/
Qwen2.5-Coder-14B-Instruct-GPTQ-Int4

Text Generation
MLC-LLM
English
code
codeqwen
chat
qwen
qwen-coder
conversational
4-bit precision
Model card Files Community
numen-tech commited on
Commit
eaf811f
·
1 Parent(s): f8e8c13

Add weights

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. README.md +15 -0
  2. config.json +5 -0
  3. merges.txt +0 -0
  4. ndarray-cache.json +0 -0
  5. params_shard_0.bin +3 -0
  6. params_shard_1.bin +3 -0
  7. params_shard_10.bin +3 -0
  8. params_shard_100.bin +3 -0
  9. params_shard_101.bin +3 -0
  10. params_shard_102.bin +3 -0
  11. params_shard_103.bin +3 -0
  12. params_shard_104.bin +3 -0
  13. params_shard_105.bin +3 -0
  14. params_shard_106.bin +3 -0
  15. params_shard_107.bin +3 -0
  16. params_shard_108.bin +3 -0
  17. params_shard_109.bin +3 -0
  18. params_shard_11.bin +3 -0
  19. params_shard_110.bin +3 -0
  20. params_shard_111.bin +3 -0
  21. params_shard_112.bin +3 -0
  22. params_shard_113.bin +3 -0
  23. params_shard_114.bin +3 -0
  24. params_shard_115.bin +3 -0
  25. params_shard_116.bin +3 -0
  26. params_shard_117.bin +3 -0
  27. params_shard_118.bin +3 -0
  28. params_shard_119.bin +3 -0
  29. params_shard_12.bin +3 -0
  30. params_shard_120.bin +3 -0
  31. params_shard_121.bin +3 -0
  32. params_shard_122.bin +3 -0
  33. params_shard_123.bin +3 -0
  34. params_shard_124.bin +3 -0
  35. params_shard_125.bin +3 -0
  36. params_shard_126.bin +3 -0
  37. params_shard_127.bin +3 -0
  38. params_shard_128.bin +3 -0
  39. params_shard_129.bin +3 -0
  40. params_shard_13.bin +3 -0
  41. params_shard_130.bin +3 -0
  42. params_shard_131.bin +3 -0
  43. params_shard_132.bin +3 -0
  44. params_shard_133.bin +3 -0
  45. params_shard_134.bin +3 -0
  46. params_shard_135.bin +3 -0
  47. params_shard_136.bin +3 -0
  48. params_shard_137.bin +3 -0
  49. params_shard_138.bin +3 -0
  50. params_shard_139.bin +3 -0
README.md CHANGED
@@ -1,3 +1,18 @@
1
  ---
2
  license: apache-2.0
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
1
  ---
2
  license: apache-2.0
3
+ license_link: https://huggingface.co/Qwen/Qwen2.5-Coder-14B-Instruct-GPTQ-Int4/blob/main/LICENSE
4
+ language:
5
+ - en
6
+ pipeline_tag: text-generation
7
+ tags:
8
+ - code
9
+ - codeqwen
10
+ - chat
11
+ - qwen
12
+ - qwen-coder
13
+ base_model: Qwen/Qwen2.5-Coder-14B-Instruct
14
+ base_model_relation: quantized
15
+ library_name: mlc-llm
16
  ---
17
+
18
+ 4-bit [GPTQ](https://arxiv.org/abs/2210.17323) quantized version of [Qwen2.5-Coder-14B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Coder-14B-Instruct) for use with the [Private LLM app](https://privatellm.app/).
config.json ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ {
2
+ "quantization_config": {
3
+ "bits": 4
4
+ }
5
+ }
merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
ndarray-cache.json ADDED
The diff for this file is too large to render. See raw diff
 
params_shard_0.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0bbf237b29222565a9e98700499c78b8f3fe11ec175dc2001b7076821c033b0f
3
+ size 389283840
params_shard_1.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e8b71a11784bd26c0d3cf8d48d4f4affdaf831ce9b7e9c7ed1b0c09ed1e3245d
3
+ size 35389440
params_shard_10.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c18ed262f6ce841f290daf0e7a046bfcdae683797d11c0a3bf99b03aba3b153f
3
+ size 35389440
params_shard_100.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a206588e6b214871a0c599a33c86f66c29b6f2d4b7c74dfcdec50f1529068664
3
+ size 70778880
params_shard_101.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:527b0d8408013df7194be22a1fe3328c2c0fd4f95281cba5a7b4c51fdbcdaa73
3
+ size 32075776
params_shard_102.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d8ddcee0a2bf94fffe0aacdbbb36d0630b060bd659f677d9dcd4d3da62858092
3
+ size 21159936
params_shard_103.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fe395801ec691e989ca74796e08d811a4a13e5dff86a07372f50156690fb7c62
3
+ size 35389440
params_shard_104.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ae5d599a183e4593cca83ad9e2ac6f41c84f02d582218522a7f49771f70c3d58
3
+ size 70778880
params_shard_105.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1c11d49d274078f1cd069403fcfe7d6fcef81eec9e6801a4d3031ae659c76daf
3
+ size 18350080
params_shard_106.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4c4c7c73479b8672c123027dabf3d278e26c74c36d07179ededeabb014d13f6a
3
+ size 18350080
params_shard_107.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3cedff913248917879f8f8b3f1c063d1ec5a376f9d2c53c39c994e38ba2420c9
3
+ size 31547392
params_shard_108.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4ef85f0a626dd1141e274c81a1f2486d2e9d4742d97f3351ac351f18a9365823
3
+ size 35389440
params_shard_109.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fed5fefaad3125298d83253f53287b812c5b07c35b563c711def5bcb3adc76b3
3
+ size 70778880
params_shard_11.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6561ca344f953c9e1d237fc81f2a64962344caed247798319fb35c6c62080ea8
3
+ size 70778880
params_shard_110.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:39834f7f85e4ec8e2ad3ade423dede238a74beed99163032340ff1639bcb9407
3
+ size 35389440
params_shard_111.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:af83a917714a5459ea7f485dfe5f415724dafcc306e973c79ac222754e7f7491
3
+ size 70778880
params_shard_112.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2957cf3a90061e0bd1547ec8975bfd0b2602b1da638103fae28f47551ca30e4b
3
+ size 18350080
params_shard_113.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:da6ba95f276454513a32bff1b5890622c4fef5a306abb64a771a498c8797b73c
3
+ size 20781056
params_shard_114.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:68929213b52c4efe1ef513e330ab1f289965dff4a25a08e2f8aaa2a713f5d265
3
+ size 35389440
params_shard_115.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0ab4297c3292905a42991f975e9da36c899f07101b0f4114d6633ac77a347d9d
3
+ size 70778880
params_shard_116.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5d552236855eac3ab55d7a0162a67b9e4d6204044ec729c0d182ef70e4f1fa1b
3
+ size 18350080
params_shard_117.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f853f710c1a16e7991d146a7a080a38695e60e49a186011c68bef489c494e985
3
+ size 35389440
params_shard_118.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:840042d8522ff86af286ddff5d60eb2e22dc477a49621cdbcd95f05aa6c61412
3
+ size 70778880
params_shard_119.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8679ecb02392004f486fce0eb456454707f29f31d16e1c634d3b28539fe2e47a
3
+ size 32075776
params_shard_12.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:19f142dc35a12c84246155916bef94d978dd469b03019dbe3bc71169b675dd7f
3
+ size 18350080
params_shard_120.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:39a81130cdc9f19eeaab18fb9ee1f7860890726caf39c0cdacfba4fb31c45d45
3
+ size 21159936
params_shard_121.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f7c82894c712ee737f3e83e9b6a77f1c7a4e45e12736bd8d081cc5de65d27292
3
+ size 35389440
params_shard_122.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cace337cdd56e8d5895dd5ba285527d515dd713eb692ebea4f6c3008fae29c77
3
+ size 70778880
params_shard_123.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:44b382d7b742631e5349bea561d12047f200b0b6d3c7ff40934a5f3603ef2d7e
3
+ size 18350080
params_shard_124.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0d09ff6eb290aecd504d1f4d31f2b6755879b15164e175f63b30889c7834959d
3
+ size 35389440
params_shard_125.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:15f24040d578b69836af5c0bf70a7b62c6f114a76dbe6a93ab5a5b0bff7e652a
3
+ size 70778880
params_shard_126.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:df9416ab218dd8b777f2933f7a8270f5dfb74e488f5e4d28441ca451f05b4181
3
+ size 32075776
params_shard_127.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ad16fcd47be9557202c25759120b2e13c75337b14707d2b8096e7173bee11840
3
+ size 21159936
params_shard_128.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e66bce256619933fd4d260b286372efba75d086a73c1744df1c0b07bb3ce8e91
3
+ size 35389440
params_shard_129.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:99456ae2d8f453f75400fa28799e35823e951fc5bb4c8322582ffd4448e4b5d2
3
+ size 70778880
params_shard_13.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cfb554d7b9382a877ce477c62057862210778e39daf178b70982d229bc98e577
3
+ size 35389440
params_shard_130.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c1428b15428079678c97dd13dce85b3818eff8930507ee0c5bd176c630608715
3
+ size 18350080
params_shard_131.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3e80750c0b8850aa53200c5461a644d6b4b3ed515e595a4b30d6582625cac3bd
3
+ size 35389440
params_shard_132.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:63ee8ab04dede757c101ccbc36b4fa4893c085674638f3edc4eca66268212732
3
+ size 70778880
params_shard_133.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e8295ddc8d80396e7fdd58f45c0720814d15c47d007a816b47d50d596c8eebdf
3
+ size 32075776
params_shard_134.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:df345c64bebc428b0f991587796f166edc8793a493b6ba9de212cd5c39bd06c2
3
+ size 21159936
params_shard_135.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7b4673ada58cf68e560d833358b8631a9901f0b8d7193ae94d937513ce721526
3
+ size 35389440
params_shard_136.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:95e417546c80441574f14bbdd035ac05707bc9de5aafc581b8863b43c70f3d0d
3
+ size 70778880
params_shard_137.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1df60c259805b9a0f32825cbedbcf9c52ab323428597658741cf0146bfd16538
3
+ size 18350080
params_shard_138.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:18bfa8e4de921d26289f3928126b28921d15cc4863735de84bc61e5c025c493b
3
+ size 18350080
params_shard_139.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:44735ec192a2b5e9c87e7f4f274116b431e655f0a8ba0f5c22d1b87fe764ac9c
3
+ size 31547392