Hugging Face's logo

JackBinary
/
OpenCodeReasoning-Nemotron-1.1-32B-q0f32-MLC

MLC-LLM
web-llm
Model card Files
xet
Community
JackBinary commited on
Commit
d5b5a49
·
verified ·
1 Parent(s): 6faa9d4

Add files using upload-large-folder tool

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. README.md +52 -0
  2. ndarray-cache.json +0 -0
  3. params_shard_0.bin +3 -0
  4. params_shard_102.bin +3 -0
  5. params_shard_103.bin +3 -0
  6. params_shard_107.bin +3 -0
  7. params_shard_108.bin +3 -0
  8. params_shard_111.bin +3 -0
  9. params_shard_114.bin +3 -0
  10. params_shard_115.bin +3 -0
  11. params_shard_117.bin +3 -0
  12. params_shard_121.bin +3 -0
  13. params_shard_122.bin +3 -0
  14. params_shard_127.bin +3 -0
  15. params_shard_129.bin +3 -0
  16. params_shard_131.bin +3 -0
  17. params_shard_133.bin +3 -0
  18. params_shard_135.bin +3 -0
  19. params_shard_139.bin +3 -0
  20. params_shard_14.bin +3 -0
  21. params_shard_140.bin +3 -0
  22. params_shard_141.bin +3 -0
  23. params_shard_143.bin +3 -0
  24. params_shard_146.bin +3 -0
  25. params_shard_147.bin +3 -0
  26. params_shard_149.bin +3 -0
  27. params_shard_155.bin +3 -0
  28. params_shard_16.bin +3 -0
  29. params_shard_165.bin +3 -0
  30. params_shard_177.bin +3 -0
  31. params_shard_179.bin +3 -0
  32. params_shard_18.bin +3 -0
  33. params_shard_180.bin +3 -0
  34. params_shard_182.bin +3 -0
  35. params_shard_19.bin +3 -0
  36. params_shard_191.bin +3 -0
  37. params_shard_192.bin +3 -0
  38. params_shard_193.bin +3 -0
  39. params_shard_196.bin +3 -0
  40. params_shard_198.bin +3 -0
  41. params_shard_20.bin +3 -0
  42. params_shard_200.bin +3 -0
  43. params_shard_202.bin +3 -0
  44. params_shard_205.bin +3 -0
  45. params_shard_211.bin +3 -0
  46. params_shard_212.bin +3 -0
  47. params_shard_214.bin +3 -0
  48. params_shard_215.bin +3 -0
  49. params_shard_217.bin +3 -0
  50. params_shard_223.bin +3 -0
README.md ADDED
@@ -0,0 +1,52 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: mlc-llm
3
+ base_model: nvidia/OpenCodeReasoning-Nemotron-1.1-32B
4
+ tags:
5
+ - mlc-llm
6
+ - web-llm
7
+ ---
8
+
9
+ # OpenCodeReasoning-Nemotron-1.1-32B-q0f32-MLC
10
+
11
+ This is the [OpenCodeReasoning-Nemotron-1.1-32B](https://huggingface.co/nvidia/OpenCodeReasoning-Nemotron-1.1-32B) model in MLC format `q0f32`.
12
+ The model can be used with [MLC-LLM](https://github.com/mlc-ai/mlc-llm) and [WebLLM](https://github.com/mlc-ai/web-llm).
13
+
14
+ ## Example Usage
15
+
16
+ Before using the examples, please follow the [installation guide](https://llm.mlc.ai/docs/install/mlc_llm.html#install-mlc-packages).
17
+
18
+ ### Chat CLI
19
+
20
+ ```bash
21
+ mlc_llm chat HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-32B-q0f32-MLC
22
+ ````
23
+
24
+ ### REST Server
25
+
26
+ ```bash
27
+ mlc_llm serve HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-32B-q0f32-MLC
28
+ ```
29
+
30
+ ### Python API
31
+
32
+ ```python
33
+ from mlc_llm import MLCEngine
34
+
35
+ model = "HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-32B-q0f32-MLC"
36
+ engine = MLCEngine(model)
37
+
38
+ for response in engine.chat.completions.create(
39
+ messages=[{"role": "user", "content": "What is the meaning of life?"}],
40
+ model=model,
41
+ stream=True,
42
+ ):
43
+ for choice in response.choices:
44
+ print(choice.delta.content, end="", flush=True)
45
+ print("\n")
46
+
47
+ engine.terminate()
48
+ ```
49
+
50
+ ## Documentation
51
+
52
+ For more on MLC LLM, visit the [documentation](https://llm.mlc.ai/docs/) and [GitHub repo](https://github.com/mlc-ai/mlc-llm).
ndarray-cache.json ADDED
The diff for this file is too large to render. See raw diff
 
params_shard_0.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b59784a50f01405e66afe36f567628ad66d7c4b0a55c6b0e2de52dd3aa4d88f9
3
+ size 1557135360
params_shard_102.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e70fe928bbd7d2f1175c59a744034aad3fae41f0047ff7fc7757095dfb1eafc2
3
+ size 73400320
params_shard_103.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:734d398fbb9f4775c703e4f9c1d5bbdd54dde31ceeb0aa3ef909c45d057446a7
3
+ size 52428800
params_shard_107.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:77d21b76f618dbd946601d462a04e7a35f9b42c4b03b8c9b1089310f858486bd
3
+ size 52428800
params_shard_108.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a96e5aa00a5fffaf51396c18062c734a2279ccb80543c586a6585d3d922a3a8c
3
+ size 283115520
params_shard_111.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7b8a7b464795abe1496b5eb30573277f68e2151e8356b4432e41b040314e18fa
3
+ size 52428800
params_shard_114.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2acd73541f90807301583a8302977e9032052de2df22d5600e5d2d6017374eef
3
+ size 73400320
params_shard_115.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1c76d9ba8e611cc35e595e04f3834a540700ddaee624841c2d7bd348930a04f4
3
+ size 52428800
params_shard_117.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:daa10200c8eb24f2f14a3adee57d499e254e23021370836bd166b26fb188a940
3
+ size 566231040
params_shard_121.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:106fedbc37768e28471c5cbdb3ba992f46af3ab6e6228d9b660bd348ab39146a
3
+ size 566231040
params_shard_122.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa2a2a4804fd5df88dc0aae696d9d22d97a0241d1f4206b97433dd0aea1254e9
3
+ size 73400320
params_shard_127.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:52cc83319ba3b200db2c22a71f7478929de4b5c3155c70709249d36dad10c125
3
+ size 52428800
params_shard_129.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5575e99b748d21a04642d88f7c71b3ed7347afeff5922a673074ae3c5ee65159
3
+ size 566231040
params_shard_131.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:082af84f687bcd5f90c17987851075c4b608991abf6b61808be2726f8d7f1c6c
3
+ size 52428800
params_shard_133.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a5d292c7f23d0cd3506a1e7864215e792ede6f0223fca182252929422b4fafb6
3
+ size 566231040
params_shard_135.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0014b0f98d753ff3a80966d02ca512876ab441251ca47819a42ab093cad0b60b
3
+ size 52428800
params_shard_139.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:32f51de8f42328a1f0704481d628447f99655263f62349a056128b9f4ca3c599
3
+ size 283115520
params_shard_14.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:940311d891e35177cabe9d308e86f010b7aa9b908e5dec56b4602da0387e1d5a
3
+ size 52428800
params_shard_140.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d1d4dbf03538ba70e7cbaeaa05bbf7b8bbecc55b2eeba15164a87ec9ee359497
3
+ size 283115520
params_shard_141.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3e0594ec19d5f02403b6ffd4fa9342249ce866ec4d4691a3b16eebc4318c5dab
3
+ size 566231040
params_shard_143.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e406408d09d5210051ce1fb86c1559fbbd4745e8aeaa53e00e169eab345e73cd
3
+ size 52428800
params_shard_146.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3dcaba4be633aaf577c7a10913b151171fd6f2583936fe3d5e7348bfe2cdfe3a
3
+ size 73400320
params_shard_147.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9ca0916f270a8005eabfa2a8086be15aa0515911192939ce778c707949c81de1
3
+ size 52428800
params_shard_149.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:55cd4cd4631b51de9371e5e1bd4d25d8aae250f2d2e97da8a5cda5afd1463ad4
3
+ size 566231040
params_shard_155.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1f37670eb5ed1b874766439680bf280a40e0db4bd92b876ef2ec3c67fdafcb23
3
+ size 52428800
params_shard_16.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4e6c0f30346b74d80c7555236a476b7d14486fa2b59041289e69cc6b191fcaba
3
+ size 566231040
params_shard_165.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:01bef76fc93f77c98e81fcb01d5d95b332f4a970d03c5719ddaa53e89424a2e2
3
+ size 566231040
params_shard_177.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9632824c65d47d857e1e53e11b8d1f5250b9d32c9faecfe339aa7cdcd3f4502b
3
+ size 73400320
params_shard_179.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:82e399d23ce362334a58e7950cad5d383bb6d0da4d337fad624b09bab745f9ad
3
+ size 283115520
params_shard_18.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e6c09d29773a3e64f69efe0a2c780843d2ad861dace13378517c9aa14b3b5a1
3
+ size 52428800
params_shard_180.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f154e8a8f941f3d86d18c4ca3d5848cbe70560093678087956a9bf78cc6c54cb
3
+ size 283115520
params_shard_182.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c842b53b9c47279d135b73aa0b9ff26a513e5d2bfd407f580237e7106036b3c4
3
+ size 73400320
params_shard_19.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:47986b5801543f64acf340fd1de3f5ac584500ba960f7d0ccd510f9f335924ae
3
+ size 283115520
params_shard_191.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:902b157c68a5b00581f39d3171e6edc3e68befce0b79742674a81d2325d2d458
3
+ size 52428800
params_shard_192.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4656846f47171308862d4873a65124aeb97d9d22f09cca6d12faf0d70d26c347
3
+ size 283115520
params_shard_193.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9dd7ca1c7eb0d24de92e8d22aab709d93a9c9f1242288372c70dc966bf11b30a
3
+ size 566231040
params_shard_196.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:66dcb9dc0d1508b72b951c530673177c26628aea4e6d137c594f9c437867a6d4
3
+ size 283115520
params_shard_198.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:788dba46263046d7e50223692774dc321a28c00e5daa7ad98625729ce948da5b
3
+ size 73400320
params_shard_20.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:82cb38805eb1f41dee82a1d0da88c4697243c5384e94335cf06948a656194b0b
3
+ size 566231040
params_shard_200.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:958564224c0ff3e81023fb20639f5a2f2d53b80eebd57ae3c1c9e888182dbcd8
3
+ size 283115520
params_shard_202.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3cd8197d1e2f30e236eef7a077f27657b31f53a96b6ded94f8ca9e56a04fbbab
3
+ size 73400320
params_shard_205.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0efacbcc895cc3e362f3f537959f3cdb21443949d4be23953130f6c87f7d5c50
3
+ size 566231040
params_shard_211.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d9865cd31d3f31d21248ef348a62b8f7757073768f1849cba93bd91ef09ff3ca
3
+ size 52428800
params_shard_212.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e6ef760775fb3fbd879b0b59d4c322f80bc473f9eb25d12d7ab51d54dadbe173
3
+ size 283115520
params_shard_214.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f17f60393081cf693f1021526e097ff2f17727271ecdeb44dfdb6a9f598b3310
3
+ size 73400320
params_shard_215.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:83943311e4213b6983da507510542c1fac12669757e3e11c2b7ca5baf610bcf9
3
+ size 52428800
params_shard_217.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:34aa1624bdc7d3e3831cf3d4a9e36bbc75579936bcabdb6d7a1a69c88f2bb4d1
3
+ size 73400320
params_shard_223.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e073e5abd0bce05d3e877dcaa5ea0d91ac3b027d5544e0ba5735aa6b9f87df1d
3
+ size 52428800