File size: 377 Bytes
fd4421c
 
dcadf22
 
 
 
fd4421c
dcadf22
 
 
1
2
3
4
5
6
7
8
9
10
11
---

license: apache-2.0
base_model: soob3123/amoral-gemma3-1B-v2
base_model_relation: quantized
library_name: mlc-llm
pipeline_tag: text-generation
---


4-bit [OmniQuant](https://arxiv.org/abs/2308.13137) quantized version of [amoral-gemma3-1B-v2](https://huggingface.co/soob3123/amoral-gemma3-1B-v2) for inference with the [Private LLM](http://privatellm.app) app.