python convert.py
-i openerotica_writing-roleplay-20k-context-nemo-12b-v1.0
-o /workspace/exllamaout
-m /workspace/exllamav2/measurement2.json
-cf /workspace/4.5bpw/
-b 4.5
-l 150000
-r 500
-c erotiquant3.parquet
-nr
- Downloads last month
- 12
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
HF Inference API was unable to determine this model's library.