4.65 bit/bpw quantization of Marcoroni-70B-v1 (https://huggingface.co/AIDC-ai-business/Marcoroni-70B-v1) using exllamav2.
- Downloads last month
- 7
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support