Safetensors conversion of Marcoroni 70B (https://huggingface.co/AIDC-ai-business/Marcoroni-70B), to do quants with exllamav2. Measurement.json is added as well.

Downloads last month
7
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support