bluuwhale
/

infinity-franken-GGUF-IQ-Imatrix

Model card Files Files and versions Community

No model card

Downloads last month: 41

GGUF

Model size

10.7B params

Architecture

llama

Hardware compatibility

Log In to view the estimation

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

View +1 variant

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including bluuwhale/infinity-franken-GGUF-IQ-Imatrix

GGUF Quantize Model 🖥️

GGUF Model Quantize Weight • 5 items • Updated Aug 5, 2024 • 1