Lyra

MN-12B-Lyra-v4-6bpw-h8-exl2

This is a 6bpw h8 exl2 quant of MN-12B-Lyra-v4

Built-in(default) calibration dataset is used.

Downloads last month
19
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for riveRiPH/MN-12B-Lyra-v4-6bpw-h8-exl2

Quantized
(27)
this model

Collection including riveRiPH/MN-12B-Lyra-v4-6bpw-h8-exl2