metadata

base_model:
  - Steelskull/L3.3-Electra-R1-70b
pipeline_tag: text-generation
library_name: transformers
quantized_by: ddh0

Steelskull/L3.3-Electra-R1-70b-GGUF

This repo provides several GGUF imatrix quantizations of Steelskull/L3.3-Electra-R1-70b.

Quantizations (worst to best)

IQ2_M
IQ3_XS
IQ3_M
Q4_K_S
IQ4_XS
Q4_K_M
Q5_K_S
Q5_K_M
Q6_K
Q8_0

The imatrix was generated using the same calibration data as Bartowski, and both the calibration data as well as the imatrix itself are provided here.