Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

mradermacher
/
KafkaLM-15B-Base-GGUF

Transformers
GGUF
pruning
distillation
sparsity‑2:4
Model card Files Files and versions
xet
Community
KafkaLM-15B-Base-GGUF
107 GB
  • 1 contributor
History: 15 commits
mradermacher's picture
mradermacher
auto-patch README.md
03eef24 verified about 1 month ago
  • .gitattributes
    2.23 kB
    uploaded from leia about 1 month ago
  • KafkaLM-15B-Base.IQ4_XS.gguf
    8.6 GB
    xet
    uploaded from leia about 1 month ago
  • KafkaLM-15B-Base.Q2_K.gguf
    5.99 GB
    xet
    uploaded from leia about 1 month ago
  • KafkaLM-15B-Base.Q3_K_L.gguf
    8.27 GB
    xet
    uploaded from leia about 1 month ago
  • KafkaLM-15B-Base.Q3_K_M.gguf
    7.68 GB
    xet
    uploaded from leia about 1 month ago
  • KafkaLM-15B-Base.Q3_K_S.gguf
    6.98 GB
    xet
    uploaded from leia about 1 month ago
  • KafkaLM-15B-Base.Q4_K_M.gguf
    9.52 GB
    xet
    uploaded from leia about 1 month ago
  • KafkaLM-15B-Base.Q4_K_S.gguf
    9.03 GB
    xet
    uploaded from leia about 1 month ago
  • KafkaLM-15B-Base.Q5_K_M.gguf
    11.1 GB
    xet
    uploaded from leia about 1 month ago
  • KafkaLM-15B-Base.Q5_K_S.gguf
    10.8 GB
    xet
    uploaded from leia about 1 month ago
  • KafkaLM-15B-Base.Q6_K.gguf
    12.8 GB
    xet
    uploaded from leia about 1 month ago
  • KafkaLM-15B-Base.Q8_0.gguf
    16.6 GB
    xet
    uploaded from leia about 1 month ago
  • README.md
    3.46 kB
    auto-patch README.md about 1 month ago