Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

ubergarm
/
DeepSeek-V3-0324-GGUF

Text Generation
GGUF
mla
imatrix
deepseek_v3
conversational
ik_llama.cpp
Model card Files Files and versions Community
4
DeepSeek-V3-0324-GGUF
Ctrl+K
Ctrl+K
  • 1 contributor
History: 15 commits
ubergarm's picture
ubergarm
Add IQ1_S_R4 smol boi
50eb2a9 22 days ago
  • DeepSeek-V3-0324-IQ1_S_R4
    Upload folder using huggingface_hub 22 days ago
  • DeepSeek-V3-0324-IQ2_K_R4
    Add DeepSeek-V3-0324-IQ2_K_R4 3 months ago
  • DeepSeek-V3-0324-IQ4_K_R4
    Release DeepSeek-V3-0324-IQ4_K_R4 and benchmarks 3 months ago
  • images
    update README and add vram usage image 3 months ago
  • .gitattributes
    1.67 kB
    Add DeepSeek-V3-0324-IQ2_K_R4 3 months ago
  • DeepSeek-V3-0324.imatrix
    987 MB
    LFS
    Add initial test imatrix data 3 months ago
  • README.md
    49.7 kB
    Add IQ1_S_R4 smol boi 22 days ago