Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

legraphista
/
Hermes-3-Llama-3.1-70B-IMat-GGUF

Text Generation
GGUF
English
Llama-3
instruct
finetune
chatml
gpt4
synthetic data
distillation
function calling
json mode
axolotl
roleplaying
chat
quantized
GGUF
quantization
imat
imatrix
static
16bit
8bit
6bit
5bit
4bit
3bit
2bit
1bit
conversational
Model card Files Files and versions Community
Hermes-3-Llama-3.1-70B-IMat-GGUF
Ctrl+K
Ctrl+K
  • 1 contributor
History: 15 commits
legraphista's picture
legraphista
Upload imatrix.log with huggingface_hub
5f905bc verified 11 months ago
  • Hermes-3-Llama-3.1-70B.BF16
    Upload Hermes-3-Llama-3.1-70B.BF16/Hermes-3-Llama-3.1-70B.BF16-00001-of-00006.gguf with huggingface_hub 11 months ago
  • Hermes-3-Llama-3.1-70B.Q6_K
    Upload Hermes-3-Llama-3.1-70B.Q6_K/Hermes-3-Llama-3.1-70B.Q6_K-00001-of-00003.gguf with huggingface_hub 11 months ago
  • Hermes-3-Llama-3.1-70B.Q8_0
    Upload Hermes-3-Llama-3.1-70B.Q8_0/Hermes-3-Llama-3.1-70B.Q8_0-00001-of-00004.gguf with huggingface_hub 11 months ago
  • .gitattributes
    2.46 kB
    Upload imatrix.dat with huggingface_hub 11 months ago
  • README.md
    7.08 kB
    Upload README.md with huggingface_hub 11 months ago
  • imatrix.dat
    24.9 MB
    LFS
    Upload imatrix.dat with huggingface_hub 11 months ago
  • imatrix.dataset
    280 kB
    Upload imatrix.dataset with huggingface_hub 11 months ago
  • imatrix.log
    11.4 kB
    Upload imatrix.log with huggingface_hub 11 months ago