DevQuasar
/

NousResearch.Hermes-4-70B-GGUF

Text Generation

Model card Files Files and versions

'Make knowledge free for everyone'

Tested with DevQuasar/wikitext-2-raw-v1-preprocessed-1k

Quantized version of: NousResearch/Hermes-4-70B

Downloads last month: 430

GGUF

Model size

70.6B params

Architecture

llama

Hardware compatibility

Log In to view the estimation

1-bit

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

View +1 variant

Model tree for DevQuasar/NousResearch.Hermes-4-70B-GGUF

Base model

meta-llama/Llama-3.1-70B

Finetuned

NousResearch/Hermes-4-70B

Quantized

(19)

this model