Severian
/

Jamba-Bagel-GGUF

Inference Endpoints

Model card Files Files and versions Community

Q6_K Version of the Jamba-Bagel fine-tune: https://huggingface.co/jondurbin/bagel-jamba-v05

(Q4_K_M and Q8 are in the works, just takes a bit to upload)

Can only be used with this fork until the merge is complete: https://github.com/ggerganov/llama.cpp/pull/7531

Downloads last month: 23

GGUF

Model size

51.6B params

Architecture

jamba

6-bit

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

The model cannot be deployed to the HF Inference API: The model has no library tag.

Collection including Severian/Jamba-Bagel-GGUF

Jamba GGUF

Current GGUF's conversion of the Jamba models. Will be updated as support in llama.cpp merges/ https://github.com/ggerganov/llama.cpp/pull/7531 • 4 items • Updated May 30, 2024 • 2