Ttimofeyka
/

bitnet-5B-v1

Text Generation

text-generation-inference

Model card Files Files and versions Community

bitnet-5B-v1

I redesigned mergekit so that I could merge the bitnet 3B model (unlike version v0, where I did merge via PyTorch).

In theory, this is compatible with quantization via llama.cpp , but tests are needed.

Downloads last month: 14

Safetensors

Model size

4.56B params

Tensor type

BF16

·

Inference Providers NEW

Text Generation

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Ttimofeyka/bitnet-5B-v1

Base model

1bitLLM/bitnet_b1_58-3B

Finetuned

(1)

this model