Negative_LLAMA_70B_EXL3_1.6bpw / README.md

SicariusSicariiStuff

Update README.md

f9219a5 verified 23 days ago

preview code

raw

history blame contribute delete

362 Bytes

metadata

base_model:
  - SicariusSicariiStuff/Negative_LLAMA_70B
datasets:
  - SicariusSicariiStuff/UBW_Tapestries
language:
  - en
library_name: transformers
license: apache-2.0
quantized_by: SicariusSicariiStuff

Note

This was made to test extremely low quants. 70B is NOT usable at 1.6 bpw. A custom strategy for quanting was used, for details check EXL3 repo.