mahdi-b
/

viral-esm2-3b-hqq

8-bit precision

Model card Files Files and versions Community

viral-esm2-3b-hqq / quantization_config.json

mahdi-b's picture

Fix recursion issue in custom model loading

334cc90 verified about 2 months ago

history blame contribute delete

124 Bytes

	{
	"quantization_method": "hqq",
	"nbits": 4,
	"group_size": 16,
	"compute_dtype": "float16",
	"hqq_version": "0.1.0"
	}