File size: 124 Bytes
334cc90 |
1 2 3 4 5 6 7 |
{
"quantization_method": "hqq",
"nbits": 4,
"group_size": 16,
"compute_dtype": "float16",
"hqq_version": "0.1.0"
} |
334cc90 |
1 2 3 4 5 6 7 |
{
"quantization_method": "hqq",
"nbits": 4,
"group_size": 16,
"compute_dtype": "float16",
"hqq_version": "0.1.0"
} |