fbaldassarri/meta-llama_Llama-3.2-1B-TEQ-int4-gs128-asym
Text Generation
•
Updated
TEQ-int4-gs128
[Highly Experimental Quantization] TEQ (Trainable Equivalent Transformation for Weight-only-Quantization of LLMs)
-
-
fbaldassarri/meta-llama_Llama-3.2-1B-TEQ-int4-gs128-sym
Text Generation • Updated -
fbaldassarri/meta-llama_Llama-3.2-1B-Instruct-TEQ-int4-gs128-asym
Text Generation • Updated -
fbaldassarri/meta-llama_Llama-3.2-1B-Instruct-TEQ-int4-gs128-sym
Text Generation • Updated -
fbaldassarri/meta-llama_Llama-3.2-3B-TEQ-int4-gs128-asym
Text Generation • Updated -
fbaldassarri/meta-llama_Llama-3.2-3B-TEQ-int4-gs128-sym
Text Generation • Updated -
fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-TEQ-int4-gs128-asym
Text Generation • Updated -
fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-TEQ-int4-gs128-sym
Text Generation • Updated