fbaldassarri/HuggingFaceTB_SmolLM2-360M-Instruct-auto_awq-int4-gs64-asym
Text Generation
•
Updated
•
9
AutoAWQ-INT4-gs64
A collection of models quantized in AutoAWQ format using Intel AutoRound, INT4, groupsize 64
-
-
fbaldassarri/HuggingFaceTB_SmolLM2-360M-auto_awq-int4-gs64-asym
Text Generation • Updated • 10 -
fbaldassarri/HuggingFaceTB_SmolLM2-360M-auto_awq-int4-gs64-sym
Text Generation • Updated • 10 -
fbaldassarri/HuggingFaceTB_SmolLM2-135M-auto_awq-int4-gs64-asym
Text Generation • Updated • 12 -
fbaldassarri/HuggingFaceTB_SmolLM2-135M-auto_awq-int4-gs64-sym
Text Generation • Updated • 10 -
fbaldassarri/HuggingFaceTB_SmolLM2-135M-Instruct-auto_awq-int4-gs64-asym
Text Generation • Updated • 10 -
fbaldassarri/HuggingFaceTB_SmolLM2-135M-Instruct-auto_awq-int4-gs64-sym
Text Generation • Updated • 10 -
fbaldassarri/sapienzanlp_Minerva-350M-base-v1.0-autoawq-int4-gs64-asym
Text Generation • Updated • 10 -
fbaldassarri/sapienzanlp_Minerva-350M-base-v1.0-autoawq-int4-gs64-sym
Text Generation • Updated • 10 -
fbaldassarri/HuggingFaceTB_SmolLM2-360M-Instruct-auto_awq-int4-gs64-sym
Text Generation • Updated • 10 -
fbaldassarri/iGeniusAI_Italia-9B-Instruct-v0.1-autoawq-int4-gs64-asym
Text Generation • Updated • 13 -
fbaldassarri/iGeniusAI_Italia-9B-Instruct-v0.1-autoawq-int4-gs64-sym
Text Generation • Updated • 9 -
fbaldassarri/openlm-research_open_llama_3b_v2-autoawq-int4-gs64-asym
Text Generation • Updated • 9 -
fbaldassarri/openlm-research_open_llama_3b_v2-autoawq-int4-gs64-sym
Text Generation • Updated • 10 -
fbaldassarri/openlm-research_open_llama_7b_v2-autoawq-int4-gs64-asym
Text Generation • Updated • 16 -
fbaldassarri/openlm-research_open_llama_7b_v2-autoawq-int4-gs64-sym
Text Generation • Updated • 13 -
fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autoawq-int4-gs64-asym
Text Generation • Updated • 8 -
fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autoawq-int4-gs64-sym
Text Generation • Updated • 8 -
fbaldassarri/ibm-granite_granite-3.3-2b-base-autoawq-int4-gs64-asym
Text Generation • Updated • 8 -
fbaldassarri/ibm-granite_granite-3.3-2b-base-autoawq-int4-gs64-sym
Text Generation • Updated • 12 -
fbaldassarri/internlm_internlm3-8b-instruct-autoawq-int4-gs64-asym
Text Generation • Updated • 5 -
fbaldassarri/internlm_internlm3-8b-instruct-autoawq-int4-gs64-sym
Text Generation • Updated • 3