daslab-testing/Llama-3.1-8B-Instruct-mxfp-w4-a4-MicroQAT-hadamard-transform
5B
•
Updated
•
39
FP-Quant-dev
Experimental versions of FP-Quant models
-
-
daslab-testing/Llama-3.1-8B-Instruct-nvfp-w4-a4-MicroQAT-hadamard-transform
5B • Updated • 27 -
daslab-testing/Llama-3.2-3B-Instruct-nvfp-w4-a4-MicroQAT-hadamard-transform
2B • Updated • 26 -
daslab-testing/Llama-3.2-3B-Instruct-mxfp-w4-a4-MicroQAT-hadamard-transform
2B • Updated • 31 -
daslab-testing/Llama-3.1-8B-Instruct-mxfp-w4-a4-GPTQ-hadamard-transform-gs128
5B • Updated • 97 -
daslab-testing/Llama-3.1-8B-Instruct-nvfp-w4-a4-GPTQ-hadamard-transform-gs128
5B • Updated • 109 -
daslab-testing/Llama-3.2-3B-Instruct-FPQuant-GPTQ-NVFP4-hadamard-gs128
2B • Updated • 29 -
daslab-testing/Llama-3.2-3B-Instruct-FPQuant-GPTQ-MXFP4-hadamard-gs128
2B • Updated • 26 -
daslab-testing/Llama-3.1-8B-Instruct-nvfp-w4-a4-RTN-hadamard-transform-gs128
5B • Updated • 30 -
daslab-testing/Llama-3.1-8B-Instruct-mxfp-w4-a4-RTN-hadamard-transform-gs128
5B • Updated • 34 -
daslab-testing/Llama-3.2-3B-Instruct-FPQuant-RTN-MXFP4-hadamard-gs128
2B • Updated • 31 -
daslab-testing/Llama-3.2-3B-Instruct-FPQuant-RTN-NVFP4-hadamard-gs128
2B • Updated • 34 -
daslab-testing/Qwen3-8B-FPQuant-RTN-NVFP4-hadamard-gs128
5B • Updated • 40 -
daslab-testing/Qwen3-8B-FPQuant-RTN-MXFP4-hadamard-gs128
5B • Updated • 34 -
daslab-testing/Qwen3-14B-FPQuant-GPTQ-MXFP4-hadamard-gs128
9B • Updated • 37 -
daslab-testing/Qwen3-14B-FPQuant-GPTQ-NVFP4-hadamard-gs128
9B • Updated • 38 -
daslab-testing/Qwen3-14B-FPQuant-RTN-MXFP4-hadamard-gs128
9B • Updated • 36 -
daslab-testing/Qwen3-14B-FPQuant-RTN-NVFP4-hadamard-gs128
9B • Updated • 38 -
daslab-testing/Qwen3-32B-FPQuant-GPTQ-NVFP4-hadamard-gs128
19B • Updated • 38 -
daslab-testing/Qwen3-32B-FPQuant-GPTQ-MXFP4-hadamard-gs128
18B • Updated • 35 -
daslab-testing/Qwen3-32B-FPQuant-RTN-NVFP4-hadamard-gs128
19B • Updated • 35 -
daslab-testing/Qwen3-32B-FPQuant-RTN-MXFP4-hadamard-gs128
18B • Updated • 38 -
daslab-testing/Llama-3.2-1B-Instruct-FPQuant-GPTQ-NVFP4-hadamard-gs128
0.8B • Updated • 27 -
daslab-testing/Llama-3.2-1B-Instruct-FPQuant-RTN-NVFP4-hadamard-gs128
0.8B • Updated • 22 -
daslab-testing/Llama-3.2-1B-Instruct-FPQuant-RTN-MXFP4-hadamard-gs128
0.8B • Updated • 26 -
daslab-testing/Llama-3.2-1B-Instruct-FPQuant-GPTQ-MXFP4-hadamard-gs128
0.8B • Updated • 22 -
daslab-testing/Qwen3-8B-FPQuant-GPTQ-MXFP4-hadamard-gs128
5B • Updated • 35 -
daslab-testing/Qwen3-8B-FPQuant-GPTQ-NVFP4-hadamard-gs128
5B • Updated • 37 -
daslab-testing/Llama-3.3-70B-Instruct-FPQuant-RTN-NVFP4-hadamard-gs128
41B • Updated • 32 -
daslab-testing/Llama-3.3-70B-Instruct-FPQuant-GPTQ-NVFP4-hadamard-gs128
41B • Updated • 44 -
daslab-testing/Llama-3.3-70B-Instruct-FPQuant-GPTQ-MXFP4-hadamard-gs128
39B • Updated • 63 -
daslab-testing/Llama-3.3-70B-Instruct-FPQuant-RTN-MXFP4-hadamard-gs128
39B • Updated • 45