Models

fxmarty/llama-tiny-testing-quark-indev

0.0B • Updated Oct 3, 2024 • 2

fxmarty/llama-tiny-int4-per-group-sym

0.0B • Updated Oct 25, 2024 • 3

fxmarty/llama-tiny-w-fp8-a-fp8

0.0B • Updated Oct 22, 2024 • 5

fxmarty/llama-tiny-w-fp8-a-fp8-o-fp8

0.0B • Updated Oct 22, 2024 • 5

fxmarty/llama-tiny-w-int8-per-tensor

0.0B • Updated Oct 22, 2024 • 3

fxmarty/llama-small-int4-per-group-sym-awq

0.0B • Updated Oct 29, 2024 • 5

fxmarty/quark-legacy-int8

0.0B • Updated Oct 10, 2024 • 4

fxmarty/llama-tiny-w-int8-b-int8-per-tensor

0.0B • Updated Oct 22, 2024 • 3

fxmarty/llama-small-int4-per-group-sym-awq-old

0.0B • Updated Oct 25, 2024 • 5

amd-quark/llama-tiny-w-int8-per-tensor

0.0B • Updated Dec 18, 2024 • 718

amd-quark/llama-tiny-w-int8-b-int8-per-tensor

0.0B • Updated Dec 18, 2024 • 723

amd-quark/llama-tiny-w-fp8-a-fp8

0.0B • Updated Dec 18, 2024 • 716

amd-quark/llama-tiny-w-fp8-a-fp8-o-fp8

0.0B • Updated Dec 18, 2024 • 723

amd-quark/llama-tiny-int4-per-group-sym

0.0B • Updated Dec 18, 2024 • 716

amd-quark/llama-small-int4-per-group-sym-awq

0.0B • Updated Dec 18, 2024 • 722

amd-quark/quark-legacy-int8

0.0B • Updated Dec 18, 2024 • 5

amd/Llama-3.1-8B-Instruct-FP8-KV-Quark-test

8B • Updated Jan 7 • 2.92k

amd/Llama-3.1-8B-Instruct-w-int8-a-int8-sym-test

8B • Updated Jan 7 • 1.94k

EmbeddedLLM/Llama-3.1-8B-Instruct-w_fp8_per_channel_sym

Text Generation • 8B • Updated Jan 22 • 5

amd/DeepSeek-R1-Distill-Llama-8B-awq-asym-uint4-g128-lmhead

Text Generation • 2B • Updated Jan 30 • 8

amd-quark/llama-tiny-fp8-quark-quant-method

0.0B • Updated Feb 7 • 1.87k

aigdat/Qwen2.5-Coder-7B-quantized-ppl-14

1B • Updated Mar 11 • 3

aigdat/Qwen2-7B-Instruct_quantized_int4_bfloat16

1B • Updated Mar 13 • 3

aigdat/Qwen2.5-1.5B-Instruct-awq-uint4-bfloat16

0.4B • Updated Mar 13 • 3

aigdat/Qwen2.5-0.5B-Instruct-awq-int4-asym-g128-fp16

0.2B • Updated Apr 2 • 3

superbigtree/Mistral-Nemo-Instruct-2407-FP8

12B • Updated Apr 9 • 3

aigdat/BioMistral-7B_quantized_int4_float16

1B • Updated Apr 10 • 5

aigdat/omost-phi-3-mini-128k_quantized_int4_float16

0.6B • Updated Apr 10 • 5

superbigtree/Mistral-Nemo-Instruct-2407-FP8_aq

12B • Updated Apr 22 • 4

aigdat/Llama-3.2-1B-Instruct-awq-uint4-float16

0.4B • Updated Apr 29 • 5