-
-
-
-
-
-
Inference Providers
Active filters:
auto-awq
kaitchup/Meta-Llama-3.1-8B-Instruct-awq-4bit
Text Generation
•
2B
•
Updated
•
2
•
1
fbaldassarri/meta-llama_Llama-3.1-8B-Instruct-auto_awq-int4-gs128-asym
Text Generation
•
2B
•
Updated
•
16
fbaldassarri/meta-llama_Llama-3.1-8B-auto_awq-int4-gs128-asym
Text Generation
•
2B
•
Updated
•
12
fbaldassarri/meta-llama_Llama-3.1-8B-auto_awq-int4-gs128-sym
Text Generation
•
2B
•
Updated
•
9
fbaldassarri/meta-llama_Llama-3.1-8B-Instruct-auto_awq-int4-gs128-sym
Text Generation
•
2B
•
Updated
•
24
•
2
fbaldassarri/HuggingFaceTB_SmolLM2-1.7B-Instruct-auto_awq-int4-gs128-asym
Text Generation
•
0.3B
•
Updated
•
7
fbaldassarri/HuggingFaceTB_SmolLM2-1.7B-Instruct-auto_awq-int4-gs128-sym
Text Generation
•
0.3B
•
Updated
•
3
fbaldassarri/EleutherAI_pythia-12b-autoawq-int4-gs128-asym
Text Generation
•
2B
•
Updated
•
5
fbaldassarri/EleutherAI_pythia-12b-autoawq-int4-gs128-sym
Text Generation
•
2B
•
Updated
•
4
fbaldassarri/allenai_OLMo-2-1124-7B-autoawq-int4-gs128-asym
Text Generation
•
2B
•
Updated
•
5
fbaldassarri/allenai_OLMo-2-1124-7B-autoawq-int4-gs128-sym
Text Generation
•
2B
•
Updated
•
5
fbaldassarri/EleutherAI_pythia-6.9b-autoawq-int4-gs128-asym
Text Generation
•
1B
•
Updated
•
5
fbaldassarri/EleutherAI_pythia-6.9b-autoawq-int4-gs128-sym
Text Generation
•
1B
•
Updated
•
5
fbaldassarri/HuggingFaceTB_SmolLM2-1.7B-auto_awq-int4-gs128-asym
Text Generation
•
0.3B
•
Updated
•
4
fbaldassarri/HuggingFaceTB_SmolLM2-1.7B-auto_awq-int4-gs128-sym
Text Generation
•
0.3B
•
Updated
•
3
fbaldassarri/allenai_OLMo-2-1124-7B-Instruct-autoawq-int4-gs128-asym
Text Generation
•
2B
•
Updated
•
4
fbaldassarri/allenai_OLMo-2-1124-7B-Instruct-autoawq-int4-gs128-sym
Text Generation
•
2B
•
Updated
•
4
fbaldassarri/sapienzanlp_Minerva-7B-instruct-v1.0-autoawq-int4-gs128-asym
Text Generation
•
1B
•
Updated
•
6
fbaldassarri/sapienzanlp_Minerva-7B-instruct-v1.0-autoawq-int4-gs128-sym
Text Generation
•
1B
•
Updated
•
5
fbaldassarri/sapienzanlp_Minerva-7B-base-v1.0-autoawq-int4-gs128-asym
Text Generation
•
1B
•
Updated
•
4
fbaldassarri/sapienzanlp_Minerva-7B-base-v1.0-autoawq-int4-gs128-sym
Text Generation
•
1B
•
Updated
•
4
fbaldassarri/sapienzanlp_Minerva-1B-base-v1.0-autoawq-int4-gs128-asym
Text Generation
•
0.3B
•
Updated
•
5
fbaldassarri/sapienzanlp_Minerva-1B-base-v1.0-autoawq-int4-gs128-sym
Text Generation
•
0.3B
•
Updated
•
5
fbaldassarri/sapienzanlp_Minerva-3B-base-v1.0-autoawq-int4-gs128-asym
Text Generation
•
0.5B
•
Updated
•
5
fbaldassarri/sapienzanlp_Minerva-3B-base-v1.0-autoawq-int4-gs128-sym
Text Generation
•
0.5B
•
Updated
•
5
fbaldassarri/HuggingFaceTB_SmolLM2-360M-Instruct-auto_awq-int4-gs64-asym
Text Generation
•
0.1B
•
Updated
•
7
fbaldassarri/HuggingFaceTB_SmolLM2-360M-auto_awq-int4-gs64-asym
Text Generation
•
0.1B
•
Updated
•
5
fbaldassarri/HuggingFaceTB_SmolLM2-360M-auto_awq-int4-gs64-sym
Text Generation
•
0.1B
•
Updated
•
8
fbaldassarri/HuggingFaceTB_SmolLM2-135M-auto_awq-int4-gs64-asym
Text Generation
•
0.0B
•
Updated
•
5
fbaldassarri/HuggingFaceTB_SmolLM2-135M-auto_awq-int4-gs64-sym
Text Generation
•
0.0B
•
Updated
•
5