-
-
-
-
-
-
Inference Providers
Active filters:
int8
RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic
Text Generation
•
8B
•
Updated
•
36.2k
•
8
vito95311/Qwen3-Omni-30B-A3B-Thinking-GGUF-INT8FP16
Text Generation
•
16B
•
Updated
•
1.04k
•
14
Svenni551/Qwen3-Embedding-0.6B-ONNX-INT8
Feature Extraction
•
Updated
•
51
•
1
Intel/distilbert-base-uncased-finetuned-sst-2-english-int8-static-inc
Text Classification
•
Updated
•
36
•
6
Intel/bert-base-uncased-mrpc-int8-qat-inc
Text Classification
•
Updated
•
7
•
1
Intel/albert-base-v2-sst2-int8-static-inc
Text Classification
•
Updated
•
23
Intel/bert-base-uncased-finetuned-swag-int8-static-inc
Multiple Choice
•
Updated
•
11
•
1
Intel/bert-base-uncased-mrpc-int8-static-inc
Text Classification
•
Updated
•
26
Intel/distilbert-base-uncased-finetuned-conll03-english-int8-static-inc
Token Classification
•
Updated
•
12
•
1
Intel/camembert-base-mrpc-int8-dynamic-inc
Text Classification
•
Updated
•
19
Intel/bert-base-uncased-mrpc-int8-dynamic-inc
Text Classification
•
Updated
•
17
Intel/roberta-base-mrpc-int8-static-inc
Text Classification
•
Updated
•
12
Intel/bart-large-mrpc-int8-dynamic-inc
Text Classification
•
Updated
•
14
Intel/xlnet-base-cased-mrpc-int8-static-inc
Text Classification
•
Updated
•
16
Intel/electra-small-discriminator-mrpc-int8-static-inc
Text Classification
•
Updated
•
10
echarlaix/distilbert-sst2-inc-dynamic-quantization-magnitude-pruning-0.1
Text Classification
•
Updated
•
8
Intel/MiniLM-L12-H384-uncased-mrpc-int8-static-inc
Text Classification
•
Updated
•
13
Intel/MiniLM-L12-H384-uncased-mrpc-int8-qat-inc
Text Classification
•
Updated
•
7
Intel/distilbert-base-cased-distilled-squad-int8-static-inc
Question Answering
•
Updated
•
9
Intel/bert-base-uncased-squad-int8-static-inc
Question Answering
•
Updated
•
11
•
1
echarlaix/t5-small-int8-dynamic
Translation
•
Updated
•
22
•
4
echarlaix/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic
Text Classification
•
Updated
•
1.01k
•
1
Intel/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic-inc
Text Classification
•
Updated
•
13
•
1
Intel/distilbert-base-uncased-distilled-squad-int8-static-inc
Question Answering
•
Updated
•
1.03k
•
5
Intel/roberta-base-squad2-int8-static-inc
Updated
•
4
•
1
Intel/roberta-large-mnli-int8-static-inc
Text Classification
•
Updated
•
14
Intel/vit-base-patch16-224-int8-static-inc
Image Classification
•
Updated
•
18
•
1
Intel/t5-small-xsum-int8-dynamic-inc
Updated
•
1.03k
•
1
Intel/t5-small-finetuned-cnn-news-int8-dynamic-inc
AlexKoff88/bert_nm_mnli_sparse_quantized_90
Text Classification
•
Updated
•
13