Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

text-embeddings-inference

4-bit precision

Misc with no match

Carbon Emissions

Mixture of Experts

Models

258

Full-text search

Active filters: int8

Intel/MiniLM-L12-H384-uncased-mrpc-int8-static-inc

Text Classification • Updated Mar 21, 2024 • 17

Intel/MiniLM-L12-H384-uncased-mrpc-int8-qat-inc

Text Classification • Updated Oct 6, 2023 • 9

Intel/distilbert-base-cased-distilled-squad-int8-static-inc

Question Answering • Updated Mar 21, 2024 • 13

Intel/bert-base-uncased-squad-int8-static-inc

Question Answering • Updated Oct 6, 2023 • 9 • 1

echarlaix/t5-small-int8-dynamic

Translation • Updated Oct 26, 2023 • 10 • • 4

echarlaix/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic

Text Classification • Updated Jun 13, 2023 • 1.99k • 1

Intel/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic-inc

Text Classification • Updated Mar 21, 2024 • 48 • 1

Intel/distilbert-base-uncased-distilled-squad-int8-static-inc

Question Answering • Updated Mar 29, 2024 • 1.99k • 4

Intel/roberta-base-squad2-int8-static-inc

Updated Mar 21, 2024 • 21 • 1

Intel/roberta-large-mnli-int8-static-inc

Text Classification • Updated Oct 6, 2023 • 8

Intel/vit-base-patch16-224-int8-static-inc

Image Classification • Updated Sep 6, 2022 • 48 • 1

Intel/t5-small-xsum-int8-dynamic-inc

Text2Text Generation • Updated Mar 21, 2024 • 1.97k • 1

Intel/t5-small-finetuned-cnn-news-int8-dynamic-inc

Text2Text Generation • Updated Oct 6, 2023 • 11

AlexKoff88/bert_nm_mnli_sparse_quantized_90

Text Classification • Updated Nov 25, 2022 • 11

echarlaix/vit-food101-int8

Image Classification • Updated Nov 22, 2022 • 17

Intel/t5-large-finetuned-xsum-cnn-int8-dynamic-inc

Text2Text Generation • Updated Mar 21, 2024 • 6

Intel/t5-base-cnn-dm-int8-dynamic-inc

Text2Text Generation • Updated Mar 21, 2024 • 16

Intel/bart-large-cnn-int8-dynamic-inc

Text2Text Generation • Updated Mar 22, 2024 • 7 • 1

Intel/distilbart-cnn-12-6-int8-dynamic-inc

Text2Text Generation • Updated Mar 22, 2024 • 66 • 2

Intel/roberta-base-mrpc-int8-dynamic-inc

Text Classification • Updated Dec 28, 2022 • 5

Intel/xlm-roberta-base-mrpc-int8-dynamic-inc

Text Classification • Updated Jun 27, 2023 • 4

Intel/albert-base-v2-sst2-int8-dynamic-inc

Text Classification • Updated Jun 27, 2023 • 14

Intel/MiniLM-L12-H384-uncased-mrpc-int8-dynamic-inc

Text Classification • Updated Dec 28, 2022 • 5

Intel/gpt-j-6B-int8-dynamic-inc

Text Generation • Updated Apr 19, 2023 • 12 • 16

Intel/gpt-j-6B-int8-static-inc

Text Generation • Updated Apr 19, 2023 • 8 • 9

DataAgent/llama-7b-alpaca-zh-20k

Updated Apr 8, 2023

ENOT-AutoDL/gpt-j-6B-tensorrt-int8

Text Generation • Updated Jun 8, 2023 • 7

Intel/gpt-j-6B-pytorch-int8-static-inc

Text Generation • Updated Jan 18, 2024 • 8

DataAgent/llama-7b-alpaca-zh-120k

Updated Apr 8, 2023 • 1

Intel/gpt-neox-japanese-2.7b-int8-inc

Text Generation • Updated Mar 21, 2024