Edit Models filters

Apps

Docker Model Runner

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

19

Full-text search

Active filters: fbgemm_fp8

meta-llama/Llama-3.1-405B-FP8

Text Generation • 406B • Updated Dec 6, 2024 • 2.49k • • 118

nm-testing/llama-3-8b-instruct-fbgemm-test-model

Text Generation • 8B • Updated Jul 18, 2024 • 2

nm-testing/Meta-Llama-3-8B-Instruct-FBGEMM-nonuniform

Text Generation • 8B • Updated Jul 20, 2024 • 211

meta-llama/Llama-3.1-405B-Instruct-FP8

Text Generation • 406B • Updated Sep 25, 2024 • 3.45k • 188

nm-testing/Meta-Llama-3-70B-Instruct-FBGEMM-nonuniform

Text Generation • 71B • Updated Jul 20, 2024 • 59 • 1

PrimeIntellect/Meta-Llama-3.1-405B-Instruct-FP8

Text Generation • Updated Aug 16, 2024 • 5

NousResearch/Meta-Llama-3.1-405B-FP8

Text Generation • 410B • Updated Jul 25, 2024 • 3 • 3

Bllossom/llama-3.1-Korean-Bllossom-405B

Text Generation • 410B • Updated Dec 13, 2024 • 7 • 55

PygmalionAI/Eleusis-12B-FBGEMM-FP8

Text Generation • 12B • Updated Jan 29 • 4

mikeriess/Llama-3.3-70B-Instruct-FP8

Text Generation • 71B • Updated Mar 11 • 4

mikeriess/Gemma-2-27B-IT-FP8

Text Generation • 27B • Updated Mar 11 • 4

mikeriess/Llama-3.1-Nemotron-70B-Reward-HF-FP8

Text Generation • 71B • Updated Mar 12 • 2

InfiniAILab/QwQ-32B-FP8

33B • Updated Mar 16 • 2

hugging-quants/Llama-4-Scout-17B-16E-Instruct-fbgemm-unfused

Image-Text-to-Text • 109B • Updated Apr 9 • 13 • 2

hugging-quants/Llama-4-Scout-17B-16E-Instruct-fbgemm

Image-Text-to-Text • 109B • Updated Apr 9 • 80 • 2

chutesai/Llama-3.1-405B-FP8

Text Generation • 406B • Updated Apr 20 • 620

haoqiwang/MNLP_M2_quantized_model

Text Generation • 0.6B • Updated May 25 • 4

haoqiwang/mnlp_m2_mcqa_model_cot00_e3_smooth_fbgemm_down2_26_27

Text Generation • 0.6B • Updated Jun 7 • 1

haoqiwang/MNLP_M3_quantized_model

Text Generation • 0.6B • Updated Jun 8