Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Misc with no match

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

19

Full-text search

Active filters: fbgemm_fp8

nm-testing/llama-3-8b-instruct-fbgemm-test-model

Text Generation • Updated Jul 18, 2024 • 40

nm-testing/Meta-Llama-3-8B-Instruct-FBGEMM-nonuniform

Text Generation • Updated Jul 20, 2024 • 59

meta-llama/Llama-3.1-405B-Instruct-FP8

Text Generation • Updated Sep 25, 2024 • 2.2k • 188

meta-llama/Llama-3.1-405B-FP8

Text Generation • Updated Dec 6, 2024 • 1.73k • • 117

nm-testing/Meta-Llama-3-70B-Instruct-FBGEMM-nonuniform

Text Generation • Updated Jul 20, 2024 • 96 • 1

PrimeIntellect/Meta-Llama-3.1-405B-Instruct-FP8

Text Generation • Updated Aug 16, 2024 • 17

NousResearch/Meta-Llama-3.1-405B-FP8

Text Generation • Updated Jul 25, 2024 • 14 • 3

Bllossom/llama-3.1-Korean-Bllossom-405B

Text Generation • Updated Dec 13, 2024 • 40 • 55

PygmalionAI/Eleusis-12B-FBGEMM-FP8

Text Generation • Updated Jan 29 • 7

mikeriess/Llama-3.3-70B-Instruct-FP8

Text Generation • Updated Mar 11 • 28

mikeriess/Gemma-2-27B-IT-FP8

Text Generation • Updated Mar 11 • 18

mikeriess/Llama-3.1-Nemotron-70B-Reward-HF-FP8

Text Generation • Updated Mar 12 • 14

InfiniAILab/QwQ-32B-FP8

Updated Mar 16 • 7

hugging-quants/Llama-4-Scout-17B-16E-Instruct-fbgemm-unfused

Image-Text-to-Text • Updated Apr 9 • 43 • 1

hugging-quants/Llama-4-Scout-17B-16E-Instruct-fbgemm

Image-Text-to-Text • Updated Apr 9 • 135 • 2

chutesai/Llama-3.1-405B-FP8

Text Generation • Updated Apr 20 • 1.61k

haoqiwang/MNLP_M2_quantized_model

Text Generation • Updated 14 days ago • 69

haoqiwang/mnlp_m2_mcqa_model_cot00_e3_smooth_fbgemm_down2_26_27

Text Generation • Updated 1 day ago • 16

haoqiwang/MNLP_M3_quantized_model

Text Generation • Updated about 7 hours ago