Edit Models filters

Model Tree

meta-llama/Llama-3.3-70B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

75

Full-text search

Active filters: meta-llama/Llama-3.3-70B-Instruct

unsloth/Llama-3.3-70B-Instruct-bnb-4bit

Text Generation • Updated 11 days ago • 98.6k • 28

MaziyarPanahi/Llama-3.3-70B-Instruct-GGUF

Text Generation • Updated Dec 7, 2024 • 1.29M • 10

unsloth/Llama-3.3-70B-Instruct-GGUF

Updated 11 days ago • 27k • 52

mlx-community/Llama-3.3-70B-Instruct-4bit

Text Generation • Updated Dec 6, 2024 • 1.71M • 25

mlx-community/Llama-3.3-70B-Instruct-8bit

Text Generation • Updated Dec 6, 2024 • 8.47k • 10

bartowski/Llama-3.3-70B-Instruct-GGUF

Text Generation • Updated Dec 7, 2024 • 40.7k • 48

lmstudio-community/Llama-3.3-70B-Instruct-GGUF

Text Generation • Updated Dec 6, 2024 • 72.2k • 43

DevQuasar/meta-llama.Llama-3.3-70B-Instruct-GGUF

Text Generation • Updated Dec 8, 2024 • 430 • 3

ibnzterrell/Meta-Llama-3.3-70B-Instruct-AWQ-INT4

Text Generation • Updated Dec 7, 2024 • 19.3k • 14

cortecs/Llama-3.3-70B-Instruct-FP8-Dynamic

Updated Dec 13, 2024 • 18.1k • 7

mlx-community/Llama-3.3-70B-Instruct-3bit

Text Generation • Updated Dec 6, 2024 • 1.58k • 5

mlx-community/Llama-3.3-70B-Instruct-6bit

Text Generation • Updated Dec 6, 2024 • 202 • 5

kosbu/Llama-3.3-70B-Instruct-AWQ

Text Generation • Updated Dec 7, 2024 • 1.63k

etemiz/Llama-3.3-70B-Instruct-GGUF

Updated 29 days ago • 807

amd/Llama-3.3-70B-Instruct-FP8-KV

Updated Dec 13, 2024 • 1.47k

mradermacher/Llama-3.3-70B-Instruct-GGUF

Updated Dec 16, 2024 • 131 • 3

second-state/Llama-3.3-70B-Instruct-GGUF

Text Generation • Updated Dec 7, 2024 • 473

gaianet/Llama-3.3-70B-Instruct-GGUF

Text Generation • Updated Dec 7, 2024 • 318

mradermacher/Llama-3.3-70B-Instruct-i1-GGUF

Updated Dec 8, 2024 • 4.33k • 4

tensorblock/Llama-3.3-70B-Instruct-GGUF

Updated Dec 7, 2024 • 2.52k • 9

kishizaki-sci/Llama-3.3-70B-Instruct-AWQ-4bit-JP-EN

Text Generation • Updated 28 days ago • 137

Dracones/Llama-3.3-70B-Instruct_exl2_8.0bpw

Text Generation • Updated Dec 7, 2024 • 9

Dracones/Llama-3.3-70B-Instruct_exl2_7.0bpw

Text Generation • Updated Dec 7, 2024 • 8

Dracones/Llama-3.3-70B-Instruct_exl2_6.0bpw

Text Generation • Updated Dec 7, 2024 • 27

Dracones/Llama-3.3-70B-Instruct_exl2_5.0bpw

Text Generation • Updated Dec 7, 2024 • 24 • 1

Dracones/Llama-3.3-70B-Instruct_exl2_4.5bpw

Text Generation • Updated Dec 7, 2024 • 29 • 2

Dracones/Llama-3.3-70B-Instruct_exl2_4.0bpw

Text Generation • Updated Dec 7, 2024 • 22

Dracones/Llama-3.3-70B-Instruct_exl2_3.5bpw

Text Generation • Updated Dec 7, 2024 • 8

Jacoby746/Llama-3.3-70B-Instruct-exl2-5.0bpw

Text Generation • Updated Dec 7, 2024 • 7

Dracones/Llama-3.3-70B-Instruct_exl2_3.0bpw

Text Generation • Updated Dec 7, 2024 • 11