Models

FriendliAI/Meta-Llama-3.1-70B-Instruct-int8

Text Generation • 71B • Updated Sep 9, 2024 • 7

ISTA-DASLab/Meta-Llama-3.1-70B-AQLM-PV-2Bit-1x16

Text Generation • 11B • Updated Sep 14, 2024 • 12 • 17

mav23/Llama-3.1-70B-Instruct-GGUF

Text Generation • 71B • Updated Oct 3, 2024 • 175

medmekk/Llama-3.1-70B-torchao-int8_weight_only

Updated Oct 8, 2024 • 3

mav23/OpenMath2-Llama3.1-70B-GGUF

71B • Updated Oct 27, 2024 • 416

mav23/Hermes-3-Llama-3.1-70B-GGUF

71B • Updated Nov 4, 2024 • 191

osllmai-community/Hermes-3-Llama-3.1-70B-bnb-4bit

Text Generation • 37B • Updated Jan 24 • 992

MikeRoz/meta-llama_Llama-3.3-70B-Instruct-4.25bpw-h6-exl2

Text Generation • Updated Dec 6, 2024 • 21 • 1

matatonic/Llama-3.3-70B-Instruct-6.5bpw-h8-exl2.2.3

Text Generation • Updated Dec 6, 2024 • 6

LoneStriker/Llama-3.3-70B-Instruct-2.4bpw-h6-exl2

Text Generation • Updated Dec 6, 2024 • 16 • 1

LoneStriker/Llama-3.3-70B-Instruct-3.5bpw-h6-exl2

Text Generation • Updated Dec 6, 2024 • 9 • 2

LoneStriker/Llama-3.3-70B-Instruct-4.0bpw-h6-exl2

Text Generation • Updated Dec 6, 2024 • 9 • 1

LoneStriker/Llama-3.3-70B-Instruct-4.65bpw-h6-exl2

Text Generation • Updated Dec 6, 2024 • 13 • 3

LoneStriker/Llama-3.3-70B-Instruct-5.0bpw-h6-exl2

Text Generation • Updated Dec 6, 2024 • 8 • 3

LoneStriker/Llama-3.3-70B-Instruct-6.0bpw-h6-exl2

Text Generation • Updated Dec 7, 2024 • 9 • 2

MikeRoz/meta-llama_Llama-3.3-70B-Instruct-8.0bpw-h8-exl2

Text Generation • Updated Dec 7, 2024 • 23 • 1

LoneStriker/Llama-3.3-70B-Instruct-2.25bpw-h6-exl2

Text Generation • Updated Dec 7, 2024 • 11 • 1

osllmai-community/Llama-3.3-70B-Instruct-GGUF

71B • Updated Jan 24 • 25

roleplaiapp/Llama-3.3-70B-Instruct-Q3_K_S-GGUF

Text Generation • 71B • Updated Jan 15 • 22

roleplaiapp/Llama-3.3-70B-Instruct-Q3_K_M-GGUF

Text Generation • 71B • Updated Jan 15 • 21

roleplaiapp/Llama-3.3-70B-Instruct-Q2_K-GGUF

Text Generation • 71B • Updated Jan 15 • 15

roleplaiapp/Llama-3.3-70B-Instruct-Q3_K_L-GGUF

Text Generation • 71B • Updated Jan 15 • 17

roleplaiapp/Llama-3.3-70B-Instruct-Q4_0-GGUF

Text Generation • 71B • Updated Jan 15 • 41 • 2

roleplaiapp/Llama-3.3-70B-Instruct-Q4_K_S-GGUF

Text Generation • 71B • Updated Jan 15 • 4

roleplaiapp/Llama-3.3-70B-Instruct-Q5_0-GGUF

Text Generation • 71B • Updated Jan 16 • 13

roleplaiapp/Llama-3.3-70B-Instruct-Q5_K_S-GGUF

Text Generation • 71B • Updated Jan 16 • 7

roleplaiapp/Llama-3.3-70B-Instruct-Q5_K_M-GGUF

Text Generation • 71B • Updated Jan 16 • 40

roleplaiapp/Llama-3.3-70B-Instruct-Q6_K-GGUF

Text Generation • 71B • Updated Jan 16 • 28

roleplaiapp/Llama-3.3-70B-Instruct-Q8_0-GGUF

Text Generation • 71B • Updated Jan 16 • 17

lurker18/Llama_3.3_70B_Instruct_AWQ_4bit

Text Generation • 11B • Updated Jan 19 • 3