-
-
-
-
-
-
Inference Providers
Active filters:
4bit
ModelCloud/Mistral-Nemo-Instruct-2407-gptq-4bit
Text Generation
•
3B
•
Updated
•
66
•
5
TheCluster/gemma-3-27b-it-uncensored-mlx-4bit
Image-Text-to-Text
•
Updated
•
1.49k
•
4
Chun121/Qwen3-4B-RPG-Roleplay-V2
Text Generation
•
4B
•
Updated
•
3.06k
•
4
tahamajs/Qwen3-4b-gsm8k-Qlora-SFT
Text Generation
•
Updated
•
16
•
1
tahamajs/Qwen3-4b-gsm8k-Qlora-GRPO
Text Generation
•
Updated
•
26
•
1
sweatSmile/Gemma-3-270m-Buddha-QA
Question Answering
•
Updated
•
32
•
1
sweatSmile/Qwen3-0.6B-4bit-NEET
Question Answering
•
0.6B
•
Updated
•
1
mayaeary/pygmalion-6b-4bit-128g
Text Generation
•
Updated
•
36
•
40
mayaeary/pygmalion-6b_dev-4bit-128g
Text Generation
•
Updated
•
22
•
120
mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g
Text Generation
•
Updated
•
16
•
2
mayaeary/PPO_Pygway-6b-Mix-4bit-128g
Text Generation
•
Updated
•
14
•
2
Ancestral/Dolly_Shygmalion-6b-4bit-128g
Text Generation
•
Updated
•
15
•
5
Ancestral/PPO_Shygmalion-6b-4bit-128g
Text Generation
•
Updated
•
16
Ancestral/Dolly_Malion-6b-4bit-128g
Text Generation
•
Updated
•
16
4bit/pygmalion-6b-4bit-128g
Text Generation
•
Updated
•
15
•
3
mlabonne/gpt2-GPTQ-4bit
Text Generation
•
Updated
•
33
•
1
seonglae/opt-125m-4bit-gptq
Text Generation
•
Updated
•
13
seonglae/wizardlm-7b-uncensored-gptq
Text Generation
•
Updated
•
18
seonglae/llama-2-7b-chat-hf-gptq
Text Generation
•
Updated
•
16
seonglae/llama-2-13b-chat-hf-gptq
Text Generation
•
Updated
•
13
CalderaAI/13B-Ouroboros-GPTQ4bit-128g-CUDA
Text Generation
•
Updated
•
17
SebastianSchramm/UniNER-7B-all-GPTQ-4bit-128g-actorder_True
Text Generation
•
1B
•
Updated
•
8
•
8
SebastianSchramm/UniNER-7B-type-GPTQ-4bit-128g-actorder_True
Text Generation
•
1B
•
Updated
•
8
•
1
SebastianSchramm/UniNER-7B-definition-GPTQ-4bit-128g-actorder_True
Text Generation
•
1B
•
Updated
•
7
•
1
SebastianSchramm/UniNER-7B-type-sup-GPTQ-4bit-128g-actorder_True
Text Generation
•
1B
•
Updated
•
20
Sanrove/gpt2-GPTQ-4b
Text Generation
•
Updated
•
6
kingabzpro/zephyr-7b-beta-Agent-Instruct
Text Generation
•
Updated
•
1
SebastianSchramm/LlamaGuard-7b-GPTQ-4bit-128g-actorder_True
Text Generation
•
1B
•
Updated
•
6
•
2
A2H0H0R1/Qwen-7B-Chat-Int4-Qlora-biology
Text Generation
•
Updated
•
1
kingabzpro/phi-2-role-play
Text Generation
•
Updated
•
6