-
-
-
-
-
-
Inference Providers
Active filters:
nm-vllm
RedHatAI/TinyLlama-1.1B-Chat-v1.0-pruned2.4
Text Generation
•
Updated
•
16
•
1
RedHatAI/MiniChat-2-3B-pruned2.4
Text Generation
•
Updated
•
15
RedHatAI/OpenHermes-2.5-Mistral-7B-pruned2.4
Text Generation
•
Updated
•
14
RedHatAI/OpenHermes-2.5-Mistral-7B-pruned50
Text Generation
•
Updated
•
16
•
1
RedHatAI/Nous-Hermes-2-SOLAR-10.7B-pruned2.4
Text Generation
•
Updated
•
12
RedHatAI/Nous-Hermes-2-Yi-34B-pruned2.4
Text Generation
•
Updated
•
8
RedHatAI/Nous-Hermes-2-Yi-34B-pruned50
Text Generation
•
Updated
•
9
RedHatAI/zephyr-7b-beta-marlin
Text Generation
•
1B
•
Updated
•
105
RedHatAI/llama2.c-stories110M-pruned2.4
Text Generation
•
Updated
•
9
RedHatAI/llama2.c-stories110M-pruned50
Text Generation
•
Updated
•
1.42k
RedHatAI/phi-2-pruned50
Text Generation
•
3B
•
Updated
•
13
RedHatAI/TinyLlama-1.1B-Chat-v1.0-marlin
Text Generation
•
0.3B
•
Updated
•
1.48k
•
2
RedHatAI/OpenHermes-2.5-Mistral-7B-marlin
Text Generation
•
1B
•
Updated
•
32
•
2
RedHatAI/Nous-Hermes-2-Yi-34B-marlin
Text Generation
•
5B
•
Updated
•
16
•
5
softmax/Llama-2-70b-chat-hf-marlin
Text Generation
•
10B
•
Updated
•
3
softmax/falcon-180B-chat-marlin
Text Generation
•
26B
•
Updated
•
6
dtransposed/llama2.c-stories110M-pruned50-compressed-tensors
Text Generation
•
0.1B
•
Updated
•
1
nm-testing/llama2.c-stories110M-pruned50-compressed-tensors
Text Generation
•
0.1B
•
Updated
•
2
mradermacher/Nous-Hermes-2-SOLAR-10.7B-pruned2.4-GGUF
11B
•
Updated
•
299
mradermacher/Nous-Hermes-2-SOLAR-10.7B-pruned2.4-i1-GGUF
11B
•
Updated
•
463
tensorblock/llama2.c-stories110M-pruned50-GGUF
0.1B
•
Updated
•
295
mradermacher/phi-2-pruned50-GGUF
mradermacher/llama2.c-stories110M-pruned50-GGUF
0.1B
•
Updated
•
138
mradermacher/OpenHermes-2.5-Mistral-7B-pruned50-GGUF
7B
•
Updated
•
60
•
1
mradermacher/MiniChat-2-3B-pruned2.4-GGUF
3B
•
Updated
•
104
mradermacher/OpenHermes-2.5-Mistral-7B-pruned50-i1-GGUF
7B
•
Updated
•
192
mradermacher/llama2.c-stories110M-pruned50-i1-GGUF
0.1B
•
Updated
•
131
mradermacher/OpenHermes-2.5-Mistral-7B-pruned2.4-GGUF
mradermacher/OpenHermes-2.5-Mistral-7B-pruned2.4-i1-GGUF
7B
•
Updated
•
145
tensorblock/OpenHermes-2.5-Mistral-7B-pruned2.4-GGUF