SolidRusT Networks

company

Verified

https://solidrust.net

solidrust

AI & ML interests

Self-hosting, Open Source and AI Unalignment

Suparious

in solidrust/dolphin-2.8-mistral-7b-v02-AWQ 3 months ago

Performed my own Quantization, now encounter an error while running inference with vllm.

#1 opened 3 months ago by

ryan-rozanitis-bd

Suparious

updated 19 models 12 months ago

solidrust/Llama-3-8B-Stroganoff-4.0-AWQ

Text Generation • 2B • Updated Sep 27, 2024 • 5

solidrust/Llama-3.1-8B-TitanFusion-Mix-AWQ

Text Generation • 2B • Updated Sep 23, 2024 • 6

solidrust/Llama-3.1-8B-TitanFusion-v3-AWQ

Text Generation • 2B • Updated Sep 23, 2024 • 6

solidrust/Fatgirl_v2_8B-AWQ

Text Generation • 2B • Updated Sep 23, 2024 • 5

solidrust/L3-Super-Nova-RP-8B-AWQ

Text Generation • 2B • Updated Sep 23, 2024 • 5

solidrust/L3-Umbral-Mind-RP-v0.3-8B-AWQ

Text Generation • 2B • Updated Sep 23, 2024 • 7

solidrust/Chili_Dog_8B-AWQ

Text Generation • 2B • Updated Sep 23, 2024 • 4

solidrust/L3-Luna-8B-AWQ

Text Generation • 2B • Updated Sep 23, 2024 • 5

solidrust/Magic_v2_8B-AWQ

Text Generation • 2B • Updated Sep 23, 2024 • 6

solidrust/Llama-3SOME-8B-v2-AWQ

Text Generation • 2B • Updated Sep 20, 2024 • 5

solidrust/gemma-2-9b-it-abliterated-AWQ

Text Generation • 3B • Updated Sep 20, 2024 • 11

solidrust/Gemma-2-Ataraxy-9B-AWQ

Text Generation • 3B • Updated Sep 20, 2024 • 5 • 1

solidrust/gemma-2-9b-it-SimPO-AWQ

Text Generation • 3B • Updated Sep 20, 2024 • 14 • 1

solidrust/Smoke_7B-AWQ

Text Generation • 2B • Updated Sep 20, 2024 • 5

solidrust/Magic_8B-AWQ

Text Generation • 2B • Updated Sep 19, 2024 • 4

solidrust/ChimeraLlama-3-8B-v3-AWQ

Text Generation • 2B • Updated Sep 19, 2024 • 5

solidrust/Llama-3.1-8B-TitanFusion-AWQ

Text Generation • 2B • Updated Sep 19, 2024 • 5

solidrust/LLama-3.1-8B-Matrix-AWQ

Text Generation • 2B • Updated Sep 19, 2024 • 5 • 1

solidrust/Gemma2-9B-TitanFusion-AWQ

Text Generation • 3B • Updated Sep 19, 2024 • 3