1 billion parameter models, quantized with AWQ.

SolidRusT Networks
company
Verified
AI & ML interests
Self-hosting, Open Source and AI Unalignment
Organization Card
Organization for sorting and categorizing collections of quantized models, featured on solidrust.net.
Currently focused on models that can be quantized by AWQ from: https://github.com/casper-hansen/AutoAWQ using https://github.com/SolidRusT/srt-model-quantizing/tree/main/awq
Collections
8
These models are selected for their compatibility with small 12GB memory GPUs.
-
solidrust/Starling-LM-7B-beta-AWQ
Text Generation • Updated • 123 • 3 -
solidrust/dolphin-2.8-mistral-7b-v02-AWQ
Text Generation • Updated • 289 • 2 -
solidrust/Hermes-2-Pro-Mistral-7B-AWQ
Text Generation • Updated • 84 • 2 -
solidrust/dolphin-2.8-experiment26-7b-AWQ
Text Generation • Updated • 89 • 1
models
509

solidrust/Llama-3-8B-Stroganoff-4.0-AWQ
Text Generation
•
Updated
•
64

solidrust/Llama-3.1-8B-TitanFusion-Mix-AWQ
Text Generation
•
Updated
•
91

solidrust/Llama-3.1-8B-TitanFusion-v3-AWQ
Text Generation
•
Updated
•
64

solidrust/Fatgirl_v2_8B-AWQ
Text Generation
•
Updated
•
70

solidrust/L3-Super-Nova-RP-8B-AWQ
Text Generation
•
Updated
•
67

solidrust/L3-Umbral-Mind-RP-v0.3-8B-AWQ
Text Generation
•
Updated
•
66

solidrust/Chili_Dog_8B-AWQ
Text Generation
•
Updated
•
62

solidrust/L3-Luna-8B-AWQ
Text Generation
•
Updated
•
64

solidrust/Magic_v2_8B-AWQ
Text Generation
•
Updated
•
65

solidrust/Llama-3SOME-8B-v2-AWQ
Text Generation
•
Updated
•
66
datasets
None public yet