1 billion parameter models, quantized with AWQ.
SolidRusT Networks
company
Verified
AI & ML interests
Self-hosting, Open Source and AI Unalignment
Organization Card
Organization for sorting and categorizing collections of quantized models, featured on solidrust.net.
Currently focused on models that can be quantized by AWQ from: https://github.com/casper-hansen/AutoAWQ using https://github.com/SolidRusT/srt-model-quantizing/tree/main/awq
Collections
8
These models are selected for their compatibility with small 12GB memory GPUs.
-
solidrust/Starling-LM-7B-beta-AWQ
Text Generation • Updated • 16 • 3 -
solidrust/dolphin-2.8-mistral-7b-v02-AWQ
Text Generation • Updated • 182 • 2 -
solidrust/Hermes-2-Pro-Mistral-7B-AWQ
Text Generation • Updated • 46 • 2 -
solidrust/dolphin-2.8-experiment26-7b-AWQ
Text Generation • Updated • 102 • 1
models
509
solidrust/Llama-3-8B-Stroganoff-4.0-AWQ
Text Generation
•
Updated
•
8
solidrust/Llama-3.1-8B-TitanFusion-Mix-AWQ
Text Generation
•
Updated
•
8
solidrust/Llama-3.1-8B-TitanFusion-v3-AWQ
Text Generation
•
Updated
•
8
solidrust/Fatgirl_v2_8B-AWQ
Text Generation
•
Updated
•
7
solidrust/L3-Super-Nova-RP-8B-AWQ
Text Generation
•
Updated
•
7
solidrust/L3-Umbral-Mind-RP-v0.3-8B-AWQ
Text Generation
•
Updated
•
8
solidrust/Chili_Dog_8B-AWQ
Text Generation
•
Updated
•
7
solidrust/L3-Luna-8B-AWQ
Text Generation
•
Updated
•
10
solidrust/Magic_v2_8B-AWQ
Text Generation
•
Updated
•
8
solidrust/Llama-3SOME-8B-v2-AWQ
Text Generation
•
Updated
•
7
datasets
None public yet