Models

lk11/Llama-3-8B-AWQ-4bit

Text Generation • 2B • Updated Jul 24, 2024 • 2

PrunaAI/LumiOpen-Viking-7B-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 20, 2024 • 5

PrunaAI/VAGOsolutions-SauerkrautLM-7b-LaserChat-AWQ-4bit-smashed

Text Generation • 1B • Updated Jul 21, 2024 • 2

PrunaAI/h2oai-h2o-danube-1.8b-base-AWQ-4bit-smashed

Text Generation • 0.4B • Updated Jul 21, 2024 • 2

PrunaAI/hfl-llama-3-chinese-8b-instruct-v3-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 21, 2024 • 3

PrunaAI/yam-peleg-Hebrew-Mistral-7B-AWQ-4bit-smashed

Text Generation • 1B • Updated Jul 21, 2024 • 2

PrunaAI/ibm-granite-granite-3b-code-base-AWQ-4bit-smashed

Text Generation • 0.7B • Updated Jul 21, 2024 • 3

PrunaAI/rinna-llama-3-youko-8b-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 21, 2024 • 2

PrunaAI/ibm-granite-granite-8b-code-instruct-AWQ-4bit-smashed

Text Generation • 1B • Updated Jul 21, 2024 • 2

Weni/ZeroShot-Agents-Mistral-4.0.71-SFT-300-AWQ

Text Generation • 3B • Updated Jul 21, 2024 • 1

PrunaAI/openchat-openchat-3.5-0106-AWQ-4bit-smashed

Text Generation • 1B • Updated Jul 21, 2024 • 1

PrunaAI/FreedomIntelligence-Apollo-7B-AWQ-4bit-smashed

Text Generation • 3B • Updated Jul 21, 2024 • 2

PrunaAI/BramVanroy-GEITje-7B-ultra-AWQ-4bit-smashed

Text Generation • 1B • Updated Jul 21, 2024 • 3

PrunaAI/tensoropera-Fox-1-1.6B-AWQ-4bit-smashed

Text Generation • 1B • Updated Jul 21, 2024 • 2

PrunaAI/aixsatoshi-Llama-3-youko-8b-instruct-chatvector-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 22, 2024 • 2

PrunaAI/hiieu-Meta-Llama-3-8B-Instruct-function-calling-json-mode-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 22, 2024 • 2

PrunaAI/Qwen-Qwen1.5-0.5B-Chat-AWQ-4bit-smashed

Text Generation • 0.4B • Updated Jul 22, 2024 • 4

PrunaAI/cognitivecomputations-dolphin-2.9.2-qwen2-7b-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 22, 2024 • 2

PrunaAI/mzbac-llama-3-8B-Instruct-function-calling-v0.2-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 22, 2024 • 2

PrunaAI/scb10x-llama-3-typhoon-v1.5-8b-instruct-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 22, 2024 • 2

ildodeltaRule/Yi-6B-200K-AWQ-VLLM

Text Generation • 1B • Updated Jul 23, 2024 • 38

PrunaAI/HuggingFaceTB-SmolLM-1.7B-AWQ-4bit-smashed

Text Generation • 0.4B • Updated Jul 22, 2024 • 3

PrunaAI/namespace-Pt-Llama-3-8B-Instruct-80K-QLoRA-Merged-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 22, 2024 • 3

PrunaAI/Gryphe-Pantheon-RP-1.0-8b-Llama-3-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 22, 2024 • 2

PrunaAI/nothingiisreal-L3-8B-Celeste-v1-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 22, 2024 • 3

hiuman/vi-gemma-2b-RAG-awq-quantization

Text Generation • 1B • Updated Jul 23, 2024 • 3

GameScribes/Mistral-Nemo-AWQ

Text Generation • 3B • Updated Jul 22, 2024 • 4

GameScribes/Mistral-v0.3-AWQ

Text Generation • 1B • Updated Jul 22, 2024 • 4

casperhansen/qwen2-0.5b-instruct-awq

Text Generation • 0.3B • Updated Jul 22, 2024 • 4

PrunaAI/unsloth-llama-3-8b-Instruct-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 22, 2024 • 2