Models

PrunaAI/openchat-openchat-3.6-8b-20240522-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 17, 2024 • 1

PrunaAI/openlynn-Llama-3-Soliloquy-8B-v1-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 17, 2024 • 1

PrunaAI/numind-NuExtract-tiny-AWQ-4bit-smashed

Text Generation • 0.4B • Updated Jul 17, 2024 • 2

Hariprasath28/SmolLM-1.7B-AWQ-4bit

Text Generation • 0.4B • Updated Jul 17, 2024 • 1

PrunaAI/abacusai-Llama-3-Smaug-8B-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 17, 2024 • 1

Ksgk-fy/maria_v113_awq_zero_point

Text Generation • 2B • Updated Jul 17, 2024 • 1

chienweichang/Llama-3-Taiwan-8B-Instruct-AWQ

Text Generation • 2B • Updated Jul 17, 2024 • 2 • 1

PrunaAI/Weyaxi-Einstein-v7-Qwen2-7B-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 17, 2024 • 1

aryamannningombam/llama-3-awq-4-bit

Text Generation • 2B • Updated Jul 17, 2024 • 1

PrunaAI/RLHFlow-pair-preference-model-LLaMA3-8B-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 17, 2024 • 2

hsan512/vistral_lora_merged_ver2-awq

Text Generation • 1B • Updated Jul 17, 2024 • 1

hugging-quants/Meta-Llama-3.1-405B-Instruct-AWQ-INT4

Text Generation • 59B • Updated Sep 13, 2024 • 973 • 36

PrunaAI/abhishek-autotrain-llama3-no-robots-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 17, 2024 • 1

PrunaAI/RLHFlow-LLaMA3-iterative-DPO-final-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 17, 2024 • 1

Weni/WeniGPT-Agents-Llama3-5.1.12-DPO-AWQ

Text Generation • 2B • Updated Jul 18, 2024 • 1

hiuman/Vistral-7B-Chat-quantize

Text Generation • 1B • Updated Jul 18, 2024 • 1

PrunaAI/ilsp-Meltemi-7B-v1-AWQ-4bit-smashed

Text Generation • 1B • Updated Jul 18, 2024 • 1

PrunaAI/Rijgersberg-GEITje-7B-AWQ-4bit-smashed

Text Generation • 1B • Updated Jul 18, 2024

PrunaAI/mistral-community-Mistral-7B-v0.2-AWQ-4bit-smashed

Text Generation • 1B • Updated Jul 18, 2024 • 1

PrunaAI/DeepMount00-Minerva-3B-base-RAG-AWQ-4bit-smashed

Text Generation • 0.5B • Updated Jul 18, 2024 • 1

PrunaAI/ChaoticNeutrals-Poppy_Porpoise-v0.4-L3-8B-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 18, 2024 • 1

PrunaAI/DAMO-NLP-SG-VideoLLaMA2-7B-16F-AWQ-4bit-smashed

Text Generation • 1B • Updated Jul 18, 2024 • 1

PrunaAI/Muhammad2003-Llama3-8B-OpenHermes-DPO-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 18, 2024 • 1

Rui1283/llama3_8b-instruct-w4-g128

Text Generation • Updated Jul 19, 2024 • 1

PrunaAI/aloobun-Cypher-7B-AWQ-4bit-smashed

Text Generation • 1B • Updated Jul 18, 2024 • 1

PrunaAI/Sao10K-L3-8B-Stheno-v3.2-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 18, 2024 • 1

infly/INF-34B-Chat-AWQ

Text Generation • 6B • Updated Jul 25, 2024 • 4 • 3

PrunaAI/AI-MO-NuminaMath-7B-TIR-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 18, 2024 • 1

Ichigo2899/mistralai-Mistral-Nemo-Instruct-2407-AWQ

Text Generation • 3B • Updated Jul 18, 2024 • 2 • 1

PrunaAI/keeeeenw-MicroLlama-AWQ-4bit-smashed

Text Generation • 0.1B • Updated Jul 18, 2024 • 2