Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

6,749

Full-text search

Active filters: awq

Ichigo2899/Artigenz-Artigenz-Coder-DS-6.7B-AWQ

Text Generation • Updated Jul 14, 2024 • 65

PrunaAI/SeaLLMs-SeaLLM-7B-v2.5-AWQ-4bit-smashed

Text Generation • Updated Jul 14, 2024 • 69

PrunaAI/Gryphe-Tiamat-8b-1.2-Llama-3-DPO-AWQ-4bit-smashed

Text Generation • Updated Jul 14, 2024 • 63

PrunaAI/Qwen-CodeQwen1.5-7B-AWQ-4bit-smashed

Text Generation • Updated Jul 15, 2024 • 11

msobroza/prometheus-8x7b-v2.0-awq

Text Generation • Updated Jul 15, 2024 • 5

Weni/ZeroShot-Agents-Llama3-4.0.70-DPO-AWQ

Text Generation • Updated Jul 15, 2024 • 6

PrunaAI/IlyaGusev-saiga_llama3_8b-AWQ-4bit-smashed

Text Generation • Updated Jul 15, 2024 • 9

PrunaAI/HuggingFaceTB-cosmo-1b-AWQ-4bit-smashed

Text Generation • Updated Jul 15, 2024 • 9

PrunaAI/sbintuitions-sarashina2-13b-AWQ-4bit-smashed

Text Generation • Updated Jul 15, 2024 • 6

PrunaAI/unsloth-gemma-7b-AWQ-4bit-smashed

Text Generation • Updated Jul 15, 2024 • 64

agentsea/internlm-xcomposer2-4khd-7b-4bit

Feature Extraction • Updated Jul 15, 2024 • 103

PrunaAI/Locutusque-Llama-3-Orca-2.0-8B-AWQ-4bit-smashed

Text Generation • Updated Jul 15, 2024 • 8

PrunaAI/ResplendentAI-Aura_v2_7B-AWQ-4bit-smashed

Text Generation • Updated Jul 15, 2024 • 8

PrunaAI/Qwen-Qwen1.5-1.8B-Chat-AWQ-4bit-smashed

Text Generation • Updated Jul 15, 2024 • 7

PrunaAI/vonjack-Phi-3-mini-4k-instruct-LLaMAfied-AWQ-4bit-smashed

Text Generation • Updated Jul 15, 2024 • 10

PrunaAI/soketlabs-pragna-1b-AWQ-4bit-smashed

Text Generation • Updated Jul 15, 2024 • 7

PrunaAI/BEE-spoke-data-smol_llama-220M-GQA-AWQ-4bit-smashed

Text Generation • Updated Jul 15, 2024 • 7

PrunaAI/mlabonne-NeuralPipe-7B-slerp-AWQ-4bit-smashed

Text Generation • Updated Jul 15, 2024 • 8

PrunaAI/qnguyen3-Master-Yi-9B-AWQ-4bit-smashed

Text Generation • Updated Jul 15, 2024 • 6

Ichigo2899/Qwen-CodeQwen1.5-7B-Chat-AWQ

Text Generation • Updated Jul 16, 2024 • 5

PrunaAI/cognitivecomputations-dolphin-2.9.3-mistral-7B-32k-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 9

PrunaAI/DeepMount00-Mistral-RAG-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 9

PrunaAI/ibm-granite-granite-3b-code-instruct-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 28

PrunaAI/DiscoResearch-Llama3-German-8B-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 7

PrunaAI/TheDrummer-Moistral-11B-v4-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 7

PrunaAI/Orenguteng-Llama-3-8B-LexiFun-Uncensored-V1-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 8

SorawitChok/SeaLLM3-7B-Chat-AWQ

Text Generation • Updated 22 days ago • 98

aws-prototyping/MegaBeam-Mistral-7B-300k-AWQ

Text Generation • Updated Jul 16, 2024 • 7 • 1

PrunaAI/zhengr-MixTAO-7Bx2-MoE-v8.1-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 9

PrunaAI/prometheus-eval-prometheus-7b-v2.0-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 9