Esperanto/mistral-7b-Instruct-v0.2-kvc-AWQ-int4-onnx
Updated
•
4
•
1
Foundation SLM AWQ int4 ONNX
In this collection, we gather all the Foundation SLM that Esperanto Technologies has converted to ONNX in int4 precision quantized with AWQ
-
-
Esperanto/gemma-2b-it-kvc-AWQ-int4-onnx
Updated • 3 -
Esperanto/gemma-7b-it-kvc-AWQ-int4-onnx
Updated • 2 -
Esperanto/llama3-8b-Instruct-kvc-AWQ-int4-onnx
Updated -
Esperanto/phi3-mini-4k-instruct-kvc-AWQ-int4-onnx
Updated -
Esperanto/vicuna-7b-v1.5-kvc-AWQ-int4-onnx
Updated -
Esperanto/llama-3.2-1B-Instruct-kvc-AWQ-int4-onnx
Text Generation • Updated -
Esperanto/llama-3.2-3B-Instruct-kvc-AWQ-int4-onnx
Text Generation • Updated • 2 -
Esperanto/llama3.1-8b-Instruct-kvc-AWQ-int4-onnx
Text Generation • Updated • 3