Hugging Face's logo

julep-ai
/
dolphin-2.9.1-llama-3-70b-awq

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Inference Endpoints
4-bit precision
awq
Model card Files Community

Model Card for dolphin-2.9.1-llama-3-70b-awq

AWQ Quantized version of cognitivecomputations/dolphin-2.9.1-llama-3-70b.

For use with vllm and other inference engines.

Downloads last month
81
Safetensors
Model size
11.3B params
Tensor type
FP16
·
I32
·
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.