---
library_name: ctranslate2
base_model:
- LGAI-EXAONE/EXAONE-3.5-7.8B-Instruct
base_model_relation: quantized
tags:
  - ctranslate2
  - chat
---
Ctranslate2 8-bit quantization of [
EXAONE-3.5-7.8B-Instruct](https://huggingface.co/LGAI-EXAONE/EXAONE-3.5-7.8B-Instruct).

However, this would not have been possible without the model first being converted to Llama format [from here](https://huggingface.co/datalama/EXAONE-3.5-7.8B-Instruct-Llamafied)