---
pipeline_tag: text-generation
---

This repository contains the monet-vd-4.1B-100BT model introduced in [Monet: Mixture of Monosemantic Experts for Transformers](https://huggingface.co/papers/2412.04139).

Code: https://github.com/dmis-lab/Monet