--- base_model: - huihui-ai/Llama-3.2-1B-Instruct-abliterated - Othmaneoz8/llama-3.2-1B-userstories-cpu - bunnycore/FuseChat-3.2-1B-Creative-RP - xdrshjr/llama3.2_1b_uncensored_5000_8epoch_lora - diabolic6045/open-llama-3.2-1B-Instruct library_name: transformers tags: - mergekit - merge --- # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [bunnycore/FuseChat-3.2-1B-Creative-RP](https://huggingface.co/bunnycore/FuseChat-3.2-1B-Creative-RP) as a base. ### Models Merged The following models were included in the merge: * [huihui-ai/Llama-3.2-1B-Instruct-abliterated](https://huggingface.co/huihui-ai/Llama-3.2-1B-Instruct-abliterated) * [Othmaneoz8/llama-3.2-1B-userstories-cpu](https://huggingface.co/Othmaneoz8/llama-3.2-1B-userstories-cpu) * [xdrshjr/llama3.2_1b_uncensored_5000_8epoch_lora](https://huggingface.co/xdrshjr/llama3.2_1b_uncensored_5000_8epoch_lora) * [diabolic6045/open-llama-3.2-1B-Instruct](https://huggingface.co/diabolic6045/open-llama-3.2-1B-Instruct) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: diabolic6045/open-llama-3.2-1B-Instruct - model: huihui-ai/Llama-3.2-1B-Instruct-abliterated - model: xdrshjr/llama3.2_1b_uncensored_5000_8epoch_lora - model: Othmaneoz8/llama-3.2-1B-userstories-cpu merge_method: model_stock base_model: bunnycore/FuseChat-3.2-1B-Creative-RP dtype: bfloat16 parameters: t: [0, 0.5, 1, 0.5, 0] ```