Alsebay/RainyMotip-2x7B AWQ

Model Summary

What is it? A 2x7B MoE model for Roleplay(?).

You will occur GPT-like responses sometimes, just skip it and reroll (gacha time). Overall, I think it good enough for Roleplaying.

You may want see this: https://huggingface.co/Alsebay/My_LLMs_Leaderboard

This model is is a Mixure of Experts (MoE) made with the following models:

  • udkai/Turdus
  • Kquant03/Samlagast-7B-laser-bf16

If you used it, please let me know if it good or not. Thank you :)

Downloads last month
82
Safetensors
Model size
1.95B params
Tensor type
I32
·
FP16
·
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model authors have turned it off explicitly.

Collection including solidrust/RainyMotip-2x7B-AWQ