This model outperformed all previous phi-2 based finetunes, except for one MoE implementation