Hugging Face's logo

Cartinoe5930
/
Llama2_init_Mistral

Text Generation
Transformers
Safetensors
llama
text-generation-inference
Model card Files Community
1

Base Model - SOLAR-10.7B

This model is the base model implementation of SOLAR-10.7B. The architecture of base model is Llama2 architecture and initialized with weights of Mistral.

Please check specific details in the GitHub Repository.

GitHub Repository: https://github.com/gauss5930/iDUS

🏆 HuggingFace Open LLM Leaderboard

Model ARC HellaSwag MMLU TruthfulQA Winogrande GSM8K Average
Llama2_init_Mistral 60.07 83.3 64.09 42.15 78.37 37.91 60.98
Downloads last month
514
Safetensors
Model size
7.24B params
Tensor type
F16
·
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Cartinoe5930/Llama2_init_Mistral

Quantizations
2 models

Spaces using Cartinoe5930/Llama2_init_Mistral 6

Collection including Cartinoe5930/Llama2_init_Mistral