Run Inf

!git clone https://github.com/huggingface/transformers.git
%cd transformers
!git checkout <commit_id_for_4.47.0.dev0>
!pip install -q .
!pip install -q accelerate==0.34.2 bitsandbytes==0.44.1 peft==0.13.1
model_id = 'Ahanaas/Zephyr_7b_Finetuned_role'
Downloads last month
0
Safetensors
Model size
7.24B params
Tensor type
FP16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support