Uploaded model

  • Developed by: auchoi
  • License: apache-2.0
  • Finetuned from model : unsloth/Phi-3-mini-4k-instruct-bnb-4bit

This was more of an experiment for me but this was an existing 4bit model that was quantized again to 4bit. it will not perform well

This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month
75
Safetensors
Model size
2.07B params
Tensor type
F32
BF16
U8
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for auchoi/phi3_4bit_merged

Quantized
(55)
this model