IntelligentEstate/MedIT-Mesh-3B-Instruct-Q8_0-GGUF Model for swar/edge use Multi check Quant training for the most Ideal and coherent model
This model was converted to GGUF format from meditsolutions/MedIT-Mesh-3B-Instruct using llama.cpp
Refer to the original model card for more details on the model.
Use with llama.cpp
Install llama.cpp through brew (works on Mac and Linux)
brew install llama.cpp
Invoke the llama.cpp server or the CLI.
CLI:
llama-cli --hf-repo IntelligentEstate/MedIT-Mesh-3B-Instruct-Q8_0-GGUF --hf-file medit-mesh-3b-instruct-q8_0.gguf -p "The meaning to life and the universe is"
- Downloads last month
- 5
Hardware compatibility
Log In
to view the estimation
8-bit
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
HF Inference deployability: The model has no library tag.
Model tree for IntelligentEstate/MediMesh-Instruct-3B-Q_8-GGUF
Base model
microsoft/Phi-3.5-mini-instruct
Finetuned
meditsolutions/MedIT-Mesh-3B-Instruct