fedora-copr
/

Mistral-7B-Instruct-v0.3-GGUF

Text Generation

4-bit precision

8-bit precision

Model card Files Files and versions Community

Model Card for fedora-copr/Mistral-7B-Instruct-v0.3-GGUF

Quants of Mistral-7B-instruct-v0.3 for use in local Log Detective inference.

Downloads last month: 66

GGUF

Model size

7.25B params

Architecture

llama

Hardware compatibility

Log In to view the estimation

6-bit

8-bit

16-bit

Inference Providers NEW

Text Generation

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for fedora-copr/Mistral-7B-Instruct-v0.3-GGUF

Base model

mistralai/Mistral-7B-v0.3

Finetuned

mistralai/Mistral-7B-Instruct-v0.3

Quantized

(159)

this model