dataequity
/

mistral-7b-instruct-v0.2.Q5_K_M.gguf

Text Generation

Model card Files Files and versions Community

Edit model card

Mistral 7B Instruct v0.2 - GGUF

Model creator: Mistral AI_
Original model: Mistral 7B Instruct v0.2

Description

This repo contains GGUF format model files for Mistral AI_'s Mistral 7B Instruct v0.2.

Prompt template: Mistral

<s>[INST] {prompt} [/INST]

Citation

TheBloke

Downloads last month: 21

GGUF

Model size

7.24B params

Architecture

llama

5-bit

Inference Examples

Text Generation

Inference API (serverless) has been turned off for this model.

Model tree for dataequity/mistral-7b-instruct-v0.2.Q5_K_M.gguf

Base model

mistralai/Mistral-7B-Instruct-v0.2

Quantized

(86)

this model