Some GGUF V3 quantizations of the model vihangd/shearedplats-2.7b-v1

ShearedPlats-2.7b-v1

An experimental finetune of Sheared LLaMA 2.7b with Alpaca-QLoRA

Datasets

Trained on alpca style datasets

Uses alpaca style prompt template

GGUF

Model size

2.7B params

Architecture

llama

Hardware compatibility

2-bit

4-bit

5-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support