Hugging Face's logo

eugenepentland
/
WizardLM-7B-Landmark

Text Generation
Transformers
PyTorch
llama
custom_code
text-generation-inference
Inference Endpoints
Model card Files Community

WizardLM-7B with 10k+ context using Landmark Attention.

Model generated using Landmark-Attention-QLoRA

https://github.com/eugenepentland/landmark-attention-qlora

A merge of the following models:

https://huggingface.co/TheBloke/wizardLM-7B-HF

https://huggingface.co/eugenepentland/WizardLM-7B-Landmark-Attention-QLoRA

Can be loaded in using oobooga, make sure to have the --trust-remote-code option on for it to function.

Downloads last month
8
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.