YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

LLaMA2-7B Fused QKV

Custom LLaMA2-7B model with fused QKV projections.

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained(
    "vuiseng9/llama2-7b-fused-qkv",
    trust_remote_code=True
)
tokenizer = AutoTokenizer.from_pretrained("vuiseng9/llama2-7b-fused-qkv")

inputs = tokenizer("Hello, I'm", return_tensors="pt")
outputs = model.generate(**inputs, max_length=50)
print(tokenizer.decode(outputs[0]))

Downloads last month: -

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support