Hugging Face's logo

Sefika
/
CRE_llama_fewrel_1_memory_10_8

Text Generation
Transformers
Safetensors
llama
trl
sft
text-generation-inference
4-bit precision
bitsandbytes
Model card Files Community
CRE_llama_fewrel_1_memory_10_8 / README.md
Sefika's picture
Sefika
Update README.md
3c970f6 verified
preview code
|
raw
history blame contribute delete
1.39 kB
metadata
library_name: transformers
tags:
  - trl
  - sft

Model Card for Model ID

Model Details

Model Description

This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.

Model Sources [optional]

  • Repository: [More Information Needed]
  • Paper [optional]: [More Information Needed]
  • Demo [optional]: [More Information Needed]

Direct Use 

from transformers import AutoModelForCausalLM, AutoTokenizer, pipeline

tokenizer = "meta-llama/Llama-2-7b-chat-hf"
model_id = "CRE_llama_fewrel_1_memory_10_8"
tokenizer = AutoTokenizer.from_pretrained(model_id, use_auth_token=True)
model = AutoModelForCausalLM.from_pretrained(
    model_id,
    device_map="auto",
    load_in_4bit=True,  # Requires bitsandbytes
    torch_dtype="auto"
)

Testing Data

FewRel

BibTeX: The paper "Large Language Models for Continual Relation Extraction" is submitted to Springer Machine Learning journal

Model Card Contact

sefika efeoglu