Rustamshry commited on
Commit
03760af
·
verified ·
1 Parent(s): 1120863

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -0
README.md CHANGED
@@ -81,6 +81,25 @@ _ = model.generate(
81
  streamer = TextStreamer(tokenizer, skip_prompt = True),
82
  )
83
  ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
84
 
85
  ## Training Data
86
 
 
81
  streamer = TextStreamer(tokenizer, skip_prompt = True),
82
  )
83
  ```
84
+ **For pipeline:**
85
+ ```python
86
+ from transformers import pipeline, AutoModelForCausalLM, AutoTokenizer
87
+ from peft import PeftModel
88
+
89
+ tokenizer = AutoTokenizer.from_pretrained("unsloth/Qwen3-1.7B")
90
+ base_model = AutoModelForCausalLM.from_pretrained("unsloth/Qwen3-1.7B")
91
+ model = PeftModel.from_pretrained(base_model, "khazarai/AzQwen")
92
+
93
+ question ="""
94
+ Bir sifət əlavə edərək aşağıdakı cümləni yenidən yazın. Tələbə mürəkkəb anlayışları anlaya bildi.
95
+ """
96
+
97
+ pipe = pipeline("text-generation", model=model, tokenizer=tokenizer)
98
+ messages = [
99
+ {"role": "user", "content": question}
100
+ ]
101
+ pipe(messages)
102
+ ```
103
 
104
  ## Training Data
105