DoppelReflEx commited on
Commit
e87c429
·
verified ·
1 Parent(s): edff771

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -26
README.md CHANGED
@@ -35,32 +35,6 @@ merge_method: dare_ties
35
  base_model: Delta-Vector/Francois-PE-V2-Huali-12B
36
  tokenizer_source: base
37
  parameters:
38
-
39
  rescale: true
40
  dtype: bfloat16
41
  ```
42
-
43
- ## 💻 Usage
44
-
45
- ```python
46
- !pip install -qU transformers accelerate
47
-
48
- from transformers import AutoTokenizer
49
- import transformers
50
- import torch
51
-
52
- model = "DoppelReflEx/DoppelReflEx/MiniusLight-24B-v2.5-test"
53
- messages = [{"role": "user", "content": "What is a large language model?"}]
54
-
55
- tokenizer = AutoTokenizer.from_pretrained(model)
56
- prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
57
- pipeline = transformers.pipeline(
58
- "text-generation",
59
- model=model,
60
- torch_dtype=torch.float16,
61
- device_map="auto",
62
- )
63
-
64
- outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)
65
- print(outputs[0]["generated_text"])
66
- ```
 
35
  base_model: Delta-Vector/Francois-PE-V2-Huali-12B
36
  tokenizer_source: base
37
  parameters:
 
38
  rescale: true
39
  dtype: bfloat16
40
  ```