Update README.md
Browse files
README.md
CHANGED
@@ -34,100 +34,61 @@ language:
|
|
34 |
---
|
35 |
|
36 |
|
37 |
-
## Recommended Prompt Format
|
38 |
|
39 |
-
```
|
40 |
-
### Instruction:
|
41 |
-
<instruction>
|
42 |
-
|
43 |
-
### Response:
|
44 |
-
```
|
45 |
-
|
46 |
-
## Recommended Inference Parameters
|
47 |
-
|
48 |
-
```yml
|
49 |
-
repetition_penalty: 1.15
|
50 |
-
do_sample: true
|
51 |
-
temperature: 0.5
|
52 |
-
top_p: 0.5
|
53 |
-
```
|
54 |
|
55 |
|
56 |
|
57 |
|
58 |
|
59 |
# InstructWise 470M - A virtual assistant.
|
|
|
|
|
|
|
|
|
|
|
|
|
60 |
|
61 |
-
Introduction- InstructWise is a model created to act as helpful virtual assistant while maintaing the memory efficiency, this model was fine-tuned on
|
62 |
## Features
|
63 |
-
|
64 |
-
- **
|
65 |
-
- **
|
66 |
-
- **
|
67 |
-
- **Versatility:** From content creation to educational support, NeXGen adapts to different writing styles and applications.
|
68 |
-
- **Advanced Architecture:** Built on the latest advancements in natural language processing, NeXGen offers high-quality text generation.
|
69 |
|
70 |
## Uses
|
71 |
|
72 |
-
|
73 |
|
74 |
-
- **Content Creation:** Generate marketing copy, stories, and product descriptions.
|
75 |
- **Assistance in Writing:** Aid authors, bloggers, and students in drafting articles and essays.
|
76 |
- **Chatbot Development:** Power conversational agents with human-like responses.
|
77 |
- **Prototyping and Idea Generation:** Facilitate brainstorming sessions for product development.
|
78 |
-
- **Social Media Content:** Generate engaging captions for social media posts.
|
79 |
- **Personal Assistant Applications:** Assist users in drafting emails and messages.
|
|
|
80 |
|
81 |
## Direct Use Cases
|
82 |
|
83 |
NeXGen can be directly employed for:
|
84 |
|
85 |
-
|
86 |
-
-
|
87 |
-
|
88 |
-
|
89 |
-
-
|
90 |
-
|
91 |
-
|
92 |
-
|
93 |
-
|
94 |
-
|
95 |
-
|
96 |
-
|
97 |
-
|
98 |
-
|
99 |
-
|
100 |
-
|
101 |
-
|
102 |
-
|
103 |
-
|
104 |
-
|
105 |
-
|
106 |
-
# Ensure attention_mask is provided
|
107 |
-
attention_mask = input_ids.ne(tokenizer.pad_token_id).float()
|
108 |
-
|
109 |
-
# Generate output text
|
110 |
-
output = model.generate(
|
111 |
-
input_ids,
|
112 |
-
max_length=max_length,
|
113 |
-
num_beams=num_beams,
|
114 |
-
no_repeat_ngram_size=no_repeat_ngram_size,
|
115 |
-
top_k=top_k,
|
116 |
-
top_p=top_p,
|
117 |
-
temperature=temperature,
|
118 |
-
attention_mask=attention_mask # Pass attention_mask to the generation method
|
119 |
-
)
|
120 |
-
|
121 |
-
decoded_output = tokenizer.decode(output[0], skip_special_tokens=True)
|
122 |
-
return decoded_output
|
123 |
-
|
124 |
-
# Example usage:
|
125 |
-
prompt = "Your prompt here"
|
126 |
-
generated_text = generate_text(prompt, max_length=200)
|
127 |
-
|
128 |
-
print("Generated Text:")
|
129 |
-
print(generated_text)
|
130 |
-
```
|
131 |
|
132 |
## Limitation
|
133 |
|
@@ -137,7 +98,7 @@ print(generated_text)
|
|
137 |
|
138 |
3. **Inappropriate Language**: The model might generate text that includes offensive language or inappropriate content. Be mindful of this, especially in applications where maintaining a respectful and inclusive tone is essential.
|
139 |
|
140 |
-
|
141 |
|
142 |
## Disclaimer
|
143 |
|
@@ -146,3 +107,21 @@ print(generated_text)
|
|
146 |
- **Not for Critical Applications**: Avoid using the model for critical applications where accuracy and reliability are paramount. The model is intended for creative and exploratory purposes.
|
147 |
|
148 |
- **Ongoing Improvement**: The model may be updated or fine-tuned for better performance. Stay informed about updates and consider using the latest version for improved results.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
34 |
---
|
35 |
|
36 |
|
|
|
37 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
38 |
|
39 |
|
40 |
|
41 |
|
42 |
|
43 |
# InstructWise 470M - A virtual assistant.
|
44 |
+
Note- we,ll be releasing more versions of InstructWise soon, with the goal of making memory-efficent models while maintaining the performance, Thank you!
|
45 |
+
Introduction- InstructWise is a model created to act as helpful virtual assistant while maintaing the memory efficiency.
|
46 |
+
# Credits
|
47 |
+
- **Base Model:** ahxt/llama2_xs_460M_experimental
|
48 |
+
- **Dataset used:** timdettmers/openassistant-guanaco
|
49 |
+
- **License:** llama2
|
50 |
|
|
|
51 |
## Features
|
52 |
+
- **Maintaining performance while being memory efficient:** Ram usage- 7.1GB Vram usage- 0.6GB (approximately)
|
53 |
+
- **Act as helpful virtual assistant:** InstructWise serves as a versatile and helpful assistant, offering a range of features that cater to various user needs. Its key strength lies in providing instructive responses to user prompts, offering detailed and insightful information.
|
54 |
+
- **Coding:** Model can perform coding as well.
|
55 |
+
- **Assisting capabilities:** can assist with wide rang of taskes.
|
|
|
|
|
56 |
|
57 |
## Uses
|
58 |
|
59 |
+
InstructWise finds application in various domains, including:
|
60 |
|
|
|
61 |
- **Assistance in Writing:** Aid authors, bloggers, and students in drafting articles and essays.
|
62 |
- **Chatbot Development:** Power conversational agents with human-like responses.
|
63 |
- **Prototyping and Idea Generation:** Facilitate brainstorming sessions for product development.
|
|
|
64 |
- **Personal Assistant Applications:** Assist users in drafting emails and messages.
|
65 |
+
and many more.
|
66 |
|
67 |
## Direct Use Cases
|
68 |
|
69 |
NeXGen can be directly employed for:
|
70 |
|
71 |
+
1. **Educational Support:**
|
72 |
+
- Assist users in learning new topics with detailed explanations and step-by-step instructions.
|
73 |
+
|
74 |
+
2. **Content Creation:**
|
75 |
+
- Generate creative content based on prompts, aiding content creators in the writing process.
|
76 |
+
|
77 |
+
3. **Code Assistance:**
|
78 |
+
- Provide guidance on coding queries, improve code documentation, and generate code snippets for developers.
|
79 |
+
|
80 |
+
4. **Interactive Conversations:**
|
81 |
+
- Enhance chatbots or virtual assistants with informative and helpful responses for users.
|
82 |
+
|
83 |
+
5. **Q&A Platforms:**
|
84 |
+
- Power question and answer platforms, offering detailed and insightful answers on various topics.
|
85 |
+
|
86 |
+
6. **Technical Writing Support:**
|
87 |
+
- Assist writers and technical communicators with suggestions for clarity and informativeness.
|
88 |
+
|
89 |
+
7. **Idea Expansion:**
|
90 |
+
- Facilitate the expansion and development of ideas by providing detailed insights and suggestions.
|
91 |
+
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
92 |
|
93 |
## Limitation
|
94 |
|
|
|
98 |
|
99 |
3. **Inappropriate Language**: The model might generate text that includes offensive language or inappropriate content. Be mindful of this, especially in applications where maintaining a respectful and inclusive tone is essential.
|
100 |
|
101 |
+
|
102 |
|
103 |
## Disclaimer
|
104 |
|
|
|
107 |
- **Not for Critical Applications**: Avoid using the model for critical applications where accuracy and reliability are paramount. The model is intended for creative and exploratory purposes.
|
108 |
|
109 |
- **Ongoing Improvement**: The model may be updated or fine-tuned for better performance. Stay informed about updates and consider using the latest version for improved results.
|
110 |
+
|
111 |
+
## Recommended Prompt Format to use:
|
112 |
+
|
113 |
+
```
|
114 |
+
### Instruction:
|
115 |
+
<instruction>
|
116 |
+
|
117 |
+
### Response:
|
118 |
+
```
|
119 |
+
|
120 |
+
## Recommended Inference Parameters:
|
121 |
+
|
122 |
+
```yml
|
123 |
+
repetition_penalty: 1.15
|
124 |
+
do_sample: true
|
125 |
+
temperature: 0.5
|
126 |
+
top_p: 0.5
|
127 |
+
```
|