Update README.md
Browse files
README.md
CHANGED
@@ -1,19 +1,62 @@
|
|
1 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2 |
|
3 |
-
|
4 |
|
5 |
-
##
|
6 |
-
|
7 |
-
|
8 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
9 |
|
10 |
## Usage
|
|
|
11 |
```python
|
12 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
|
|
13 |
|
|
|
14 |
model = AutoModelForCausalLM.from_pretrained("adrianpintilie/EminescuAI-70B")
|
15 |
tokenizer = AutoTokenizer.from_pretrained("adrianpintilie/EminescuAI-70B")
|
16 |
-
```
|
17 |
|
18 |
-
|
19 |
-
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
language: ro
|
3 |
+
tags:
|
4 |
+
- romanian
|
5 |
+
- llama
|
6 |
+
- lora
|
7 |
+
- finetuning
|
8 |
+
license: mit
|
9 |
+
base_model:
|
10 |
+
- meta-llama/Llama-3.3-70B-Instruct
|
11 |
+
---
|
12 |
|
13 |
+
# EminescuAI
|
14 |
|
15 |
+
## Overview
|
16 |
+
EminescuAI is a specialized language model based on meta-llama/Llama-3.3-70B, fine-tuned using LoRA (Low-Rank Adaptation) technology. The model was trained on the public literary works of Mihai Eminescu, one of Romania's most influential poets and writers. Building upon its smaller 8B predecessor, this 70B-parameter model demonstrates significantly enhanced capabilities in understanding and generating Romanian literary content.
|
17 |
+
|
18 |
+
## Technical Details
|
19 |
+
|
20 |
+
- **Base Model:** meta-llama/Llama-3.3-70B-Instruct
|
21 |
+
- **Fine-tuning Method:** LoRA (Low-Rank Adaptation)
|
22 |
+
- **Training Data:** Public works by Mihai Eminescu
|
23 |
+
- **Primary Language:** Romanian
|
24 |
+
|
25 |
+
## Capabilities
|
26 |
+
The model excels at generating text in Romanian that reflects Eminescu's literary style, producing more coherent and contextually appropriate poetry while maintaining consistent narrative structure.
|
27 |
+
|
28 |
+
It performs better on descriptive writing tasks, particularly:
|
29 |
+
- Nature-themed poetry
|
30 |
+
- Seasonal descriptions
|
31 |
+
- Romantic and contemplative prose
|
32 |
+
- Understanding and responding to Romanian language prompts
|
33 |
+
|
34 |
+
Ideal for:
|
35 |
+
- Creative writing in Romanian
|
36 |
+
- Generating descriptive text inspired by Romanian romantic literature
|
37 |
+
|
38 |
+
## Limitations
|
39 |
+
For optimal results:
|
40 |
+
- Use Romanian language prompts
|
41 |
+
- Focus on descriptive and creative writing tasks
|
42 |
+
- Keep in mind the model works best with themes common in Romanian romantic literature
|
43 |
+
|
44 |
+
## Technical Note
|
45 |
+
This model represents an application of modern AI technology to classical Romanian literature, demonstrating how historical literary styles can be preserved and studied using machine learning techniques.
|
46 |
|
47 |
## Usage
|
48 |
+
|
49 |
```python
|
50 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
51 |
+
from peft import PeftModel
|
52 |
|
53 |
+
# Încarcă modelul și tokenizer-ul
|
54 |
model = AutoModelForCausalLM.from_pretrained("adrianpintilie/EminescuAI-70B")
|
55 |
tokenizer = AutoTokenizer.from_pretrained("adrianpintilie/EminescuAI-70B")
|
|
|
56 |
|
57 |
+
# Generează text
|
58 |
+
text = "Scrie o poezie despre:"
|
59 |
+
inputs = tokenizer(text, return_tensors="pt")
|
60 |
+
outputs = model.generate(**inputs, max_length=200)
|
61 |
+
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
|
62 |
+
```
|