adrianpintilie commited on
Commit
ceaa080
·
verified ·
1 Parent(s): 4141747

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +52 -9
README.md CHANGED
@@ -1,19 +1,62 @@
1
- # adrianpintilie/EminescuAI-70B
 
 
 
 
 
 
 
 
 
 
2
 
3
- This model is a fine-tuned version of meta-llama/Llama-3.3-70B-Instruct using LoRA (Low-Rank Adaptation).
4
 
5
- ## Model Details
6
- - Base Model: meta-llama/Llama-3.3-70B-Instruct
7
- - Training Method: LoRA
8
- - License: [Specify the license]
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
9
 
10
  ## Usage
 
11
  ```python
12
  from transformers import AutoModelForCausalLM, AutoTokenizer
 
13
 
 
14
  model = AutoModelForCausalLM.from_pretrained("adrianpintilie/EminescuAI-70B")
15
  tokenizer = AutoTokenizer.from_pretrained("adrianpintilie/EminescuAI-70B")
16
- ```
17
 
18
- ## Training Details
19
- [Add your training details here]
 
 
 
 
 
1
+ ---
2
+ language: ro
3
+ tags:
4
+ - romanian
5
+ - llama
6
+ - lora
7
+ - finetuning
8
+ license: mit
9
+ base_model:
10
+ - meta-llama/Llama-3.3-70B-Instruct
11
+ ---
12
 
13
+ # EminescuAI
14
 
15
+ ## Overview
16
+ EminescuAI is a specialized language model based on meta-llama/Llama-3.3-70B, fine-tuned using LoRA (Low-Rank Adaptation) technology. The model was trained on the public literary works of Mihai Eminescu, one of Romania's most influential poets and writers. Building upon its smaller 8B predecessor, this 70B-parameter model demonstrates significantly enhanced capabilities in understanding and generating Romanian literary content.
17
+
18
+ ## Technical Details
19
+
20
+ - **Base Model:** meta-llama/Llama-3.3-70B-Instruct
21
+ - **Fine-tuning Method:** LoRA (Low-Rank Adaptation)
22
+ - **Training Data:** Public works by Mihai Eminescu
23
+ - **Primary Language:** Romanian
24
+
25
+ ## Capabilities
26
+ The model excels at generating text in Romanian that reflects Eminescu's literary style, producing more coherent and contextually appropriate poetry while maintaining consistent narrative structure.
27
+
28
+ It performs better on descriptive writing tasks, particularly:
29
+ - Nature-themed poetry
30
+ - Seasonal descriptions
31
+ - Romantic and contemplative prose
32
+ - Understanding and responding to Romanian language prompts
33
+
34
+ Ideal for:
35
+ - Creative writing in Romanian
36
+ - Generating descriptive text inspired by Romanian romantic literature
37
+
38
+ ## Limitations
39
+ For optimal results:
40
+ - Use Romanian language prompts
41
+ - Focus on descriptive and creative writing tasks
42
+ - Keep in mind the model works best with themes common in Romanian romantic literature
43
+
44
+ ## Technical Note
45
+ This model represents an application of modern AI technology to classical Romanian literature, demonstrating how historical literary styles can be preserved and studied using machine learning techniques.
46
 
47
  ## Usage
48
+
49
  ```python
50
  from transformers import AutoModelForCausalLM, AutoTokenizer
51
+ from peft import PeftModel
52
 
53
+ # Încarcă modelul și tokenizer-ul
54
  model = AutoModelForCausalLM.from_pretrained("adrianpintilie/EminescuAI-70B")
55
  tokenizer = AutoTokenizer.from_pretrained("adrianpintilie/EminescuAI-70B")
 
56
 
57
+ # Generează text
58
+ text = "Scrie o poezie despre:"
59
+ inputs = tokenizer(text, return_tensors="pt")
60
+ outputs = model.generate(**inputs, max_length=200)
61
+ print(tokenizer.decode(outputs[0], skip_special_tokens=True))
62
+ ```