Update README.md
Browse files
README.md
CHANGED
|
@@ -9,6 +9,27 @@ library_name: transformers
|
|
| 9 |
tags:
|
| 10 |
- legal
|
| 11 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 12 |
## Usage
|
| 13 |
Install the following dependencies:
|
| 14 |
```sh
|
|
@@ -55,8 +76,8 @@ Load SEMPL-IT model and tokenizer:
|
|
| 55 |
```py
|
| 56 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 57 |
|
| 58 |
-
tokenizer = AutoTokenizer.from_pretrained("VerbACxSS/sempl-it-verbs-
|
| 59 |
-
model = AutoModelForCausalLM.from_pretrained("VerbACxSS/sempl-it-verbs-
|
| 60 |
```
|
| 61 |
|
| 62 |
Define and apply chat template:
|
|
|
|
| 9 |
tags:
|
| 10 |
- legal
|
| 11 |
---
|
| 12 |
+
# sempl-it-verbs-bnb
|
| 13 |
+
SEMPL-IT aims to simplify Italian administrative texts using a progressive approach based on multiple specialized models.
|
| 14 |
+
Each model addresses a specific aspect of the text transformation process, ensuring a step-by-step refinement.
|
| 15 |
+
|
| 16 |
+
## Simplification Pipeline
|
| 17 |
+
The complete text simplification pipeline follows eight sequential steps:
|
| 18 |
+
1. [proofreading](https://huggingface.co/VerbACxSS/sempl-it-proofreading-bnb)
|
| 19 |
+
2. [lex](https://huggingface.co/VerbACxSS/sempl-it-lex-bnb)
|
| 20 |
+
3. [connectives](https://huggingface.co/VerbACxSS/sempl-it-connectives-bnb)
|
| 21 |
+
4. [expressions](https://huggingface.co/VerbACxSS/sempl-it-expressions-bnb)
|
| 22 |
+
5. [sentence-splitter](https://huggingface.co/VerbACxSS/sempl-it-sentence-splitter-bnb)
|
| 23 |
+
6. [nominalizations](https://huggingface.co/VerbACxSS/sempl-it-nominalizations-bnb)
|
| 24 |
+
7. [verbs](https://huggingface.co/VerbACxSS/sempl-it-verbs-bnb) (this)
|
| 25 |
+
8. [sentence-reorganizer](https://huggingface.co/VerbACxSS/sempl-it-sentence-reorganizer-bnb)
|
| 26 |
+
|
| 27 |
+
## Web App
|
| 28 |
+
To integrate this model into the full system, check out:
|
| 29 |
+
- Frontend: [GitHub Repository](https://github.com/VerbACxSS/sempl-it-frontend)
|
| 30 |
+
- Backend: [GitHub Repository](https://github.com/VerbACxSS/sempl-it-backend)
|
| 31 |
+
- Inference: [GitHub Repository](https://github.com/VerbACxSS/sempl-it-inference)
|
| 32 |
+
|
| 33 |
## Usage
|
| 34 |
Install the following dependencies:
|
| 35 |
```sh
|
|
|
|
| 76 |
```py
|
| 77 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 78 |
|
| 79 |
+
tokenizer = AutoTokenizer.from_pretrained("VerbACxSS/sempl-it-verbs-bnb")
|
| 80 |
+
model = AutoModelForCausalLM.from_pretrained("VerbACxSS/sempl-it-verbs-bnb").to("cuda")
|
| 81 |
```
|
| 82 |
|
| 83 |
Define and apply chat template:
|