Update README.md
Browse files
README.md
CHANGED
@@ -24,7 +24,7 @@ This model was fine-tuned using **Optuna-based hyperparameter optimization** on
|
|
24 |
|
25 |
---
|
26 |
|
27 |
-
<img src="https://cdn-uploads.huggingface.co/production/uploads/64e8ea3892d9db9a93580fe3/xp0S8cYIVbb8xJ0sGH7qw.png" alt="Poster" width="
|
28 |
|
29 |
### Supported Tasks
|
30 |
|
@@ -35,14 +35,8 @@ This model was fine-tuned using **Optuna-based hyperparameter optimization** on
|
|
35 |
|
36 |
---
|
37 |
|
38 |
-
## Training Details
|
39 |
|
40 |
-
|
41 |
-
|
42 |
-
* The recipe is dataset-agnostic.
|
43 |
-
|
44 |
-
|
45 |
-
### Hyperparameter Search Space
|
46 |
|
47 |
The Optuna study explored:
|
48 |
|
@@ -50,14 +44,14 @@ The Optuna study explored:
|
|
50 |
* **Weight decay:** Uniform(0.0, 0.3)
|
51 |
* **Per device train batch size:** Choice([8, 16, 32])
|
52 |
|
53 |
-
|
54 |
|
55 |
The pipeline optimizes:
|
56 |
|
57 |
* **Metric:** Validation accuracy (can switch to F1, loss, or task-specific metrics)
|
58 |
* **Direction:** Maximize
|
59 |
|
60 |
-
|
61 |
|
62 |
| Hyperparameter | Best Value |
|
63 |
| ------------------- | ---------- |
|
|
|
24 |
|
25 |
---
|
26 |
|
27 |
+
<img src="https://cdn-uploads.huggingface.co/production/uploads/64e8ea3892d9db9a93580fe3/xp0S8cYIVbb8xJ0sGH7qw.png" alt="Poster" width="600"/>
|
28 |
|
29 |
### Supported Tasks
|
30 |
|
|
|
35 |
|
36 |
---
|
37 |
|
|
|
38 |
|
39 |
+
## Hyperparameter Search Space
|
|
|
|
|
|
|
|
|
|
|
40 |
|
41 |
The Optuna study explored:
|
42 |
|
|
|
44 |
* **Weight decay:** Uniform(0.0, 0.3)
|
45 |
* **Per device train batch size:** Choice([8, 16, 32])
|
46 |
|
47 |
+
## Optimization Objective
|
48 |
|
49 |
The pipeline optimizes:
|
50 |
|
51 |
* **Metric:** Validation accuracy (can switch to F1, loss, or task-specific metrics)
|
52 |
* **Direction:** Maximize
|
53 |
|
54 |
+
## Best Trial Example (MRPC)
|
55 |
|
56 |
| Hyperparameter | Best Value |
|
57 |
| ------------------- | ---------- |
|