Update README.md
Browse files
README.md
CHANGED
@@ -71,7 +71,7 @@ Here is the training notebook: (Fine_tuning_llama4 (Original)) [https://huggingf
|
|
71 |
|
72 |
## Notes
|
73 |
|
74 |
-
- **GPU Required**: Make sure you have access to
|
75 |
- **Environment**: The notebook expects an environment where NVIDIA CUDA drivers are available (`nvidia-smi` check is included).
|
76 |
- **Memory Efficiency**: 4-bit loading greatly reduces memory footprint.
|
77 |
|
@@ -99,7 +99,7 @@ Please answer the following medical question.
|
|
99 |
```
|
100 |
|
101 |
---
|
102 |
-
## Usage Script
|
103 |
|
104 |
```python
|
105 |
from transformers import AutoTokenizer, AutoModelForCausalLM, BitsAndBytesConfig
|
|
|
71 |
|
72 |
## Notes
|
73 |
|
74 |
+
- **GPU Required**: Make sure you have access to 3X H200s. Get it from RunPod for an hours. Training took only 7 minutes.
|
75 |
- **Environment**: The notebook expects an environment where NVIDIA CUDA drivers are available (`nvidia-smi` check is included).
|
76 |
- **Memory Efficiency**: 4-bit loading greatly reduces memory footprint.
|
77 |
|
|
|
99 |
```
|
100 |
|
101 |
---
|
102 |
+
## Usage Script (not-tested)
|
103 |
|
104 |
```python
|
105 |
from transformers import AutoTokenizer, AutoModelForCausalLM, BitsAndBytesConfig
|