Update README.md
Browse files
README.md
CHANGED
|
@@ -16,7 +16,7 @@ This technical report demonstrates that large language models (LLMs) can maintai
|
|
| 16 |
- Improved output quality in qualitative testing.
|
| 17 |
|
| 18 |
## Implementation Details
|
| 19 |
-
- Base Model:
|
| 20 |
- Training Dataset: [LaMini](https://huggingface.co/datasets/MBZUAI/LaMini-instruction).
|
| 21 |
- Architecture: Modified transformer decoder with grouped pointwise convolutions.
|
| 22 |
|
|
|
|
| 16 |
- Improved output quality in qualitative testing.
|
| 17 |
|
| 18 |
## Implementation Details
|
| 19 |
+
- Base Model: [kphi3](https://github.com/joaopauloschuler/less-parameters-llm).
|
| 20 |
- Training Dataset: [LaMini](https://huggingface.co/datasets/MBZUAI/LaMini-instruction).
|
| 21 |
- Architecture: Modified transformer decoder with grouped pointwise convolutions.
|
| 22 |
|