schuler commited on
Commit
05ee59c
·
verified ·
1 Parent(s): 14e1c95

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -16,7 +16,7 @@ This technical report demonstrates that large language models (LLMs) can maintai
16
  - Improved output quality in qualitative testing.
17
 
18
  ## Implementation Details
19
- - Base Model: Microsoft's [phi-3-mini-4k-instruct](https://huggingface.co/microsoft/Phi-3-mini-4k-instruct).
20
  - Training Dataset: [LaMini](https://huggingface.co/datasets/MBZUAI/LaMini-instruction).
21
  - Architecture: Modified transformer decoder with grouped pointwise convolutions.
22
 
 
16
  - Improved output quality in qualitative testing.
17
 
18
  ## Implementation Details
19
+ - Base Model: [kphi3](https://github.com/joaopauloschuler/less-parameters-llm).
20
  - Training Dataset: [LaMini](https://huggingface.co/datasets/MBZUAI/LaMini-instruction).
21
  - Architecture: Modified transformer decoder with grouped pointwise convolutions.
22