mergekit-community
/

UltraLong-Thinking

Text Generation

text-generation-inference

Model card Files Files and versions Community

Update README.md

#1

by Isotonic - opened 16 days ago

base: refs/heads/main

←

from: refs/pr/1

Discussion Files changed

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -35,6 +35,6 @@ merge_method: slerp
 base_model: nvidia/Llama-3.1-Nemotron-8B-UltraLong-4M-Instruct
 dtype: bfloat16
 parameters:
-  t: [0, 0.5, 1, 0.5, 0] # V shaped curve: Hermes for input & output, WizardMath in the middle layers
 ```

 base_model: nvidia/Llama-3.1-Nemotron-8B-UltraLong-4M-Instruct
 dtype: bfloat16
 parameters:
+  t: [0, 0.5, 1, 0.5, 0] # V shaped curve: Nemotron-8B for input & output, ReDistill in the middle layers
 ```