Edit model card

Join our Discord! https://discord.gg/Nbv9pQ88Xb


BeaverAI & Steelskull proudly present...

Theia 21B v1 🧘

An upscaled NeMo with half its layers trained on my special sauce πŸ’¦

image/png

According to the giant impact hypothesis, Theia orbited the Sun, nearly along the orbit of the proto-Earth, by staying close to one or the other of the Sun-Earth system's two more stable Lagrangian points.

image/gif

Theia was eventually perturbed away from that relationship by the gravitational influence of Jupiter, Venus, or both, resulting in a collision between Theia and Earth.

Description

  • This is a finetune of Steelskull's NeMoria 21B model.
  • Testers have reported enhanced RP capabilities, better storytelling, and richer prose.

Links

Usage

  • Mistral format
    • Make sure that there is a space between [/INST] and {{char}}: like [/INST] {{char}}:.
    • [/INST]{{char}}: (no space between) has a huge negative impact on performance.
  • Use DRY
Downloads last month
11
Safetensors
Model size
20.4B params
Tensor type
BF16
Β·
Inference API
Unable to determine this model's library. Check the docs .

Model tree for TheDrummer/Theia-21B-v1

Finetunes
1 model
Merges
1 model
Quantizations
4 models