Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Nitral-Archive
/
CEV420-12B-Chatmlified-STEP2
like
2
Follow
Nitral's Archive
13
Safetensors
English
mistral
License:
other
Model card
Files
Files and versions
Community
Train
main
CEV420-12B-Chatmlified-STEP2
/
README.md
Nitral-AI
Update README.md
e2a8aa9
verified
3 days ago
preview
code
|
raw
Copy download link
history
blame
contribute
delete
523 Bytes
metadata
license:
other
language:
-
en
Chatmlification meme
Base model: Captain Eris Violet-v0.420
Step 1: Tokens swapped to ChatML "appropriately" in configs. (This already happened)
Step 2: Barycentric based embedding swap applied with token surgery. (You are currently here)
Example notebook on how to accomplish this
To-do.
Step 3: Train for a single epoch on additional instruction data for healing of the network.