Various useful datasets with preference optimization
Nicholas Beerbower PRO
nbeerbower
AI & ML interests
QLoRA finetuning and merging LLMs for fun
Recent Activity
liked
a model
1 day ago
NovelAI/nai-anime-v2
liked
a dataset
5 days ago
OmniGen2/X2I2
liked
a model
5 days ago
OmniGen2/OmniGen2
Organizations
Dumplings
Qwen2.5 finetunes aiming for decensorship and improved english prose
bruphin
Series of merge experiments attempting to make a small uncensored ChatML model based initially on ehartford/dolphin and rwitz/go-bruins-v2 mistral-7B
llama 3 experiments
Merge and finetune experiments with llama 3, aiming for decensorship and benchmark performance.
Qwen3
my qwen3 tunes
abliteration loras
Extracted adapters for removing censorship in models
flammen
Merge & finetune experiments aiming for strong character roleplay, creative writing, and overall good performance.
Nemo
Mistral Nemo 12B finetunes and merges
-
nbeerbower/mistral-nemo-bophades-12B
Text Generation • 12B • Updated • 75 • • 9 -
nbeerbower/Lyra-Gutenberg-mistral-nemo-12B
Text Generation • 12B • Updated • 76 • • 19 -
nbeerbower/mistral-nemo-gutenberg-12B-v4
Text Generation • 12B • Updated • 75 • • 21 -
nbeerbower/mistral-nemo-gutenberg-12B-v3
Text Generation • 12B • Updated • 27 • 11
DPO
Various useful datasets with preference optimization
Qwen3
my qwen3 tunes
Dumplings
Qwen2.5 finetunes aiming for decensorship and improved english prose
abliteration loras
Extracted adapters for removing censorship in models
bruphin
Series of merge experiments attempting to make a small uncensored ChatML model based initially on ehartford/dolphin and rwitz/go-bruins-v2 mistral-7B
flammen
Merge & finetune experiments aiming for strong character roleplay, creative writing, and overall good performance.
llama 3 experiments
Merge and finetune experiments with llama 3, aiming for decensorship and benchmark performance.
Nemo
Mistral Nemo 12B finetunes and merges
-
nbeerbower/mistral-nemo-bophades-12B
Text Generation • 12B • Updated • 75 • • 9 -
nbeerbower/Lyra-Gutenberg-mistral-nemo-12B
Text Generation • 12B • Updated • 76 • • 19 -
nbeerbower/mistral-nemo-gutenberg-12B-v4
Text Generation • 12B • Updated • 75 • • 21 -
nbeerbower/mistral-nemo-gutenberg-12B-v3
Text Generation • 12B • Updated • 27 • 11