Various useful datasets with preference optimization
Nicholas Beerbower PRO
nbeerbower
AI & ML interests
QLoRA finetuning and merging LLMs for fun
Recent Activity
liked
a model
about 22 hours ago
NovelAI/nai-anime-v2
liked
a dataset
4 days ago
OmniGen2/X2I2
liked
a model
4 days ago
OmniGen2/OmniGen2
Organizations
models
219
nbeerbower/NikuXL-v0.1
Text-to-Image
•
Updated
•
2
nbeerbower/NikuX1-Test
Text-to-Image
•
Updated
•
6
nbeerbower/Yanfei-v2-Qwen3-32B
Text Generation
•
33B
•
Updated
•
87
•
1
nbeerbower/Menghua-Qwen3-32B-lora
Updated
•
17
nbeerbower/Zhiming-Qwen3-32B-lora
Updated
•
13
nbeerbower/Mistral-Nemo-Gutenberg-Vitus-12B
12B
•
Updated
•
50
•
4
nbeerbower/Vitus-Qwen3-14B
15B
•
Updated
•
56
•
3
nbeerbower/Vitus-mistral-nemo-12B
12B
•
Updated
•
42
nbeerbower/Yanfei-Qwen3-32B
Text Generation
•
33B
•
Updated
•
57
•
1
nbeerbower/Schreiber-mistral-nemo-12B
Text Generation
•
12B
•
Updated
•
105
•
1
datasets
20
nbeerbower/NikuX-DPO-captioned
Viewer
•
Updated
•
792
•
134
nbeerbower/NikuX-DPO-filtered
Viewer
•
Updated
•
792
•
178
nbeerbower/NikuX-DPO-concat
Viewer
•
Updated
•
883
•
148
nbeerbower/NikuX3-DPO-Filtered
Viewer
•
Updated
•
581
•
122
nbeerbower/NikuX3-DPO
Viewer
•
Updated
•
651
•
114
nbeerbower/NikuX2-DPO-Filtered
Viewer
•
Updated
•
282
•
121
nbeerbower/YanfeiMix-DPO
Viewer
•
Updated
•
22.4k
•
103
nbeerbower/human-writing-dpo
Updated
•
87
•
5
nbeerbower/NikuX2-DPO
Viewer
•
Updated
•
333
•
75
nbeerbower/NikuX1-DPO
Viewer
•
Updated
•
20
•
127