CPT uses rubric-guided synthetic data and DPO to enable LLMs to dynamically adjust behavior (e.g., writing style) at inference with system prompts
-
Configurable Preference Tuning with Rubric-Guided Synthetic Data
Paper • 2506.11702 • Published • 2 -
vicgalle/creative-rubrics-preferences
Viewer • Updated • 900 • 95 • 2 -
vicgalle/creative-rubrics
Viewer • Updated • 1.33k • 103 • 3 -
vicgalle/configurable-preference-mistral-nemo-12b
Text Generation • Updated