Update README.md

README.md

@@ -31,6 +31,44 @@ tags:
 This model was converted to GGUF format from [`nbeerbower/Xiaolong-Qwen3-0.6B`](https://huggingface.co/nbeerbower/Xiaolong-Qwen3-0.6B) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
 Refer to the [original model card](https://huggingface.co/nbeerbower/Xiaolong-Qwen3-0.6B) for more details on the model.
 
+---
+Xiaolong is a small, uncensored, reasoning-focused model finetuned using ORPO and QLoRA on top of Qwen3-0.6B-abliterated-TIES.
+
+Finetuning Details
+-
+
+- Method: ORPO
+- Epochs: 1.3
+- Learning Rate: 5e-6, cosine decay w/ 5% warmup
+- Batch Size: 4 x 8 (32 effective)
+- Max Grad Norm: 0.3
+- LoRA Rank: 64
+- Hardware: 1x NVIDIA RTX A6000
+
+Dataset Composition
+-
+~9,100 samples. 3,000 used Chain of Thought reasoning.
+
+- nbeerbower/GreatFirewall-DPO
+- nbeerbower/Schule-DPO
+- nbeerbower/Purpura-DPO
+- nbeerbower/Arkhaios-DPO
+- jondurbin/truthy-dpo-v0.1
+- antiven0m/physical-reasoning-dpo
+- flammenai/Date-DPO-NoAsterisks
+- flammenai/Prude-Phi3-DPO
+- Atsunori/HelpSteer2-DPO (1000 samples)
+- jondurbin/gutenberg-dpo-v0.1
+- nbeerbower/gutenberg2-dpo
+- nbeerbower/gutenberg-moderne-dpo
+
+Chain of Thought
+-
+- GeneralReasoning/GeneralThought-430K (1000 samples)
+- nvidia/OpenMathReasoning (1000 samples)
+- nvidia/OpenCodeReasoning (1000 samples)
+
+---
 ## Use with llama.cpp
 Install llama.cpp through brew (works on Mac and Linux)