Update README.md

README.md

@@ -9,8 +9,14 @@ tags:
 - model_hub_mixin
 - pytorch_model_hub_mixin
 ---
+# BEN2 pruning test # 1 - distillation
+Original parameters: 94,134,658
 
-This model has been pushed to the Hub using the [PytorchModelHubMixin](https://huggingface.co/docs/huggingface_hub/package_reference/mixins#huggingface_hub.PyTorchModelHubMixin) integration:
-- Code: https://github.com/PramaLLC/BEN2
-- Paper: [More Information Needed]
-- Docs: [More Information Needed]
+Pruned parameters: 36,275,254
+
+Parameter reduction: 61.5%
+
+- Swin Transformer depths: [2, 2, 18, 2] → [2, 2, 6, 2]
+- Swin Transformer heads: [4, 8, 16, 32] → [3, 6, 12, 24]
+
+distill loss: 0.0008