PrunaAI/HuggingFaceTB-SmolLM2-1.7B-Instruct-GGUF-smashed
Updated
β’
977
Pruna AI
Enterprise
company
AI & ML interests
Efficient machine learning for any model and hardware: pruning, quantization, compilation, and more.
Recent Activity
PrunaAI's activity
sharpenbΒ
updated
a
model
2 days ago
Upload folder using huggingface_hub
2
#3 opened 2 days ago
by
sharpenb
Upload folder using huggingface_hub
2
#4 opened 2 days ago
by
sharpenb
Upload folder using huggingface_hub
2
#5 opened 2 days ago
by
sharpenb
sharpenbΒ
published
a
model
2 days ago
sharpenbΒ
updated
2
models
2 days ago
Upload folder using huggingface_hub
2
#4 opened 2 days ago
by
sharpenb
sharpenbΒ
published
a
model
2 days ago
Upload folder using huggingface_hub
2
#1 opened 2 days ago
by
sharpenb
sharpenbΒ
published
a
model
2 days ago
Upload folder using huggingface_hub
2
#1 opened 2 days ago
by
sharpenb
Post
2992
We open-sourced the
- Github repo: https://github.com/PrunaAI/pruna
- Documentation: https://docs.pruna.ai/en/stable/index.html
With open-sourcing, people can now inspect and contribute to the open code. Beyond the code, we provide detailed readme, tutorials, benchmarks, and documentation to make transparent compression, evaluation, and saving/loading/serving of AI models.
Happy to share it with you and always interested in collecting your feedback :)
pruna package that can be easily installed with pip install pruna :) It allows to easily ccompress and evaluate AI models including transformers and diffusers.- Github repo: https://github.com/PrunaAI/pruna
- Documentation: https://docs.pruna.ai/en/stable/index.html
With open-sourcing, people can now inspect and contribute to the open code. Beyond the code, we provide detailed readme, tutorials, benchmarks, and documentation to make transparent compression, evaluation, and saving/loading/serving of AI models.
Happy to share it with you and always interested in collecting your feedback :)
- 1 reply
Post
525
How to deploy compressed ML models in your pipeline?
We wrote a series of blogs on this topics. Hope that it can be helpful to people:
- Standard Model Compression in ML Pipeline: https://www.pruna.ai/blog/standard-model-compression-ml-pipeline
- Boost Your Replicate Models with Pruna AI: A Step-by-Step Guide: https://www.pruna.ai/blog/guide-replicate-pruna-ai
- Pruna + Triton: A Winning Combination for High-Performance AI Deployments: https://www.pruna.ai/blog/pruna-triton-combination
Feel free to join our discord (https://discord.com/invite/rskEr4BZJx) if you have questions ;)
We wrote a series of blogs on this topics. Hope that it can be helpful to people:
- Standard Model Compression in ML Pipeline: https://www.pruna.ai/blog/standard-model-compression-ml-pipeline
- Boost Your Replicate Models with Pruna AI: A Step-by-Step Guide: https://www.pruna.ai/blog/guide-replicate-pruna-ai
- Pruna + Triton: A Winning Combination for High-Performance AI Deployments: https://www.pruna.ai/blog/pruna-triton-combination
Feel free to join our discord (https://discord.com/invite/rskEr4BZJx) if you have questions ;)
Post
1901
We compressed SmolLMs to make 135 variations of them (see https://huggingface.co/PrunaAI?search_models=smolLM) with different quantization configurations with
We made a blog to summarize our findings (see https://www.pruna.ai/blog/smollm2-smaller-faster) and small LM can be made smaller! :)
pruna (https://docs.pruna.ai/en/latest/). We made a blog to summarize our findings (see https://www.pruna.ai/blog/smollm2-smaller-faster) and small LM can be made smaller! :)
-
- 3 replies
Upload folder using huggingface_hub
2
#1 opened 2 months ago
by
sharpenb
sharpenbΒ
updated
a
model
2 months ago
Upload folder using huggingface_hub
2
#1 opened 2 months ago
by
sharpenb
Upload folder using huggingface_hub
2
#1 opened 2 months ago
by
sharpenb