GGUF quants of ServiceNow-AI/Apriel-Nemotron-15b-Thinker
Using llama.cpp b5295 (commit 91a86a6f354aa73a7aab7bc3d283be410fdc93a5)
The importance matrix was generated with calibration_datav3.txt.
All quants were generated/calibrated with the imatrix, including the K quants.
Quantized from BF16.
- Downloads last month
- 252
Hardware compatibility
Log In
to view the estimation
2-bit
3-bit
4-bit
5-bit
6-bit
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for redponike/Apriel-Nemotron-15b-Thinker-GGUF
Base model
ServiceNow-AI/Apriel-Nemotron-15b-Thinker