Hugging Face's logo
Munish Kumar's picture
42 5 417

Munish Kumar

munish0838
siaoght's profile picture jaxmetaverse's profile picture 21world's profile picture
·
https://hf.co/QuantFactory

AI & ML interests

LLM Quantizations

Organizations

Blog-explorers's profile picture Indic Benchmarks's profile picture Quant Factory's profile picture Data Is Better Together's profile picture Hugging Face Discord Community's profile picture

munish0838's activity

New activity in QuantFactory/Ministral-3b-instruct-GGUF 28 days ago

Heads up: this isn't the new ministral 3b

2
#1 opened about 1 month ago by bartowski
New activity in QuantFactory/LLAMA-3_8B_Unaligned_BETA-GGUF about 1 month ago

Requesting Re-Quant. Tokenizer Updated with better chatml Support

1
#1 opened about 1 month ago by Luni
New activity in QuantFactory/quant-req 3 months ago

Update app.py
#2 opened 3 months ago by munish0838
New activity in QuantFactory/Mistral-Nemo-Instruct-2407-GGUF 4 months ago

Error loading model in llama.cpp ?

8
#1 opened 4 months ago by ubergarm
New activity in QuantFactory/internistai-base-7b-v0.2-GGUF 4 months ago

Add paper and citation
#1 opened 4 months ago by maximegmd
New activity in munish0838/Gemma2-9b-Matter-0.1-Slim-A 5 months ago

Adding `safetensors` variant of this model
#1 opened 5 months ago by SFconvertbot
New activity in munish0838/Phi-3-mini-4k-instruct-Matter-0.1-Slim-A 5 months ago

Adding `safetensors` variant of this model
#1 opened 5 months ago by SFconvertbot
New activity in munish0838/llama-3-8b-Instruct-Matter-0.1-Slim-A 5 months ago

Adding `safetensors` variant of this model
#1 opened 5 months ago by SFconvertbot
New activity in munish0838/Mistral-v0.3-Instruct-Matter-Slim-A 5 months ago

Adding `safetensors` variant of this model
#1 opened 5 months ago by SFconvertbot
New activity in instruction-pretrain/medicine-Llama3-8B 5 months ago

Tokenizer files missing

4
#2 opened 5 months ago by munish0838

Unable to use model

2
#1 opened 5 months ago by munish0838
New activity in QuantFactory/dolphin-2.9-llama3-8b-GGUF 5 months ago

What am I doing wrong? Using Oobabooga.

3
#1 opened 7 months ago by Goldenblood56

does not appear to have a file named config.json

2
#2 opened 7 months ago by atubong
New activity in QuantFactory/Meta-Llama-3-8B-Instruct-GGUF 5 months ago

Compatibility with llama-cpp and Ollama

6
#17 opened 6 months ago by liashchynskyi
New activity in QuantFactory/Llama-3-Alpha-Ko-8B-Instruct-GGUF 6 months ago

Is the original model allganize/Llama-3-Alpha-Ko-8B-Instruct?

3
#1 opened 6 months ago by coconut00
New activity in QuantFactory/Phi-3-mini-128k-instruct-GGUF 6 months ago

error when loading the model

5
#3 opened 6 months ago by StefanStroescu
New activity in mistralai/Codestral-22B-v0.1 6 months ago

How to convert to HF format?

5
#6 opened 6 months ago by ddh0
New activity in internlm/internlm2-math-plus-1_8b 6 months ago

Rename configuration_internlm.py to configuration_internlm2.py
#1 opened 6 months ago by munish0838
New activity in internlm/internlm2-math-plus-7b 6 months ago

Rename configuration_internlm.py to configuration_internlm2.py
#1 opened 6 months ago by munish0838
New activity in QuantFactory/Phi-3-mini-128k-instruct-GGUF 6 months ago

I have now tried two quantizations 8_0, and 6_K, they both fail like you see below.

3
#2 opened 7 months ago by BigDeeper