Hugging Face's logo
Munish Kumar's picture
43 5 563

Munish Kumar

munish0838
anujga's profile picture Jaishak's profile picture neoopus's profile picture
·
https://hf.co/QuantFactory

AI & ML interests

LLM Quantizations

Recent Activity

updated a model 3 days ago
QuantFactory/DeepCoder-14B-Preview-GGUF
liked a model 4 days ago
QuantFactory/DeepCoder-14B-Preview-GGUF
published a model 4 days ago
QuantFactory/DeepCoder-14B-Preview-GGUF
View all activity

Organizations

Open-Source AI Meetup's profile picture Blog-explorers's profile picture Indic Benchmarks's profile picture Quant Factory's profile picture Hugging Face Discord Community's profile picture Dataset Tools's profile picture Data Is Better Together Contributor's profile picture AI Classroom's profile picture

munish0838's activity

New activity in OpenMeditron/Meditron3-Gemma2-2B 3 months ago

GGUF

3
#1 opened 3 months ago by
amogusgaysex
New activity in QuantFactory/Ministral-3b-instruct-GGUF 6 months ago

Heads up: this isn't the new ministral 3b

2
2
#1 opened 6 months ago by
bartowski
New activity in QuantFactory/LLAMA-3_8B_Unaligned_BETA-GGUF 6 months ago

Requesting Re-Quant. Tokenizer Updated with better chatml Support

1
#1 opened 6 months ago by
Luni
New activity in QuantFactory/Mistral-Nemo-Instruct-2407-GGUF 9 months ago

Error loading model in llama.cpp ?

8
#1 opened 9 months ago by
ubergarm
New activity in QuantFactory/internistai-base-7b-v0.2-GGUF 9 months ago

Add paper and citation
#1 opened 9 months ago by
maximegmd
New activity in munish0838/Gemma2-9b-Matter-0.1-Slim-A 10 months ago

Adding `safetensors` variant of this model
#1 opened 10 months ago by
SFconvertbot
New activity in munish0838/Phi-3-mini-4k-instruct-Matter-0.1-Slim-A 10 months ago

Adding `safetensors` variant of this model
#1 opened 10 months ago by
SFconvertbot
New activity in munish0838/llama-3-8b-Instruct-Matter-0.1-Slim-A 10 months ago

Adding `safetensors` variant of this model
#1 opened 10 months ago by
SFconvertbot
New activity in munish0838/Mistral-v0.3-Instruct-Matter-Slim-A 10 months ago

Adding `safetensors` variant of this model
#1 opened 10 months ago by
SFconvertbot
New activity in QuantFactory/dolphin-2.9-llama3-8b-GGUF 10 months ago

What am I doing wrong? Using Oobabooga.

3
#1 opened 12 months ago by
Goldenblood56

does not appear to have a file named config.json

2
#2 opened 12 months ago by
atubong
New activity in QuantFactory/Meta-Llama-3-8B-Instruct-GGUF 10 months ago

Compatibility with llama-cpp and Ollama

6
#17 opened 11 months ago by
liashchynskyi
New activity in QuantFactory/Llama-3-Alpha-Ko-8B-Instruct-GGUF 11 months ago

Is the original model allganize/Llama-3-Alpha-Ko-8B-Instruct?

3
#1 opened 11 months ago by
coconut00
New activity in QuantFactory/Phi-3-mini-128k-instruct-GGUF 11 months ago

error when loading the model

5
#3 opened 11 months ago by
StefanStroescu
New activity in mistralai/Codestral-22B-v0.1 11 months ago

How to convert to HF format?

8
5
#6 opened 11 months ago by
ddh0
New activity in internlm/internlm2-math-plus-1_8b 11 months ago

Rename configuration_internlm.py to configuration_internlm2.py
#1 opened 11 months ago by
munish0838
New activity in internlm/internlm2-math-plus-7b 11 months ago

Rename configuration_internlm.py to configuration_internlm2.py
#1 opened 11 months ago by
munish0838
New activity in QuantFactory/Phi-3-mini-128k-instruct-GGUF 11 months ago

I have now tried two quantizations 8_0, and 6_K, they both fail like you see below.

3
#2 opened 12 months ago by
BigDeeper

Working with llama cpp ?

4
#1 opened 12 months ago by
ivanpzk
New activity in QuantFactory/Meta-Llama-3-8B-Instruct-GGUF 11 months ago

This quantized Llama3 cannot answer in different language like original Meta Llama3 model

1
#16 opened 11 months ago by
taiSupermicro