43 5 608

Munish Kumar

munish0838

https://hf.co/QuantFactory

AI & ML interests

LLM Quantizations

Recent Activity

liked a model 4 days ago

QuantFactory/Peach-2.0-9B-8k-Roleplay-GGUF

published a model 4 days ago

QuantFactory/Peach-2.0-9B-8k-Roleplay-GGUF

liked a model 4 days ago

QuantFactory/llama-3.1-medprm-reward-v1.0-GGUF

View all activity

Organizations

New activity in OpenMeditron/Meditron3-Gemma2-2B 5 months ago

GGUF

#1 opened 5 months ago by

amogusgaysex

New activity in QuantFactory/Ministral-3b-instruct-GGUF 8 months ago

Heads up: this isn't the new ministral 3b

👍 2

#1 opened 8 months ago by

bartowski

New activity in QuantFactory/LLAMA-3_8B_Unaligned_BETA-GGUF 8 months ago

Requesting Re-Quant. Tokenizer Updated with better chatml Support

#1 opened 8 months ago by

Luni

New activity in QuantFactory/Mistral-Nemo-Instruct-2407-GGUF 11 months ago

Error loading model in llama.cpp ?

#1 opened 11 months ago by

ubergarm

New activity in QuantFactory/internistai-base-7b-v0.2-GGUF 12 months ago

Add paper and citation

#1 opened 12 months ago by

maximegmd

New activity in munish0838/Gemma2-9b-Matter-0.1-Slim-A 12 months ago

Adding `safetensors` variant of this model

#1 opened 12 months ago by

SFconvertbot

New activity in munish0838/Phi-3-mini-4k-instruct-Matter-0.1-Slim-A 12 months ago

Adding `safetensors` variant of this model

#1 opened 12 months ago by

SFconvertbot

New activity in munish0838/llama-3-8b-Instruct-Matter-0.1-Slim-A about 1 year ago

Adding `safetensors` variant of this model

#1 opened about 1 year ago by

SFconvertbot

New activity in munish0838/Mistral-v0.3-Instruct-Matter-Slim-A about 1 year ago

Adding `safetensors` variant of this model

#1 opened about 1 year ago by

SFconvertbot

New activity in QuantFactory/dolphin-2.9-llama3-8b-GGUF about 1 year ago

What am I doing wrong? Using Oobabooga.

#1 opened about 1 year ago by

Goldenblood56

does not appear to have a file named config.json

#2 opened about 1 year ago by

atubong

New activity in QuantFactory/Meta-Llama-3-8B-Instruct-GGUF about 1 year ago

Compatibility with llama-cpp and Ollama

#17 opened about 1 year ago by

liashchynskyi

New activity in QuantFactory/Llama-3-Alpha-Ko-8B-Instruct-GGUF about 1 year ago

Is the original model allganize/Llama-3-Alpha-Ko-8B-Instruct?

#1 opened about 1 year ago by

coconut00

New activity in QuantFactory/Phi-3-mini-128k-instruct-GGUF about 1 year ago

error when loading the model

#3 opened about 1 year ago by

StefanStroescu

New activity in mistralai/Codestral-22B-v0.1 about 1 year ago

How to convert to HF format?

➕ 👀 8

#6 opened about 1 year ago by

ddh0

New activity in internlm/internlm2-math-plus-1_8b about 1 year ago

Rename configuration_internlm.py to configuration_internlm2.py

#1 opened about 1 year ago by

munish0838

New activity in internlm/internlm2-math-plus-7b about 1 year ago

Rename configuration_internlm.py to configuration_internlm2.py

#1 opened about 1 year ago by

munish0838

New activity in QuantFactory/Phi-3-mini-128k-instruct-GGUF about 1 year ago

I have now tried two quantizations 8_0, and 6_K, they both fail like you see below.

#2 opened about 1 year ago by

BigDeeper

Working with llama cpp ?

#1 opened about 1 year ago by

ivanpzk

New activity in QuantFactory/Meta-Llama-3-8B-Instruct-GGUF about 1 year ago

This quantized Llama3 cannot answer in different language like original Meta Llama3 model

#16 opened about 1 year ago by

taiSupermicro

Munish Kumar

AI & ML interests

Recent Activity

Organizations

munish0838's activity

GGUF

Heads up: this isn't the new ministral 3b

Requesting Re-Quant. Tokenizer Updated with better chatml Support

Error loading model in llama.cpp ?

Add paper and citation

Adding `safetensors` variant of this model

Adding `safetensors` variant of this model

Adding `safetensors` variant of this model

Adding `safetensors` variant of this model

What am I doing wrong? Using Oobabooga.

does not appear to have a file named config.json

Compatibility with llama-cpp and Ollama

Is the original model allganize/Llama-3-Alpha-Ko-8B-Instruct?

error when loading the model

How to convert to HF format?

Rename configuration_internlm.py to configuration_internlm2.py

Rename configuration_internlm.py to configuration_internlm2.py

I have now tried two quantizations 8_0, and 6_K, they both fail like you see below.

Working with llama cpp ?

This quantized Llama3 cannot answer in different language like original Meta Llama3 model