44 5 622

Munish Kumar

munish0838

https://hf.co/QuantFactory

AI & ML interests

LLM Quantizations

Recent Activity

liked a model 2 days ago

QuantFactory/Art-0-8B-GGUF

published a model 2 days ago

QuantFactory/Art-0-8B-GGUF

published a model 2 days ago

QuantFactory/WEBGEN-4B-Preview-GGUF

View all activity

Organizations

New activity in QuantFactory/Ahma-3B-GGUF 2 months ago

Improve model card: Add GGUF usage, paper link, and correct metadata

#1 opened 2 months ago by

nielsr

New activity in OpenMeditron/Meditron3-Gemma2-2B 8 months ago

GGUF

#1 opened 8 months ago by

amogusgaysex

New activity in QuantFactory/Ministral-3b-instruct-GGUF 11 months ago

Heads up: this isn't the new ministral 3b

👍 2

#1 opened 11 months ago by

bartowski

New activity in QuantFactory/LLAMA-3_8B_Unaligned_BETA-GGUF 11 months ago

Requesting Re-Quant. Tokenizer Updated with better chatml Support

#1 opened 11 months ago by

Luni

New activity in QuantFactory/Mistral-Nemo-Instruct-2407-GGUF about 1 year ago

Error loading model in llama.cpp ?

#1 opened about 1 year ago by

ubergarm

New activity in QuantFactory/internistai-base-7b-v0.2-GGUF about 1 year ago

Add paper and citation

#1 opened about 1 year ago by

maximegmd

New activity in munish0838/Gemma2-9b-Matter-0.1-Slim-A about 1 year ago

Adding `safetensors` variant of this model

#1 opened about 1 year ago by

SFconvertbot

New activity in munish0838/Phi-3-mini-4k-instruct-Matter-0.1-Slim-A about 1 year ago

Adding `safetensors` variant of this model

#1 opened about 1 year ago by

SFconvertbot

New activity in munish0838/llama-3-8b-Instruct-Matter-0.1-Slim-A about 1 year ago

Adding `safetensors` variant of this model

#1 opened about 1 year ago by

SFconvertbot

New activity in munish0838/Mistral-v0.3-Instruct-Matter-Slim-A about 1 year ago

Adding `safetensors` variant of this model

#1 opened about 1 year ago by

SFconvertbot

New activity in QuantFactory/dolphin-2.9-llama3-8b-GGUF over 1 year ago

What am I doing wrong? Using Oobabooga.

#1 opened over 1 year ago by

Goldenblood56

does not appear to have a file named config.json

#2 opened over 1 year ago by

atubong

New activity in QuantFactory/Meta-Llama-3-8B-Instruct-GGUF over 1 year ago

Compatibility with llama-cpp and Ollama

#17 opened over 1 year ago by

liashchynskyi

New activity in QuantFactory/Llama-3-Alpha-Ko-8B-Instruct-GGUF over 1 year ago

Is the original model allganize/Llama-3-Alpha-Ko-8B-Instruct?

#1 opened over 1 year ago by

coconut00

New activity in QuantFactory/Phi-3-mini-128k-instruct-GGUF over 1 year ago

error when loading the model

#3 opened over 1 year ago by

StefanStroescu

New activity in mistralai/Codestral-22B-v0.1 over 1 year ago

How to convert to HF format?

➕ 👀 8

#6 opened over 1 year ago by

ddh0

New activity in internlm/internlm2-math-plus-1_8b over 1 year ago

Rename configuration_internlm.py to configuration_internlm2.py

#1 opened over 1 year ago by

munish0838

New activity in internlm/internlm2-math-plus-7b over 1 year ago

Rename configuration_internlm.py to configuration_internlm2.py

#1 opened over 1 year ago by

munish0838

New activity in QuantFactory/Phi-3-mini-128k-instruct-GGUF over 1 year ago

I have now tried two quantizations 8_0, and 6_K, they both fail like you see below.

#2 opened over 1 year ago by

BigDeeper

Working with llama cpp ?

#1 opened over 1 year ago by

ivanpzk

Munish Kumar

AI & ML interests

Recent Activity

Organizations

munish0838's activity

Improve model card: Add GGUF usage, paper link, and correct metadata

GGUF

Heads up: this isn't the new ministral 3b

Requesting Re-Quant. Tokenizer Updated with better chatml Support

Error loading model in llama.cpp ?

Add paper and citation

Adding `safetensors` variant of this model

Adding `safetensors` variant of this model

Adding `safetensors` variant of this model

Adding `safetensors` variant of this model

What am I doing wrong? Using Oobabooga.

does not appear to have a file named config.json

Compatibility with llama-cpp and Ollama

Is the original model allganize/Llama-3-Alpha-Ko-8B-Instruct?

error when loading the model

How to convert to HF format?

Rename configuration_internlm.py to configuration_internlm2.py

Rename configuration_internlm.py to configuration_internlm2.py

I have now tried two quantizations 8_0, and 6_K, they both fail like you see below.

Working with llama cpp ?