mgoin/Llama-2-7b-chat-hf-pruned95
Text Generation
•
7B
•
Updated
Michael Goin
mgoin
AI & ML interests
LLM inference optimization, compression, quantization, pruning, distillation
Recent Activity
updated
a model
12 days ago
RedHatAI/Llama-3.2-1B-FP8
new activity
25 days ago
kernels-community/vllm-flash-attn3:Support for B200s?
liked
a model
about 1 month ago
moondream/moondream3-preview
Organizations
mgoin/Llama-2-7b-chat-hf-pruned90
Text Generation
•
7B
•
Updated
mgoin/Llama-2-7b-chat-hf-pruned85
Text Generation
•
7B
•
Updated
mgoin/Llama-2-7b-chat-hf-pruned80
Text Generation
•
7B
•
Updated
mgoin/Llama-2-7b-chat-hf-pruned75
Text Generation
•
7B
•
Updated
mgoin/Hermes-2-Pro-Llama-3-8B-Marlin
Text Generation
•
Updated
•
1
mgoin/Meta-Llama-3-70B-Instruct-Marlin
Text Generation
•
Updated
•
70
•
6
mgoin/Meta-Llama-3-8B-Instruct-Marlin
Text Generation
•
Updated
•
43
mgoin/Meta-Llama-3-70B-Instruct-GPTQ
Text Generation
•
Updated
•
4
•
2
mgoin/Meta-Llama-3-8B-Instruct-GPTQ
Updated
mgoin/TinyLlama-1.1B-Chat-v1.0-pruned50-quant-ds
Text Generation
•
Updated
mgoin/bert-base-rotten-tomatoes-pruned90-quant
Text Classification
•
Updated
mgoin/tiny-random-llama-2-quant
Text Generation
•
104k
•
Updated
mgoin/tiny-random-LlamaForCausalLM-pruned95-compressed
Text Generation
•
1.22M
•
Updated
•
1
mgoin/llama2-125m-95-compressed
Text Generation
•
75.3M
•
Updated
•
1
mgoin/llama2_70b_sparsegpt_2_4_sft_tp1_fp8
Updated
•
1
mgoin/llama2.c-stories15M-quant-pt
Text Generation
•
Updated
•
2
mgoin/Nous-Hermes-2-Yi-34B-pruned50-compressed
Text Generation
•
22B
•
Updated
•
1
mgoin/TinyLlama-1.1B-Chat-v1.0-pruned2.4-test
Text Generation
•
1B
•
Updated
•
3
mgoin/TinyLlama-1.1B-Chat-v1.0-pruned2.4-compressed
Text Generation
•
0.8B
•
Updated
mgoin/phi-2-super-gptq
Text Generation
•
0.6B
•
Updated
mgoin/mistral-7b-gsm8k-gguf
Text Generation
•
7B
•
Updated
•
17
mgoin/all-MiniLM-L6-v2-quant-ds
Feature Extraction
•
Updated
mgoin/all-MiniLM-L6-v2-pruned50-quant-ds
Feature Extraction
•
Updated
•
2
mgoin/Nous-Hermes-2-Yi-34B-pruned50-quant-ds
Text Generation
•
Updated
mgoin/Nous-Hermes-2-Yi-34B-pruned50-quant-pt
Text Generation
•
Updated
•
1
mgoin/llama2-125m-pruned95-quant-ds
Text Generation
•
Updated
mgoin/llama2-125m-95-ds
Text Generation
•
Updated
mgoin/llama2-125m-95
Text Generation
•
0.3B
•
Updated
mgoin/starcoderbase-1b-pruned50
Text Generation
•
Updated
•
1