Hugging Face's logo
Robert Shaw's picture
16 6 4

Robert Shaw

robertgshaw2
herMaster's profile picture joennlae's profile picture brwoodside's profile picture
·

AI & ML interests

None yet

Recent Activity

new activity about 1 month ago
nm-testing/pixtral-12b-w4a16-actorder-group:What is an actorder group and what are the advantages of running this in vLLM?
new activity about 2 months ago
neuralmagic/Sparse-Llama-3.1-8B-2of4:Can I apply a LoRA?
new activity about 2 months ago
nm-testing/Llama-3.3-70B-Instruct-FP8-dynamic:Nice model, any info on scripts used to quantize?
View all activity

Organizations

HeavyAI's profile picture Neural Magic's profile picture Revel Labs's profile picture NM Testing's profile picture Red Hat's profile picture

robertgshaw2's activity

New activity in nm-testing/pixtral-12b-w4a16-actorder-group about 1 month ago

What is an actorder group and what are the advantages of running this in vLLM?

4
#1 opened about 1 month ago by
nickandbro
New activity in neuralmagic/Sparse-Llama-3.1-8B-2of4 about 2 months ago

Can I apply a LoRA?

2
#1 opened about 2 months ago by
RonanMcGovern
New activity in nm-testing/Llama-3.3-70B-Instruct-FP8-dynamic about 2 months ago

Nice model, any info on scripts used to quantize?

1
#1 opened about 2 months ago by
RonanMcGovern
updated a model 2 months ago
upvoted a paper 3 months ago
New activity in neuralmagic/Meta-Llama-3-8B-Instruct-FP8 4 months ago

How to download the model with transformer library

5
#6 opened 4 months ago by
Rick10
New activity in mistralai/Pixtral-12B-2409 4 months ago

Update README.md

3
#25 opened 4 months ago by
robertgshaw2
updated a model 4 months ago
upvoted a collection 4 months ago
New activity in neuralmagic/Meta-Llama-3.1-70B-Instruct-FP8 4 months ago

Issue running on vLLM using FP8

2
#3 opened 4 months ago by
ffleandro
updated a model 4 months ago
New activity in neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a8 5 months ago

vllm says the requested model does not exist

2
#1 opened 5 months ago by
shivams101
New activity in neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w4a16 5 months ago

Storage format differs from other w4a16 models

2
#2 opened 5 months ago by
timdettmers
New activity in neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a16 5 months ago

Model weights are not loaded

4
#3 opened 5 months ago by
MarvelousMouse
updated 2 models 7 months ago
New activity in neuralmagic/Mistral-Nemo-Instruct-2407-FP8 7 months ago

Can not be inferenced with vllm openai server

1
#1 opened 7 months ago by
jjqsdq
updated 3 models 7 months ago