Mark Kurtz

markurtz's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic over 1 year ago

What is the difference between this and "neuralmagic/Meta-Llama-3.1-8B-Instruct-FP8"

1

#1 opened over 1 year ago by

RonanMcGovern

commented a paper over 1 year ago

"Give Me BF16 or Give Me Death"? Accuracy-Performance Trade-Offs in LLM Quantization

Paper • 2411.02355 • Published Nov 4, 2024 • 52 •

3

New activity in RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-FP8-dynamic over 1 year ago

Can you please add Nemotron 70B static?

3

#1 opened over 1 year ago by

nickandbro

New activity in RedHatAI/Phi-3-mini-128k-instruct-FP8 almost 2 years ago

Prompt format in `tokenizer_config.json`

3

#1 opened almost 2 years ago by

justinthelaw

New activity in RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a16 almost 2 years ago

Language support

1

#1 opened almost 2 years ago by

ashbo