10 9 35

Haihao Shen

Haihao

https://github.com/intel/auto-round

AI & ML interests

LLM quantization, sparsity, and acceleration

Articles

Building Cost-Efficient Enterprise RAG applications with Intel Gaudi 2 and Intel Xeon

May 9

• 11

Accelerate StarCoder with 🤗 Optimum Intel on Xeon: Q8/Q4 and Speculative Decoding

Jan 30

• 4

Organizations

Haihao's activity

liked a model 4 months ago

Intel/Meta-Llama-3.1-8B-Instruct-int4-inc

Updated Aug 29 • 2

liked a model 5 months ago

Intel/neural-embedding-v1

Updated Jun 26 • 13

liked 2 spaces 6 months ago

Running

📈

Shanghainese TTS

Running

145

🏆

Low-bit Quantized Open LLM Leaderboard

Track, rank and evaluate open LLMs and chatbots

liked a model 8 months ago

Intel/phi-2-int4-inc

Text Generation • Updated 26 days ago • 36 • 2

liked a space 8 months ago

Running on CPU Upgrade

🥇

HHEM Leaderboard

liked 2 models 9 months ago

Intel/neural-chat-7b-v3-1-int4-inc

Text Generation • Updated Aug 26 • 35 • 2

Intel/neural-chat-7b-v3-3-int4-inc

Text Generation • Updated Aug 26 • 16 • 3

liked 2 models 11 months ago

Intel/neural-chat-7b-v3-3

Text Generation • Updated 6 days ago • 54.4k • 75

Bilic/NeuralChat-finetuned-for-fraud-detection

Text Generation • Updated Dec 19, 2023 • 19 • 2

liked a model 12 months ago

Intel/neural-chat-7b-v3-2

Text Generation • Updated Feb 22 • 1.57k • 56

liked a dataset 12 months ago

Intel/orca_dpo_pairs

Viewer • Updated Nov 29, 2023 • 12.9k • 1.17k • 290

liked 4 spaces 12 months ago

Runtime error

🏃

Intel Neural Chat 7b V3 1

liked 4 models about 1 year ago

Intel/neural-chat-7b-v3-1

Text Generation • Updated Sep 9 • 5.43k • 545

Intel/neural-chat-7b-v3

Text Generation • Updated 3 days ago • 180 • 67

Intel/whisper-tiny-onnx-int4-inc

Automatic Speech Recognition • Updated Oct 16, 2023 • 14 • 7

Intel/whisper-small-onnx-int4-inc

Automatic Speech Recognition • Updated Oct 16, 2023 • 3 • 2