Hugging Face's logo

qualcomm
/
Qwen2-7B-Instruct

Text Generation
PyTorch
llm
generative_ai
android
Model card Files Community
qaihm-bot commited on
Commit
b48d580
·
verified ·
1 Parent(s): db750d7

v0.31.0

Browse files

See https://github.com/quic/ai-hub-models/releases/v0.31.0 for changelog.

Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -50,7 +50,7 @@ This model is an implementation of Qwen2-7B-Instruct found [here](https://github
50
 
51
  | Model | Precision | Device | Chipset | Target Runtime | Response Rate (tokens per second) | Time To First Token (range, seconds)
52
  |---|---|---|---|---|---|
53
- | Qwen2.5-3B-Instruct | w4a16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN | 13.65 | 0.170593 - 5.458976 | -- | Use Export Script |
54
 
55
  ## Deploying Qwen2-7B-Instruct on-device
56
 
 
50
 
51
  | Model | Precision | Device | Chipset | Target Runtime | Response Rate (tokens per second) | Time To First Token (range, seconds)
52
  |---|---|---|---|---|---|
53
+ | Qwen2.5-3B-Instruct | w4a16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_CONTEXT_BINARY | 13.65 | 0.170593 - 5.458976 | -- | Use Export Script |
54
 
55
  ## Deploying Qwen2-7B-Instruct on-device
56