Hugging Face's logo

qualcomm
/
Yolo-v7

Object Detection
PyTorch
real_time
android
Model card Files
xet
Community
qaihm-bot commited on
Commit
42fdfd8
·
verified ·
1 Parent(s): 98a90cd

v0.38.0

Browse files

See https://github.com/quic/ai-hub-models/releases/v0.38.0 for changelog.

Files changed (1) hide show
  1. README.md +79 -87
README.md CHANGED
@@ -38,92 +38,84 @@ More details on model performance across various devices, can be found
38
 
39
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
40
  |---|---|---|---|---|---|---|---|---|
41
- | Yolo-v7 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 24.69 ms | 1 - 118 MB | NPU | -- |
42
- | Yolo-v7 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 23.017 ms | 5 - 136 MB | NPU | -- |
43
- | Yolo-v7 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 12.899 ms | 1 - 48 MB | NPU | -- |
44
- | Yolo-v7 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 13.272 ms | 5 - 43 MB | NPU | -- |
45
- | Yolo-v7 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 9.495 ms | 0 - 100 MB | NPU | -- |
46
- | Yolo-v7 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 10.461 ms | 3 - 32 MB | NPU | -- |
47
- | Yolo-v7 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 10.52 ms | 0 - 48 MB | NPU | -- |
48
- | Yolo-v7 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 11.354 ms | 1 - 117 MB | NPU | -- |
49
- | Yolo-v7 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 10.502 ms | 2 - 130 MB | NPU | -- |
50
- | Yolo-v7 | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 24.69 ms | 1 - 118 MB | NPU | -- |
51
- | Yolo-v7 | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 23.017 ms | 5 - 136 MB | NPU | -- |
52
- | Yolo-v7 | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 9.471 ms | 0 - 101 MB | NPU | -- |
53
- | Yolo-v7 | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 10.432 ms | 5 - 21 MB | NPU | -- |
54
- | Yolo-v7 | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 14.446 ms | 1 - 40 MB | NPU | -- |
55
- | Yolo-v7 | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 11.804 ms | 2 - 42 MB | NPU | -- |
56
- | Yolo-v7 | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 9.481 ms | 0 - 102 MB | NPU | -- |
57
- | Yolo-v7 | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 10.461 ms | 5 - 21 MB | NPU | -- |
58
- | Yolo-v7 | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 11.354 ms | 1 - 117 MB | NPU | -- |
59
- | Yolo-v7 | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 10.502 ms | 2 - 130 MB | NPU | -- |
60
- | Yolo-v7 | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 9.408 ms | 0 - 103 MB | NPU | -- |
61
- | Yolo-v7 | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 10.539 ms | 5 - 21 MB | NPU | -- |
62
- | Yolo-v7 | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 10.612 ms | 0 - 40 MB | NPU | -- |
63
- | Yolo-v7 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 6.7 ms | 8 - 221 MB | NPU | -- |
64
- | Yolo-v7 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 6.008 ms | 5 - 313 MB | NPU | -- |
65
- | Yolo-v7 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 7.683 ms | 5 - 227 MB | NPU | -- |
66
- | Yolo-v7 | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 7.059 ms | 1 - 116 MB | NPU | -- |
67
- | Yolo-v7 | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 5.878 ms | 5 - 128 MB | NPU | -- |
68
- | Yolo-v7 | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 6.636 ms | 5 - 136 MB | NPU | -- |
69
- | Yolo-v7 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 11.142 ms | 210 - 210 MB | NPU | -- |
70
- | Yolo-v7 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 12.352 ms | 8 - 8 MB | NPU | -- |
71
- | Yolo-v7 | w8a16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 18.123 ms | 2 - 37 MB | NPU | -- |
72
- | Yolo-v7 | w8a16 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 12.229 ms | 2 - 54 MB | NPU | -- |
73
- | Yolo-v7 | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 9.433 ms | 2 - 16 MB | NPU | -- |
74
- | Yolo-v7 | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 120.182 ms | 17 - 382 MB | NPU | -- |
75
- | Yolo-v7 | w8a16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 10.283 ms | 2 - 39 MB | NPU | -- |
76
- | Yolo-v7 | w8a16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 23.85 ms | 2 - 43 MB | NPU | -- |
77
- | Yolo-v7 | w8a16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 210.86 ms | 85 - 100 MB | CPU | -- |
78
- | Yolo-v7 | w8a16 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 184.504 ms | 77 - 88 MB | CPU | -- |
79
- | Yolo-v7 | w8a16 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 18.123 ms | 2 - 37 MB | NPU | -- |
80
- | Yolo-v7 | w8a16 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 9.405 ms | 2 - 15 MB | NPU | -- |
81
- | Yolo-v7 | w8a16 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 11.982 ms | 2 - 50 MB | NPU | -- |
82
- | Yolo-v7 | w8a16 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 9.433 ms | 2 - 14 MB | NPU | -- |
83
- | Yolo-v7 | w8a16 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 10.283 ms | 2 - 39 MB | NPU | -- |
84
- | Yolo-v7 | w8a16 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 9.443 ms | 2 - 18 MB | NPU | -- |
85
- | Yolo-v7 | w8a16 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 122.948 ms | 43 - 373 MB | NPU | -- |
86
- | Yolo-v7 | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 5.124 ms | 2 - 53 MB | NPU | -- |
87
- | Yolo-v7 | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 92.731 ms | 37 - 1273 MB | NPU | -- |
88
- | Yolo-v7 | w8a16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 4.979 ms | 2 - 46 MB | NPU | -- |
89
- | Yolo-v7 | w8a16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 91.176 ms | 54 - 1814 MB | NPU | -- |
90
- | Yolo-v7 | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 7.915 ms | 12 - 12 MB | NPU | -- |
91
- | Yolo-v7 | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 116.555 ms | 58 - 58 MB | NPU | -- |
92
- | Yolo-v7 | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 5.567 ms | 0 - 27 MB | NPU | -- |
93
- | Yolo-v7 | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 4.303 ms | 1 - 30 MB | NPU | -- |
94
- | Yolo-v7 | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 3.315 ms | 0 - 49 MB | NPU | -- |
95
- | Yolo-v7 | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 2.742 ms | 1 - 47 MB | NPU | -- |
96
- | Yolo-v7 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 2.617 ms | 0 - 32 MB | NPU | -- |
97
- | Yolo-v7 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 1.914 ms | 1 - 11 MB | NPU | -- |
98
- | Yolo-v7 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 3.839 ms | 0 - 93 MB | NPU | -- |
99
- | Yolo-v7 | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 3.053 ms | 0 - 27 MB | NPU | -- |
100
- | Yolo-v7 | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 2.361 ms | 1 - 31 MB | NPU | -- |
101
- | Yolo-v7 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 19.88 ms | 8 - 56 MB | NPU | -- |
102
- | Yolo-v7 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 8.683 ms | 1 - 38 MB | NPU | -- |
103
- | Yolo-v7 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 57.963 ms | 38 - 54 MB | CPU | -- |
104
- | Yolo-v7 | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 114.496 ms | 18 - 48 MB | GPU | -- |
105
- | Yolo-v7 | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 50.506 ms | 35 - 46 MB | CPU | -- |
106
- | Yolo-v7 | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 5.567 ms | 0 - 27 MB | NPU | -- |
107
- | Yolo-v7 | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 4.303 ms | 1 - 30 MB | NPU | -- |
108
- | Yolo-v7 | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 2.621 ms | 0 - 8 MB | NPU | -- |
109
- | Yolo-v7 | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 1.918 ms | 1 - 14 MB | NPU | -- |
110
- | Yolo-v7 | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 4.344 ms | 0 - 35 MB | NPU | -- |
111
- | Yolo-v7 | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 3.251 ms | 1 - 37 MB | NPU | -- |
112
- | Yolo-v7 | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 2.626 ms | 0 - 33 MB | NPU | -- |
113
- | Yolo-v7 | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 1.912 ms | 0 - 9 MB | NPU | -- |
114
- | Yolo-v7 | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 3.053 ms | 0 - 27 MB | NPU | -- |
115
- | Yolo-v7 | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 2.361 ms | 1 - 31 MB | NPU | -- |
116
- | Yolo-v7 | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 2.668 ms | 0 - 22 MB | NPU | -- |
117
- | Yolo-v7 | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 1.915 ms | 1 - 13 MB | NPU | -- |
118
- | Yolo-v7 | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 3.864 ms | 0 - 103 MB | NPU | -- |
119
- | Yolo-v7 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 1.752 ms | 0 - 40 MB | NPU | -- |
120
- | Yolo-v7 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 1.287 ms | 1 - 47 MB | NPU | -- |
121
- | Yolo-v7 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 2.718 ms | 0 - 348 MB | NPU | -- |
122
- | Yolo-v7 | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 1.608 ms | 0 - 29 MB | NPU | -- |
123
- | Yolo-v7 | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 1.175 ms | 1 - 37 MB | NPU | -- |
124
- | Yolo-v7 | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 2.567 ms | 1 - 131 MB | NPU | -- |
125
- | Yolo-v7 | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 2.188 ms | 22 - 22 MB | NPU | -- |
126
- | Yolo-v7 | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 3.848 ms | 6 - 6 MB | NPU | -- |
127
 
128
 
129
 
@@ -205,7 +197,7 @@ from qai_hub_models.models.yolov7 import Model
205
  torch_model = Model.from_pretrained()
206
 
207
  # Device
208
- device = hub.Device("Samsung Galaxy S24")
209
 
210
  # Trace model
211
  input_shape = torch_model.get_input_spec()
 
38
 
39
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
40
  |---|---|---|---|---|---|---|---|---|
41
+ | Yolo-v7 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 26.953 ms | 1 - 127 MB | NPU | -- |
42
+ | Yolo-v7 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 21.079 ms | 2 - 131 MB | NPU | -- |
43
+ | Yolo-v7 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 11.046 ms | 1 - 49 MB | NPU | -- |
44
+ | Yolo-v7 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 13.655 ms | 5 - 45 MB | NPU | -- |
45
+ | Yolo-v7 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 10.855 ms | 0 - 112 MB | NPU | -- |
46
+ | Yolo-v7 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 10.48 ms | 5 - 27 MB | NPU | -- |
47
+ | Yolo-v7 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 10.107 ms | 0 - 133 MB | NPU | -- |
48
+ | Yolo-v7 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 12.508 ms | 1 - 127 MB | NPU | -- |
49
+ | Yolo-v7 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 10.433 ms | 3 - 130 MB | NPU | -- |
50
+ | Yolo-v7 | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 26.953 ms | 1 - 127 MB | NPU | -- |
51
+ | Yolo-v7 | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 21.079 ms | 2 - 131 MB | NPU | -- |
52
+ | Yolo-v7 | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 10.895 ms | 0 - 127 MB | NPU | -- |
53
+ | Yolo-v7 | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 10.517 ms | 5 - 21 MB | NPU | -- |
54
+ | Yolo-v7 | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 12.75 ms | 1 - 40 MB | NPU | -- |
55
+ | Yolo-v7 | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 11.897 ms | 2 - 44 MB | NPU | -- |
56
+ | Yolo-v7 | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 10.84 ms | 0 - 135 MB | NPU | -- |
57
+ | Yolo-v7 | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 10.473 ms | 5 - 24 MB | NPU | -- |
58
+ | Yolo-v7 | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 12.508 ms | 1 - 127 MB | NPU | -- |
59
+ | Yolo-v7 | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 10.433 ms | 3 - 130 MB | NPU | -- |
60
+ | Yolo-v7 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 7.496 ms | 0 - 254 MB | NPU | -- |
61
+ | Yolo-v7 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 7.063 ms | 4 - 298 MB | NPU | -- |
62
+ | Yolo-v7 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 6.94 ms | 5 - 321 MB | NPU | -- |
63
+ | Yolo-v7 | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 6.251 ms | 1 - 109 MB | NPU | -- |
64
+ | Yolo-v7 | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 4.977 ms | 5 - 133 MB | NPU | -- |
65
+ | Yolo-v7 | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 6.938 ms | 0 - 125 MB | NPU | -- |
66
+ | Yolo-v7 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 11.128 ms | 222 - 222 MB | NPU | -- |
67
+ | Yolo-v7 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 10.752 ms | 9 - 9 MB | NPU | -- |
68
+ | Yolo-v7 | w8a16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 14.805 ms | 2 - 38 MB | NPU | -- |
69
+ | Yolo-v7 | w8a16 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 12.172 ms | 2 - 57 MB | NPU | -- |
70
+ | Yolo-v7 | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 9.574 ms | 2 - 14 MB | NPU | -- |
71
+ | Yolo-v7 | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 113.132 ms | 29 - 378 MB | NPU | -- |
72
+ | Yolo-v7 | w8a16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 10.16 ms | 2 - 39 MB | NPU | -- |
73
+ | Yolo-v7 | w8a16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 23.692 ms | 2 - 44 MB | NPU | -- |
74
+ | Yolo-v7 | w8a16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 227.488 ms | 60 - 73 MB | CPU | -- |
75
+ | Yolo-v7 | w8a16 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 180.52 ms | 79 - 91 MB | CPU | -- |
76
+ | Yolo-v7 | w8a16 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 14.805 ms | 2 - 38 MB | NPU | -- |
77
+ | Yolo-v7 | w8a16 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 9.583 ms | 2 - 14 MB | NPU | -- |
78
+ | Yolo-v7 | w8a16 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 12.001 ms | 2 - 51 MB | NPU | -- |
79
+ | Yolo-v7 | w8a16 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 9.577 ms | 2 - 14 MB | NPU | -- |
80
+ | Yolo-v7 | w8a16 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 10.16 ms | 2 - 39 MB | NPU | -- |
81
+ | Yolo-v7 | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 5.166 ms | 2 - 51 MB | NPU | -- |
82
+ | Yolo-v7 | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 93.143 ms | 39 - 1739 MB | NPU | -- |
83
+ | Yolo-v7 | w8a16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 5.559 ms | 2 - 46 MB | NPU | -- |
84
+ | Yolo-v7 | w8a16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 82.7 ms | 51 - 1813 MB | NPU | -- |
85
+ | Yolo-v7 | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 9.957 ms | 17 - 17 MB | NPU | -- |
86
+ | Yolo-v7 | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 109.781 ms | 56 - 56 MB | NPU | -- |
87
+ | Yolo-v7 | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 5.574 ms | 0 - 28 MB | NPU | -- |
88
+ | Yolo-v7 | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 4.288 ms | 1 - 30 MB | NPU | -- |
89
+ | Yolo-v7 | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 3.421 ms | 0 - 48 MB | NPU | -- |
90
+ | Yolo-v7 | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 2.799 ms | 1 - 46 MB | NPU | -- |
91
+ | Yolo-v7 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 2.67 ms | 0 - 32 MB | NPU | -- |
92
+ | Yolo-v7 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 1.915 ms | 1 - 13 MB | NPU | -- |
93
+ | Yolo-v7 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 3.608 ms | 0 - 48 MB | NPU | -- |
94
+ | Yolo-v7 | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 3.077 ms | 0 - 28 MB | NPU | -- |
95
+ | Yolo-v7 | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 2.375 ms | 0 - 30 MB | NPU | -- |
96
+ | Yolo-v7 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 20.561 ms | 8 - 54 MB | NPU | -- |
97
+ | Yolo-v7 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 8.568 ms | 1 - 39 MB | NPU | -- |
98
+ | Yolo-v7 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 57.194 ms | 36 - 51 MB | CPU | -- |
99
+ | Yolo-v7 | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 127.355 ms | 17 - 47 MB | GPU | -- |
100
+ | Yolo-v7 | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 51.618 ms | 35 - 45 MB | CPU | -- |
101
+ | Yolo-v7 | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 5.574 ms | 0 - 28 MB | NPU | -- |
102
+ | Yolo-v7 | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 4.288 ms | 1 - 30 MB | NPU | -- |
103
+ | Yolo-v7 | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 2.671 ms | 0 - 33 MB | NPU | -- |
104
+ | Yolo-v7 | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 1.917 ms | 1 - 17 MB | NPU | -- |
105
+ | Yolo-v7 | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 4.322 ms | 0 - 35 MB | NPU | -- |
106
+ | Yolo-v7 | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 3.281 ms | 1 - 37 MB | NPU | -- |
107
+ | Yolo-v7 | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 2.625 ms | 5 - 36 MB | NPU | -- |
108
+ | Yolo-v7 | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 1.917 ms | 2 - 15 MB | NPU | -- |
109
+ | Yolo-v7 | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 3.077 ms | 0 - 28 MB | NPU | -- |
110
+ | Yolo-v7 | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 2.375 ms | 0 - 30 MB | NPU | -- |
111
+ | Yolo-v7 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 1.748 ms | 0 - 43 MB | NPU | -- |
112
+ | Yolo-v7 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 1.293 ms | 1 - 48 MB | NPU | -- |
113
+ | Yolo-v7 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 2.523 ms | 0 - 208 MB | NPU | -- |
114
+ | Yolo-v7 | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 1.343 ms | 0 - 31 MB | NPU | -- |
115
+ | Yolo-v7 | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 0.981 ms | 1 - 34 MB | NPU | -- |
116
+ | Yolo-v7 | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 2.122 ms | 0 - 148 MB | NPU | -- |
117
+ | Yolo-v7 | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 2.163 ms | 22 - 22 MB | NPU | -- |
118
+ | Yolo-v7 | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 3.648 ms | 5 - 5 MB | NPU | -- |
 
 
 
 
 
 
 
 
119
 
120
 
121
 
 
197
  torch_model = Model.from_pretrained()
198
 
199
  # Device
200
+ device = hub.Device("Samsung Galaxy S25")
201
 
202
  # Trace model
203
  input_shape = torch_model.get_input_spec()