qaihm-bot commited on
Commit
13133c7
·
verified ·
1 Parent(s): 183cd95

See https://github.com/quic/ai-hub-models/releases/v0.31.0 for changelog.

.gitattributes CHANGED
@@ -33,3 +33,6 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Segformer-Base.dlc filter=lfs diff=lfs merge=lfs -text
37
+ Segformer-Base_w8a16.dlc filter=lfs diff=lfs merge=lfs -text
38
+ Segformer-Base_w8a8.dlc filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -36,71 +36,85 @@ More details on model performance across various devices, can be found
36
 
37
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
38
  |---|---|---|---|---|---|---|---|---|
39
- | Segformer-Base | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 315.099 ms | 9 - 65 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.tflite) |
40
- | Segformer-Base | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN | 321.201 ms | 2 - 11 MB | NPU | Use Export Script |
41
- | Segformer-Base | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 114.238 ms | 9 - 66 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.tflite) |
42
- | Segformer-Base | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN | 121.029 ms | 3 - 55 MB | NPU | Use Export Script |
43
- | Segformer-Base | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 115.018 ms | 0 - 36 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.tflite) |
44
- | Segformer-Base | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN | 116.65 ms | 3 - 6 MB | NPU | Use Export Script |
45
- | Segformer-Base | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 117.193 ms | 9 - 66 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.tflite) |
46
- | Segformer-Base | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN | 119.038 ms | 1 - 10 MB | NPU | Use Export Script |
47
- | Segformer-Base | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 315.099 ms | 9 - 65 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.tflite) |
48
- | Segformer-Base | float | SA7255P ADP | Qualcomm® SA7255P | QNN | 321.201 ms | 2 - 11 MB | NPU | Use Export Script |
49
- | Segformer-Base | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 114.665 ms | 0 - 38 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.tflite) |
50
- | Segformer-Base | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN | 116.561 ms | 3 - 6 MB | NPU | Use Export Script |
51
- | Segformer-Base | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 125.933 ms | 9 - 61 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.tflite) |
52
- | Segformer-Base | float | SA8295P ADP | Qualcomm® SA8295P | QNN | 130.6 ms | 0 - 17 MB | NPU | Use Export Script |
53
- | Segformer-Base | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 114.784 ms | 0 - 33 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.tflite) |
54
- | Segformer-Base | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN | 116.849 ms | 3 - 5 MB | NPU | Use Export Script |
55
- | Segformer-Base | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 117.193 ms | 9 - 66 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.tflite) |
56
- | Segformer-Base | float | SA8775P ADP | Qualcomm® SA8775P | QNN | 119.038 ms | 1 - 10 MB | NPU | Use Export Script |
57
- | Segformer-Base | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 114.86 ms | 0 - 36 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.tflite) |
58
- | Segformer-Base | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN | 116.832 ms | 3 - 18 MB | NPU | Use Export Script |
59
- | Segformer-Base | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 111.55 ms | 19 - 52 MB | NPU | [Segformer-Base.onnx](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.onnx) |
60
- | Segformer-Base | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 86.521 ms | 9 - 75 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.tflite) |
61
- | Segformer-Base | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN | 87.898 ms | 3 - 62 MB | NPU | Use Export Script |
62
- | Segformer-Base | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 83.731 ms | 23 - 81 MB | NPU | [Segformer-Base.onnx](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.onnx) |
63
- | Segformer-Base | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 93.336 ms | 8 - 59 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.tflite) |
64
- | Segformer-Base | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN | 97.56 ms | 3 - 53 MB | NPU | Use Export Script |
65
- | Segformer-Base | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 94.304 ms | 23 - 70 MB | NPU | [Segformer-Base.onnx](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.onnx) |
66
- | Segformer-Base | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 121.73 ms | 3 - 3 MB | NPU | Use Export Script |
67
- | Segformer-Base | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 118.315 ms | 35 - 35 MB | NPU | [Segformer-Base.onnx](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.onnx) |
68
- | Segformer-Base | w8a16 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 40.96 ms | 31 - 99 MB | NPU | [Segformer-Base.onnx](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a16.onnx) |
69
- | Segformer-Base | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 28.528 ms | 28 - 288 MB | NPU | [Segformer-Base.onnx](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a16.onnx) |
70
- | Segformer-Base | w8a16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 31.159 ms | 27 - 239 MB | NPU | [Segformer-Base.onnx](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a16.onnx) |
71
- | Segformer-Base | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 44.24 ms | 58 - 58 MB | NPU | [Segformer-Base.onnx](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a16.onnx) |
72
- | Segformer-Base | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 35.944 ms | 2 - 41 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.tflite) |
73
- | Segformer-Base | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN | 25.442 ms | 1 - 10 MB | NPU | Use Export Script |
74
- | Segformer-Base | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 13.76 ms | 2 - 49 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.tflite) |
75
- | Segformer-Base | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN | 9.382 ms | 1 - 44 MB | NPU | Use Export Script |
76
- | Segformer-Base | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 13.209 ms | 2 - 14 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.tflite) |
77
- | Segformer-Base | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN | 7.852 ms | 1 - 4 MB | NPU | Use Export Script |
78
- | Segformer-Base | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 13.755 ms | 2 - 40 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.tflite) |
79
- | Segformer-Base | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN | 8.462 ms | 1 - 13 MB | NPU | Use Export Script |
80
- | Segformer-Base | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 122.719 ms | 14 - 55 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.tflite) |
81
- | Segformer-Base | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN | 33.447 ms | 1 - 13 MB | NPU | Use Export Script |
82
- | Segformer-Base | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 415.858 ms | 50 - 68 MB | GPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.tflite) |
83
- | Segformer-Base | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 35.944 ms | 2 - 41 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.tflite) |
84
- | Segformer-Base | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN | 25.442 ms | 1 - 10 MB | NPU | Use Export Script |
85
- | Segformer-Base | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 13.24 ms | 2 - 15 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.tflite) |
86
- | Segformer-Base | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN | 7.806 ms | 1 - 4 MB | NPU | Use Export Script |
87
- | Segformer-Base | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 15.501 ms | 2 - 42 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.tflite) |
88
- | Segformer-Base | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN | 9.948 ms | 1 - 18 MB | NPU | Use Export Script |
89
- | Segformer-Base | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 13.25 ms | 2 - 15 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.tflite) |
90
- | Segformer-Base | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN | 7.81 ms | 1 - 3 MB | NPU | Use Export Script |
91
- | Segformer-Base | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 13.755 ms | 2 - 40 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.tflite) |
92
- | Segformer-Base | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN | 8.462 ms | 1 - 13 MB | NPU | Use Export Script |
93
- | Segformer-Base | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 13.244 ms | 2 - 15 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.tflite) |
94
- | Segformer-Base | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN | 7.828 ms | 1 - 12 MB | NPU | Use Export Script |
95
- | Segformer-Base | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 17.979 ms | 3 - 25 MB | NPU | [Segformer-Base.onnx](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.onnx) |
96
- | Segformer-Base | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 9.065 ms | 2 - 52 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.tflite) |
97
- | Segformer-Base | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN | 5.255 ms | 1 - 61 MB | NPU | Use Export Script |
98
- | Segformer-Base | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 12.47 ms | 5 - 66 MB | NPU | [Segformer-Base.onnx](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.onnx) |
99
- | Segformer-Base | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 9.279 ms | 2 - 43 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.tflite) |
100
- | Segformer-Base | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN | 4.788 ms | 1 - 53 MB | NPU | Use Export Script |
101
- | Segformer-Base | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 11.956 ms | 5 - 56 MB | NPU | [Segformer-Base.onnx](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.onnx) |
102
- | Segformer-Base | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 8.692 ms | 1 - 1 MB | NPU | Use Export Script |
103
- | Segformer-Base | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 19.372 ms | 9 - 9 MB | NPU | [Segformer-Base.onnx](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.onnx) |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
104
 
105
 
106
 
@@ -164,8 +178,8 @@ Profiling Results
164
  Segformer-Base
165
  Device : cs_8275 (ANDROID 14)
166
  Runtime : TFLITE
167
- Estimated inference time (ms) : 315.1
168
- Estimated peak memory usage (MB): [9, 65]
169
  Total # Ops : 545
170
  Compute Unit(s) : npu (545 ops) gpu (0 ops) cpu (0 ops)
171
  ```
 
36
 
37
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
38
  |---|---|---|---|---|---|---|---|---|
39
+ | Segformer-Base | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 221.556 ms | 9 - 66 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.tflite) |
40
+ | Segformer-Base | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 221.863 ms | 3 - 50 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.dlc) |
41
+ | Segformer-Base | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 114.26 ms | 9 - 70 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.tflite) |
42
+ | Segformer-Base | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 118.529 ms | 3 - 59 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.dlc) |
43
+ | Segformer-Base | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 114.76 ms | 0 - 39 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.tflite) |
44
+ | Segformer-Base | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 113.569 ms | 3 - 23 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.dlc) |
45
+ | Segformer-Base | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 117.148 ms | 10 - 65 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.tflite) |
46
+ | Segformer-Base | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 116.315 ms | 2 - 51 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.dlc) |
47
+ | Segformer-Base | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 221.556 ms | 9 - 66 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.tflite) |
48
+ | Segformer-Base | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 221.863 ms | 3 - 50 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.dlc) |
49
+ | Segformer-Base | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 114.524 ms | 0 - 34 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.tflite) |
50
+ | Segformer-Base | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 114.118 ms | 3 - 23 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.dlc) |
51
+ | Segformer-Base | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 125.923 ms | 9 - 62 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.tflite) |
52
+ | Segformer-Base | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 124.125 ms | 0 - 56 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.dlc) |
53
+ | Segformer-Base | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 114.745 ms | 0 - 37 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.tflite) |
54
+ | Segformer-Base | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 113.858 ms | 3 - 21 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.dlc) |
55
+ | Segformer-Base | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 117.148 ms | 10 - 65 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.tflite) |
56
+ | Segformer-Base | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 116.315 ms | 2 - 51 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.dlc) |
57
+ | Segformer-Base | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 114.914 ms | 0 - 42 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.tflite) |
58
+ | Segformer-Base | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 114.277 ms | 3 - 19 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.dlc) |
59
+ | Segformer-Base | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 110.869 ms | 20 - 51 MB | NPU | [Segformer-Base.onnx](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.onnx) |
60
+ | Segformer-Base | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 86.645 ms | 8 - 72 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.tflite) |
61
+ | Segformer-Base | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 86.093 ms | 3 - 60 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.dlc) |
62
+ | Segformer-Base | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 83.425 ms | 21 - 81 MB | NPU | [Segformer-Base.onnx](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.onnx) |
63
+ | Segformer-Base | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 76.112 ms | 9 - 62 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.tflite) |
64
+ | Segformer-Base | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 92.911 ms | 3 - 54 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.dlc) |
65
+ | Segformer-Base | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 78.241 ms | 21 - 67 MB | NPU | [Segformer-Base.onnx](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.onnx) |
66
+ | Segformer-Base | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 119.744 ms | 31 - 31 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.dlc) |
67
+ | Segformer-Base | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 118.375 ms | 35 - 35 MB | NPU | [Segformer-Base.onnx](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base.onnx) |
68
+ | Segformer-Base | w8a16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 22.589 ms | 0 - 35 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a16.dlc) |
69
+ | Segformer-Base | w8a16 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 16.08 ms | 2 - 45 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a16.dlc) |
70
+ | Segformer-Base | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 12.294 ms | 2 - 14 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a16.dlc) |
71
+ | Segformer-Base | w8a16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 13.298 ms | 2 - 38 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a16.dlc) |
72
+ | Segformer-Base | w8a16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 44.511 ms | 2 - 69 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a16.dlc) |
73
+ | Segformer-Base | w8a16 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 22.589 ms | 0 - 35 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a16.dlc) |
74
+ | Segformer-Base | w8a16 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 12.252 ms | 2 - 17 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a16.dlc) |
75
+ | Segformer-Base | w8a16 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 15.09 ms | 2 - 39 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a16.dlc) |
76
+ | Segformer-Base | w8a16 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 12.437 ms | 2 - 14 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a16.dlc) |
77
+ | Segformer-Base | w8a16 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 13.298 ms | 2 - 38 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a16.dlc) |
78
+ | Segformer-Base | w8a16 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 12.31 ms | 2 - 14 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a16.dlc) |
79
+ | Segformer-Base | w8a16 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 40.224 ms | 31 - 109 MB | NPU | [Segformer-Base.onnx](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a16.onnx) |
80
+ | Segformer-Base | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 8.172 ms | 2 - 48 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a16.dlc) |
81
+ | Segformer-Base | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 29.02 ms | 29 - 291 MB | NPU | [Segformer-Base.onnx](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a16.onnx) |
82
+ | Segformer-Base | w8a16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 7.292 ms | 1 - 41 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a16.dlc) |
83
+ | Segformer-Base | w8a16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 28.532 ms | 26 - 235 MB | NPU | [Segformer-Base.onnx](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a16.onnx) |
84
+ | Segformer-Base | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 13.693 ms | 0 - 0 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a16.dlc) |
85
+ | Segformer-Base | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 43.855 ms | 55 - 55 MB | NPU | [Segformer-Base.onnx](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a16.onnx) |
86
+ | Segformer-Base | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 23.648 ms | 2 - 40 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.tflite) |
87
+ | Segformer-Base | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 12.996 ms | 1 - 33 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.dlc) |
88
+ | Segformer-Base | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 13.514 ms | 2 - 49 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.tflite) |
89
+ | Segformer-Base | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 8.385 ms | 1 - 46 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.dlc) |
90
+ | Segformer-Base | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 13.184 ms | 2 - 15 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.tflite) |
91
+ | Segformer-Base | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 7.165 ms | 1 - 10 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.dlc) |
92
+ | Segformer-Base | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 13.734 ms | 2 - 40 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.tflite) |
93
+ | Segformer-Base | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 7.795 ms | 1 - 34 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.dlc) |
94
+ | Segformer-Base | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 132.091 ms | 15 - 56 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.tflite) |
95
+ | Segformer-Base | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 25.935 ms | 1 - 48 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.dlc) |
96
+ | Segformer-Base | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 442.717 ms | 41 - 59 MB | GPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.tflite) |
97
+ | Segformer-Base | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 23.648 ms | 2 - 40 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.tflite) |
98
+ | Segformer-Base | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 12.996 ms | 1 - 33 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.dlc) |
99
+ | Segformer-Base | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 13.29 ms | 2 - 15 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.tflite) |
100
+ | Segformer-Base | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 7.135 ms | 1 - 12 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.dlc) |
101
+ | Segformer-Base | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 15.487 ms | 2 - 43 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.tflite) |
102
+ | Segformer-Base | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 8.958 ms | 1 - 35 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.dlc) |
103
+ | Segformer-Base | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 13.199 ms | 2 - 15 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.tflite) |
104
+ | Segformer-Base | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 7.132 ms | 1 - 11 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.dlc) |
105
+ | Segformer-Base | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 13.734 ms | 2 - 40 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.tflite) |
106
+ | Segformer-Base | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 7.795 ms | 1 - 34 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.dlc) |
107
+ | Segformer-Base | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 13.163 ms | 2 - 14 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.tflite) |
108
+ | Segformer-Base | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 7.133 ms | 1 - 12 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.dlc) |
109
+ | Segformer-Base | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 17.824 ms | 2 - 25 MB | NPU | [Segformer-Base.onnx](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.onnx) |
110
+ | Segformer-Base | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 9.068 ms | 2 - 51 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.tflite) |
111
+ | Segformer-Base | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 4.756 ms | 1 - 46 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.dlc) |
112
+ | Segformer-Base | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 12.495 ms | 7 - 66 MB | NPU | [Segformer-Base.onnx](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.onnx) |
113
+ | Segformer-Base | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 9.281 ms | 1 - 40 MB | NPU | [Segformer-Base.tflite](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.tflite) |
114
+ | Segformer-Base | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 4.429 ms | 1 - 39 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.dlc) |
115
+ | Segformer-Base | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 11.905 ms | 5 - 56 MB | NPU | [Segformer-Base.onnx](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.onnx) |
116
+ | Segformer-Base | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 8.004 ms | 18 - 18 MB | NPU | [Segformer-Base.dlc](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.dlc) |
117
+ | Segformer-Base | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 19.367 ms | 9 - 9 MB | NPU | [Segformer-Base.onnx](https://huggingface.co/qualcomm/Segformer-Base/blob/main/Segformer-Base_w8a8.onnx) |
118
 
119
 
120
 
 
178
  Segformer-Base
179
  Device : cs_8275 (ANDROID 14)
180
  Runtime : TFLITE
181
+ Estimated inference time (ms) : 221.6
182
+ Estimated peak memory usage (MB): [9, 66]
183
  Total # Ops : 545
184
  Compute Unit(s) : npu (545 ops) gpu (0 ops) cpu (0 ops)
185
  ```
Segformer-Base.dlc ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e79295897e25691dc8352d26825e33321f6e24551effb06aade251ba08dd1fb9
3
+ size 15336373
Segformer-Base_w8a16.dlc ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fade3511d45d6f444f8f630e48455ab0005c93233818f5bdc66f57ec14274eac
3
+ size 4754166
Segformer-Base_w8a8.dlc ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8b25891d76bf9a81637b81dba4dd8152cc2a30923b3a855b82c91b666c483a96
3
+ size 4741903