The ZCU104 evaluation board uses the mid-range ZU7EV UltraScale+ device. Dual B4096 DPU cores are implemented in the programmable logic, delivering 2.46 TOPS INT8 peak performance for deep learning inference acceleration.
Refer to the following table for the throughput performance (in frames/sec or fps) for various neural network samples on ZCU104 with the DPUs clocked at 300 MHz.
No | Neural Network | Input Size | GOPS | Performance (fps) (Single thread) | Performance (fps) (Multiple thread) |
---|---|---|---|---|---|
1 | bcc_pt | 800x1000 | 268.9 | 3.5 | 8 |
2 | bevdet | 256x704 | 407.6 | 1.7 | 4.6 |
3 | c2d2_lite | 512x512 | 6.86 | 3.1 | 3.5 |
4 | centerpoint | 2560x40x4 | 54 | 16.8 | 20.7 |
5 | cflownet_pt | 128x128 | 5.21 | 66.2 | 144.6 |
6 | chen_color_resnet18_pt | 224x224 | 3.627 | 224.8 | 463.1 |
7 | clocs | 12000x100x4 | 41 | 2.9 | 10.3 |
8 | drunet_pt | 528x608 | 2.59 | 63.6 | 152 |
9 | efficientdet_d2_tf | 768x768 | 11.06 | 3.7 | 7.2 |
10 | efficientnet_lite_tf2 | 224x224 | 0.77 | 214.2 | 458.4 |
11 | efficientnet-b0_tf2 | 224x224 | 0.36 | 83.3 | 146.4 |
12 | efficientNet-edgetpu-L_tf | 300x300 | 19.36 | 37.3 | 73.5 |
13 | efficientNet-edgetpu-M_tf | 240x240 | 7.34 | 85.3 | 169.5 |
14 | efficientNet-edgetpu-S_tf | 224x224 | 4.72 | 122.6 | 250.6 |
15 | ENet_cityscapes_pt | 512x1024 | 8.6 | 10.4 | 40 |
16 | face_mask_detection_pt | 512x512 | 0.593 | 120 | 326.8 |
17 | face-quality_pt | 80x60 | 0.06 | 2939.2 | 8601.2 |
18 | facerec-resnet20_mixed_pt | 112x96 | 3.5 | 180.1 | 315.7 |
19 | facereid-large_pt | 96x96 | 0.5 | 1124 | 2548.5 |
20 | facereid-small_pt | 80x80 | 0.09 | 2447.2 | 6649.9 |
21 | fadnet | 576x960 | 441 | 1.7 | 3.5 |
22 | fadnet_pruned | 576x960 | 154 | 2.6 | 5.3 |
23 | fadnet_v2_pt | 576x960 | 412 | 1.8 | 4.8 |
24 | fadnet_v2_pruned_pt | 576x960 | 201 | 2.7 | 7.8 |
25 | FairMot_pt | 640x480 | 36 | 23.9 | 52.7 |
26 | FPN-resnet18_covid19-seg_pt | 352x352 | 22.7 | 39.6 | 81.5 |
27 | HardNet_MSeg_pt | 352x352 | 22.78 | 26.3 | 49.1 |
28 | hfnet_tf | 960x960 | 20.09 | 3.2 | 14.5 |
29 | HRNet_pt | 1024x2048 | 1511.9 | N/A | N/A |
30 | inception_resnet_v2_tf | 299x299 | 26.4 | 25.6 | 47.4 |
31 | inception_v1_tf | 224x224 | 3 | 203.7 | 422.1 |
32 | inception_v2_tf | 224x224 | 3.88 | 99.5 | 199 |
33 | inception_v3_pt | 299x299 | 5.7 | 64.3 | 125.6 |
34 | inception_v3_tf | 299x299 | 11.5 | 64.3 | 125.7 |
35 | inception_v3_tf2 | 299x299 | 11.5 | 63.6 | 125 |
36 | inception_v4_2016_09_09_tf | 299x299 | 24.6 | 30.9 | 59.8 |
37 | medical_seg_cell_tf2 | 128x128 | 5.3 | 166.3 | 351.4 |
38 | MLPerf_resnet50_v1.5_tf | 224x224 | 8.19 | 85.6 | 163.2 |
39 | mlperf_ssd_resnet34_tf | 1200x1200 | 433 | 1.9 | 5.2 |
40 | mobilenet_1_0_224_tf2 | 224x224 | 1.1 | 341.6 | 795.3 |
41 | mobilenet_edge_0_75_tf | 224x224 | 0.62 | 277.2 | 608.1 |
42 | mobilenet_edge_1_0_tf | 224x224 | 0.99 | 229.3 | 487.3 |
43 | mobilenet_v1_0_25_128_tf | 128x128 | 0.027 | 1347.5 | 4343.4 |
44 | mobilenet_v1_0_5_160_tf | 160x160 | 0.15 | 936.2 | 2671.8 |
45 | mobilenet_v1_1_0_224_tf | 224x224 | 1.1 | 346.9 | 807.4 |
46 | mobilenet_v2_1_0_224_tf | 224x224 | 0.6 | 284.1 | 622.3 |
47 | mobilenet_v2_1_4_224_tf | 224x224 | 1.2 | 203.1 | 418.9 |
48 | mobilenet_v2_cityscapes_tf | 1024x2048 | 132.74 | 1.8 | 5.5 |
49 | mobilenet_v3_small_1_0_tf2 | 224x224 | 0.132 | 365 | 849 |
50 | monodepth2_pt | 192x640 | 257.21 | 46.2 | 96.6 |
51 | movenet_ntd_pt | 192x192 | 0.5 | 94.9 | 368.9 |
52 | MT-resnet18_mixed_pt | 512x320 | 13.65 | 34.4 | 94.7 |
53 | multi_task_v3_pt | 320x512 | 25.44 | 17.8 | 56.2 |
54 | ocr_pt | 960x960 | 875.7 | 1 | 2.6 |
55 | ofa_depthwise_res50_pt | 176x176 | 1.25 | 109 | 346.2 |
56 | ofa_rcan_latency_pt | 360x640 | 45.7 | 17.9 | 28.7 |
57 | ofa_resnet50_0_9B_pt | 160x160 | 1.8 | 197.3 | 354.5 |
58 | ofa_yolo_pruned_0_30_pt | 640x640 | 34.71 | 22.7 | 49 |
59 | ofa_yolo_pruned_0_50_pt | 640x640 | 24.62 | 29.1 | 64.5 |
60 | ofa_yolo_pt | 640x640 | 48.88 | 17.9 | 37.6 |
61 | person-orientation_pruned_558m_pt | 224x112 | 0.558 | 820 | 1554.1 |
62 | personreid-res18_pt | 176x80 | 1.1 | 456.1 | 836.5 |
63 | personreid-res50_pt | 256x128 | 5.3 | 104 | 229.2 |
64 | pmg_pt | 224x224 | 2.28 | 165.7 | 333 |
65 | pointpainting | 40000x64x16 | 112 | 1.3 | 4.5 |
66 | pointpillars_kitti_12000_pt | 12000x100x4 | 10.8 | 20.1 | 49.6 |
67 | pointpillars_nuscenes | 40000x64x5 | 108 | 2.3 | 8.8 |
68 | rcan_pruned_tf | 360x640 | 86.95 | 9.9 | 19 |
69 | refinedet_VOC_tf | 320x320 | 81.9 | 10.9 | 26 |
70 | RefineDet-Medical_EDD_tf | 320x320 | 9.8 | 71.2 | 169.4 |
71 | resnet_v1_101_tf | 224x224 | 14.4 | 50.1 | 97.6 |
72 | resnet_v1_152_tf | 224x224 | 21.8 | 34.2 | 66.6 |
73 | resnet_v1_50_tf | 224x224 | 7 | 95.9 | 183.2 |
74 | resnet_v2_101_tf | 299x299 | 26.78 | 25.2 | 47.9 |
75 | resnet_v2_152_tf | 299x299 | 40.47 | 17.2 | 32.6 |
76 | resnet_v2_50_tf | 299x299 | 13.1 | 48.1 | 90.8 |
77 | resnet50_pt | 224x224 | 4.1 | 84.8 | 161.8 |
78 | resnet50_tf2 | 224x224 | 7.7 | 95.1 | 182.1 |
79 | SA_gate_base_pt | 360x360 | 178 | 3.5 | 8.6 |
80 | salsanext_pt | 64x2048 | 20.4 | 9.7 | 40.6 |
81 | salsanext_v2_pt | 64x2048 | 32 | 6.3 | 15.7 |
82 | semantic_seg_citys_tf2 | 512x1024 | 54 | 7.7 | 25.6 |
83 | SemanticFPN_cityscapes_pt | 256x512 | 10 | 36.4 | 150.9 |
84 | SemanticFPN_Mobilenetv2_pt | 512x1024 | 5.4 | 10.7 | 53 |
85 | SESR_S_pt | 360x640 | 7.48 | 94.4 | 145.8 |
86 | solo_pt | 640x640 | 107 | 1.5 | 4.9 |
87 | squeezenet_pt | 224x224 | 0.82 | 594 | 1319.7 |
88 | ssd_inception_v2_coco_tf | 300x300 | 9.6 | 42 | 90 |
89 | ssd_mobilenet_v1_coco_tf | 300x300 | 2.5 | 115.6 | 314.8 |
90 | ssd_mobilenet_v2_coco_tf | 300x300 | 3.8 | 85.6 | 199.8 |
91 | ssd_resnet_50_fpn_coco_tf | 640x640 | 178.4 | 2.9 | 5.3 |
92 | ssdlite_mobilenet_v2_coco_tf | 300x300 | 1.5 | 110.6 | 285.1 |
93 | ssr_pt | 256x256 | 39.72 | 6.5 | 12.5 |
94 | superpoint_tf | 480x640 | 52.4 | 11 | 40.3 |
95 | textmountain_pt | 960x960 | 575.2 | 1.8 | 3.7 |
96 | tsd_yolox_pt | 640x640 | 73 | 14 | 27.8 |
97 | ultrafast_pt | 288x800 | 8.4 | 38.5 | 81.6 |
98 | unet_chaos-CT_pt | 512x512 | 23.3 | 23.6 | 59.1 |
99 | vehicle_make_resnet18_pt | 224x224 | 3.627 | 224.6 | 463.5 |
100 | vehicle_type_resnet18_pt | 224x224 | 3.627 | 225 | 463.5 |
101 | vgg_16_tf | 224x224 | 31 | 21.8 | 38.4 |
102 | vgg_19_tf | 224x224 | 39.3 | 18.8 | 33.8 |
103 | xilinxSR_pt | 360x640x3 | 182.44 | 2.5 | 4.4 |
104 | yolov3_coco_416_tf2 | 416x416 | 65.9 | 14.1 | 29 |
105 | yolov3_voc_tf | 416x416 | 65.6 | 14.5 | 29.2 |
106 | yolov4_csp_pt | 640x640 | 121 | 7.8 | 16.1 |
107 | yolov4_leaky_416_tf | 416x416 | 60.3 | 14.4 | 29 |
108 | yolov4_leaky_512_tf | 512x512 | 91.2 | 10.9 | 21.8 |
109 | yolov5_large_pt | 640x640 | 109.6 | 9.3 | 19 |
110 | yolov5_nano_pt | 640x640 | 4.6 | 75 | 197.1 |
111 | yolov5s6_pt | 640x640 | 17 | 11.2 | 25.4 |
112 | yolov6m_pt | 640x640 | 82.2 | 6.4 | 24.6 |
113 | yolox_nano_pt | 416x416x3 | 1 | 193.3 | 463.6 |