ReLU Type - 3.4 English

DPUCZDX8G for Zynq UltraScale+ MPSoCs Product Guide (PG338)

Document ID
PG338
Release Date
2022-01-20
Version
3.4 English

The ReLU Type option determines which kind of ReLU function can be used in the DPUCZDX8G. ReLU and ReLU6 are supported by default. The option “ReLU + LeakyReLU + ReLU6“ means that LeakyReLU becomes available as an activation function.

Note: LeakyReLU coefficient is fixed to 0.1.
Table 1. Extra LUTs with ReLU + LeakyReLU + ReLU6 compared to ReLU+ReLU6
DPU Architecture Extra LUTs
B512(4x8x8) 347
B800(4x10x10) 725
B1024(8x8x8) 451
B1152(4x12x12) 780
B1600(8x10x10) 467
B2304(8x12x12) 706
B3136(8x14x14) 831
B4096(8x16x16) 925