In the systolic array, the data of the matrix A (or B) should input in a transposed order compared to its original row-major format. Transpose unit in the GEMM kernel is implemented to perform the transpose operation. It also plays a role of double buffer and re-transmites the data to the systolic arrays since the data is re-usable in the block mattrix multiplication.