An AI Engine kernel is a program which is
written using the C/C++ language,
AI Engine API and
specialized intrinsic functions that target the VLIW scalar and vector processors. The
AI Engine kernel code is compiled using
aiecompiler that is included in the AMD Vitis™
core development kit. The aiecompiler compiles the kernels to produce ELF files that are run on the
AI Engine processors.
The AI Engine supports specialized data
types and API functions for vector processing. By restructuring some scalar application
code with these API functions and vector data types, one can create fast and efficient
vectorized code. The aiecompiler takes care of mapping
API functions to operations, vector or scalar register allocation and data movement,
automatic scheduling, and generation of microcode that is efficiently packed into VLIW
instructions.
The following chapters introduce the data types supported and registers available for use by the AI Engine kernel. In addition, the vector API functions that initialize, load, and store, as well as operate on the vector registers using the appropriate data types are also described.
To achieve the highest performance on the AI Engine, the primary goal of single kernel programming is to ensure that the usage of the vector processor approaches its theoretical maximum. Vectorization of the algorithm is important, but managing the vector registers, memory access, and software pipelining are also required. The programmer must strive to make the data for the new operation available while the current operation is executing because the vector processor is capable of an operation every clock cycle. Optimizations using software pipelining in loops are available using pragmas. For instance, when the inner loop has sequential or loop carried dependencies it might be possible to unroll an outer loop and compute multiple values in parallel. The following sections go over these concepts as well.