Generating the Quantized Model - 3.5 English

Vitis AI User Guide (UG1414)

Document ID
UG1414
Release Date
2023-06-29
Version
3.5 English

After the successful execution of the vai_q_tensorflow command, one output file is generated in the ${output_dir} location:

  • quantize_eval_model.pb can be used to evaluate the accuracy of the quantized model on CPU/GPUs and can be used to simulate the results on hardware.
Table 1. vai_q_tensorflow Output Files
No. Name Description
1 deploy_model.pb Quantized model for the Vitis AI compiler (extended TensorFlow format) for targeting DPUCZDX8G implementations.
2 quantize_eval_model.pb Quantized model for evaluation (also, the Vitis AI compiler input for most DPU architectures, like DPUCAHX8H, and DPUCADF8H).