Demo 1: MultiTask Segmentation + Car Detection and Road Line Detection - 2.0 English

Vitis AI Library User Guide (UG1354)

Document ID
UG1354
Release Date
2022-01-20
Version
2.0 English

Target Application

ADAS/AD

AI Model, Performance, and Power

FPN
512x288, 4ch, 20fp
VPGNET
640x480, 1ch, 56fps
20W @ ZU9EG

Building and Running the Demo

Build the demo in the host and copy the program to the target board.

cd Vitis-AI/demo/Vitis-AI-Library/apps/segs_and_roadline_detect
bash -x build.sh
scp segs_and_roadline_detect_x segs_and_roadline_detect_drm root@IP_OF_BOARD:~/

To use OpenCV display, run the following command:

./segs_and_roadline_detect_x seg_512_288.avi seg_512_288.avi seg_512_288.aviseg_512_288.avi lane_640_480.avi -t 2 -t 2 -t 2 -t 2 -t 3 >/dev/null 2>&1

If you want to use DRM display, connect to the board using SSH and run the following command:

./segs_and_roadline_detect_drm seg_512_288.avi seg_512_288.avi seg_512_288.avi
seg_512_288.avi lane_640_480.avi -t 2 -t 2 -t 2 -t 2 -t 3 >/dev/null 2>&1
Note:
  1. The video files are in the vitis_ai_library_r2.0.0_video.tar.gz. Download the package from here.
  2. Due to limitations of the Docker environment, the MultiTask demos cannot run in the DRM mode on Cloud devices.
Figure 1. Segmentation and Roadline Detection Demo Picture