Journal of Applied Sciences ›› 2024, Vol. 42 ›› Issue (1): 103-118.doi: 10.3969/j.issn.0255-8297.2024.01.009

• Special Issue on Computer Application • Previous Articles     Next Articles

Object Tracking Algorithm Based on Vehicle Appearance Features and Inter-frame Optical Flow

LI Shaoqian1, CHENG Xin1, ZHOU Jingmei2, ZHAO Xiangmo1   

  1. 1. College of Information Engineering, Chang'an University, Xi'an 710064, Shaanxi, China;
    2. College of Electronic and Control Engineering, Chang'an University, Xi'an 710064, Shaanxi, China
  • Received:2023-06-29 Online:2024-01-30 Published:2024-02-02

Abstract: In complex road scenes, frequent occlusions and similar appearances between vehicle targets, coupled with the use of static preset parameters used throughout the entire movement of the targets collectively contribute to a decline in tracking accuracy. This paper proposes an object tracking algorithm based on vehicle appearance features and inter-frame optical flow. Firstly, the position information of the vehicle target frame is obtained through the YOLOv5x network model. Secondly, the optical flow between the current frame and the previous frame is calculated using the RAFT (recurrent all-pairs field transforms for optical flow) algorithm, and the optical flow map is clipped according to the obtained position information. Finally, in the process of Kalman filtering, inter-frame optical flow is used to compensate for more accurate motion state information, while vehicle appearance features and intersection over union (IOU) features are used to complete trajectory matching. Experimental results show that the tracking algorithm correlating inter-frame optical flow performs well on the MOT16 data set. Compared with simple online and realtime tracking with a deep association metric (DeepSORT), mostly tracked trajectories (MT) has increased by 1.6%, multiple object tracking accuracy (MOTA) has increased by 1.3%, and multiple object tracking precision (MOTP) has increased by 0.6%. The accuracy of the improved vehicle appearance feature extraction model has been improved by 1.7% and 6.3% on the training and verification sets, respectively. Consequently, leveraging the high-precision vehicle appearance feature model and motion state information from the associated inter-frame optical flow enables effective vehicle target tracking in traffic scenes.

Key words: object tracking, vehicle exterior features, inter-frame optical flow, Kalman filter

CLC Number: