Multi-pedestrian tracking using deep learning technique and tracklet assignment

Pedestrian tracking is a particular problem of object tracking, and an important component in various vision-based applications, such as autonomous cars or surveillance systems. After several years of development, pedestrian tracking in videos is still a challenging problem because of various visual properties of objects and surrounding environment. In this research, we propose a tracking-by-detection system for pedestrian tracking, which incorporates Convolutional Neural Network (CNN) and color information. Pedestrians in video frames are localized by a CNN, then detected pedestrians are assigned to their corresponding tracklets based on similarities in color distributions. The experimental results show that our system was able to overcome various difficulties to produce highly accurate tracking results.