Online Video Object Detection Using Association LSTM

Citations Over TimeTop 10% of 2017 papers

Abstract

Video object detection is a fundamental tool for many applications. Since direct application of image-based object detection cannot leverage the rich temporal information inherent in video data, we advocate to the detection of long-range video object pattern. While the Long Short-Term Memory (LSTM) has been the de facto choice for such detection, currently LSTM cannot fundamentally model object association between consecutive frames. In this paper, we propose the association LSTM to address this fundamental association problem. Association LSTM not only regresses and classifiy directly on object locations and categories but also associates features to represent each output object. By minimizing the matching error between these features, we learn how to associate objects in two consecutive frames. Additionally, our method works in an online manner, which is important for most video tasks. Compared to the traditional video object detection methods, our approach outperforms them on standard video datasets.

Related Papers

• → A real-time object detection algorithm for video(2019)131 cited
• → Small Object Detection Using Context Information Fusion in Faster R-CNN(2018)21 cited
• → A Survey on Object Detection Methods in Deep Learning(2021)17 cited
• → Object Detection using Machine Learning: A Survey(2019)1 cited
• → Object detection techniques for real-time applications(2022)