Flow-Guided Feature Aggregation for Video Object Detection

Citations Over TimeTop 1% of 2017 papers

Abstract

Extending state-of-the-art object detectors from image to video is challenging. The accuracy of detection suffers from degenerated object appearances in videos, e.g., motion blur, video defocus, rare poses, etc. Existing work attempts to exploit temporal information on box level, but such methods are not trained end-to-end. We present flow-guided feature aggregation, an accurate and end-to-end learning framework for video object detection. It leverages temporal coherence on feature level instead. It improves the per-frame features by aggregation of nearby features along the motion paths, and thus improves the video recognition accuracy. Our method significantly improves upon strong singleframe baselines in ImageNet VID [33], especially for more challenging fast moving objects. Our framework is principled, and on par with the best engineered systems winning the ImageNet VID challenges 2016, without additional bells-and-whistles. The code would be released.

Related Papers

• → Optical Flow Based on Lucas-Kanade Method for Motion Estimation(2020)19 cited
• → 1000-fps real-time optical flow detection system(2010)14 cited
• → Group action recognition in soccer videos(2008)13 cited
• → Learning Optical Expansion from Scale Matching(2023)2 cited
• → SEMI-AUTOMATIC MULTI-CAMERA VIDEO ANNOTATION TOOL FOR OBJECT TRACKING AND OPTICAL FLOW BENCHMARK CREATION(2019)