No-Frills Human-Object Interaction Detection: Factorization, Layout Encodings, and Training Techniques

Citations Over TimeTop 23% of 2019 papers

Abstract

We show that for human-object interaction detection a relatively simple factorized model with appearance and layout encodings constructed from pre-trained object detectors outperforms more sophisticated approaches. Our model includes factors for detection scores, human and object appearance, and coarse (box-pair configuration) and optionally fine-grained layout (human pose). We also develop training techniques that improve learning efficiency by: (1) eliminating a train-inference mismatch; (2) rejecting easy negatives during mini-batch training; and (3) using a ratio of negatives to positives that is two orders of magnitude larger than existing approaches. We conduct a thorough ablation study to understand the importance of different factors and training techniques using the challenging HICO-Det dataset.

Related Papers

• No-Frills Human-Object Interaction Detection: Factorization, Appearance and Layout Encodings, and Training Techniques.(2018)
• → Adaptive Offline Quintuplet Loss for Image-Text Matching(2020)3 cited
• → Learning to Detect Objects with Minimal Supervision(2012)