Changedetection.net: A new change detection benchmark dataset
Citations Over TimeTop 1% of 2012 papers
Abstract
Change detection is one of the most commonly encountered low-level tasks in computer vision and video processing. A plethora of algorithms have been developed to date, yet no widely accepted, realistic, large-scale video dataset exists for benchmarking different methods. Presented here is a unique change detection benchmark dataset consisting of nearly 90,000 frames in 31 video sequences representing 6 categories selected to cover a wide range of challenges in 2 modalities (color and thermal IR). A distinguishing characteristic of this dataset is that each frame is meticulously annotated for ground-truth foreground, background, and shadow area boundaries - an effort that goes much beyond a simple binary label denoting the presence of change. This enables objective and precise quantitative comparison and ranking of change detection algorithms. This paper presents and discusses various aspects of the new dataset, quantitative performance metrics used, and comparative results for over a dozen previous and new change detection algorithms. The dataset, evaluation tools, and algorithm rankings are available to the public on a website 1 and will be updated with feedback from academia and industry in the future.
Related Papers
- Strategic Benchmarking: How to Rate Your Company's Performance against the World's Best(1993)
- → COMPARISON OF BEST PRACTICE BENCHMARKING MODELS(2011)11 cited
- → A guide for mental health clinicians to develop and undertake benchmarking activities(2010)2 cited
- Theoretical Aspects of Benchmarking Theory(2004)
- → Comparing ourselves: using benchmarking techniques to measure performance between academic libraries(2009)1 cited