Synopses for Massive Data: Samples, Histograms, Wavelets, Sketches
Citations Over TimeTop 1% of 2011 papers
Abstract
Methods for Approximate Query Processing (AQP) are essential for dealing with massive data. They are often the only means of providing interactive response times when exploring massive datasets, and are also needed to handle high speed data streams. These methods proceed by computing a lossy, compact synopsis of the data, and then executing the query of interest against the synopsis rather than the entire dataset. We describe basic principles and recent developments in AQP. We focus on four key synopses: random samples, histograms, wavelets, and sketches. We consider issues such as accuracy, space and time efficiency, optimality, practicality, range of applicability, error bounds on query answers, and incremental maintenance. We also discuss the tradeoffs between the different synopsis types.
Related Papers
- → Wavelet and its Applications(2018)10 cited
- → Wavelet Analysis of Fracturing Pressure Data(2018)12 cited
- → NON-MSF A-WAVELETS FROM A-WAVELET SETS(2013)
- A survey of developments of super-wavelets(2007)
- ERROR LIMITED HISTOGRAM(1998)