Entity resolution with iterative blocking

Citations Over TimeTop 1% of 2009 papers

Abstract

Entity Resolution (ER) is the problem of identifying which records in a database refer to the same real-world entity. An exhaustive ER process involves computing the similarities between pairs of records, which can be very expensive for large datasets. Various blocking techniques can be used to enhance the performance of ER by dividing the records into blocks in multiple ways and only comparing records within the same block. However, most blocking techniques process blocks separately and do not exploit the results of other blocks. In this paper, we propose an iterative blocking framework where the ER results of blocks are reflected to subsequently processed blocks. Blocks are now iteratively processed until no block contains any more matching records. Compared to simple blocking, iterative blocking may achieve higher accuracy because reflecting the ER results of blocks to other blocks may generate additional record matches. Iterative blocking may also be more efficient because processing a block now saves the processing time for other blocks. We implement a scalable iterative blocking system and demonstrate that iterative blocking can be more accurate and efficient than blocking for large datasets.

Related Papers

• → New iterative method for model updating based on model reduction(2010)28 cited
• → Analysis of multilayer substrates by multilayer contribution of wave concept iterative process(2007)10 cited
• → EM Scattering Analysis of Cylinder Array Using Iterative T-Matrix Theory(2015)
• → Improving the macro-basis function using insertion method and iterative refinement process for planar structure with one-dimensional wave propagation(2010)
• → Analysis of a new kind of quadruple folded substrate integrated waveguide filter with LTCC technology by wave concept iterative process(2015)