GANana: Unsupervised Domain Adaptation for Volumetric Regression of Fruit

Citations Over TimeTop 11% of 2021 papers

Abstract

3D reconstruction of fruit is important as a key component of fruit grading and an important part of many size estimation pipelines. Like many computer vision challenges, the 3D reconstruction task suffers from a lack of readily available training data in most domains, with methods typically depending on large datasets of high-quality image-model pairs. In this paper, we propose an unsupervised domain-adaptation approach to 3D reconstruction where labelled images only exist in our source synthetic domain, and training is supplemented with different unlabelled datasets from the target real domain. We approach the problem of 3D reconstruction using volumetric regression and produce a training set of 25,000 pairs of images and volumes using hand-crafted 3D models of bananas rendered in a 3D modelling environment (Blender). Each image is then enhanced by a GAN to more closely match the domain of photographs of real images by introducing a volumetric consistency loss, improving performance of 3D reconstruction on real images. Our solution harnesses the cost benefits of synthetic data while still maintaining good performance on real world images. We focus this work on the task of 3D banana reconstruction from a single image, representing a common task in plant phenotyping, but this approach is general and may be adapted to any 3D reconstruction task including other plant species and organs.

Related Papers

• → Some Results on Cross Viewpoint Consistency Checking(1995)13 cited
• → Data Centric Domain Adaptation for Historical
\nText with OCR Errors(2021)3 cited
• → Learning under Unknown Bias(2013)
• → MADI: Inter-domain Matching and Intra-domain Discrimination for Cross-domain Speech Recognition(2023)
• → DASA: Domain Adaptation via Saliency Augmentation(2023)