Learning to Hallucinate Examples from Extrinsic and Intrinsic Supervision

Citations Over Time

Abstract

Learning to hallucinate additional examples has recently been shown as a promising direction to address few-shot learning tasks. This work investigates two important yet overlooked natural supervision signals for guiding the hallucination process – (i) extrinsic: classifiers trained on hallucinated examples should be close to strong classifiers that would be learned from a large amount of real examples; and (ii) intrinsic: clusters of hallucinated and real examples belonging to the same class should be pulled together, while simultaneously pushing apart clusters of hallucinated and real examples from different classes. We achieve (i) by introducing an additional mentor model on data-abundant base classes for directing the hallucinator, and achieve (ii) by performing contrastive learning between hallucinated and real examples. As a general, model-agnostic framework, our dual mentor-and self-directed (DMAS) hallucinator significantly improves few-shot learning performance on widely-used benchmarks in various scenarios.

Related Papers

• → Few-Shot Learning via Saliency-Guided Hallucination of Samples(2019)235 cited
• → Source monitoring deficits in hallucinating compared to non-hallucinating patients with schizophrenia(2006)76 cited
• → Learning to Hallucinate Examples from Extrinsic and Intrinsic Supervision(2021)5 cited
• → Hallucinations in Children: A Follow‐up Study(1988)39 cited
• The hallucinating patient and nursing intervention.(1976)