RFID Tattoo
Citations Over TimeTop 10% of 2019 papers
Abstract
This paper presents an RF-based assistive technology for voice impairments (i.e., dysphonia), which occurs in an estimated 1% of the global population. We specifically focus on acquired voice disorders where users continue to be able to make facial and lip gestures associated with speech. Despite the rich literature on assistive technologies in this space, there remains a gap for a solution that neither requires external infrastructure in the environment, battery-powered sensors on skin or body-worn manual input devices. We present RFTattoo, which to our knowledge is the first wireless speech recognition system for voice impairments using batteryless and flexible RFID tattoos. We design specialized wafer-thin tattoos attached around the user's face and easily hidden by makeup. We build models that process signal variations from these tattoos to a portable RFID reader to recognize various facial gestures corresponding to distinct classes of sounds. We then develop natural language processing models that infer meaningful words and sentences based on the observed series of gestures. A detailed user study with 10 users reveals 86% accuracy in reconstructing the top-100 words in the English language, even without the users making any sounds.
Related Papers
- → Eliciting Mid-Air Gestures for Wall-Display Interaction(2016)43 cited
- → Towards successful user interaction with systems: Focusing on user-derived gestures for smart home systems(2014)36 cited
- Dictionary of Worldwide Gestures(1997)
- Spontaneous use of gesture sequences in orangutans(2012)
- A Quantitative Study on Gestures of Young Teachers with Varied Teaching Prizes(2009)