Gestures Recognition from Sound Waves

Binh, Nguyen Dang (2016) Gestures Recognition from Sound Waves. EAI Endorsed Transactions on Context-aware Systems and Applications, 3 (10): e5. ISSN 2409-0026

[thumbnail of eai.12-9-2016.151679.pdf]
eai.12-9-2016.151679.pdf - Published Version
Available under License Creative Commons Attribution No Derivatives.

Download (1MB) | Preview


We propose a new method to recognize gestures from sound waves. The main contribution of this paper is to recognize gestures based on the analysis of short-time Fourier transforms (STFT) using the Doppler effect to sense gestures. To do this, we generate an inaudible tone, which gets frequency-shifted when it reflects off moving objects like the hand. We measure this shift with the microphone to infer various gestures. Experimenting method and evaluating results by using the hand gestures of many different people to browse applications such as website, document and images in the browser on the computers in the classroom and library environment for accurate results. In addition, we describe the phenomena and recognition algorithm, demonstrate a variety of gestures, and present an informal evaluation on the robustness of this approach across Laptop device and people.

Item Type: Article
Uncontrolled Keywords: In-air gesture sensing; Doppler effect; interaction technique
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
QA75 Electronic computers. Computer science
Depositing User: EAI Editor II.
Date Deposited: 16 Sep 2020 08:49
Last Modified: 16 Sep 2020 08:49

Actions (login required)

View Item
View Item