Vibration sensor improves voice recognition in mobile phones

voice recognition for mobile phones
New sensor promises improves accuracy of voice recognition for mobile devices (Pixabay)

While most mobile phones incorporate a voice-recognition feature, the usefulness and accuracy of voice recognition can be adversely affected by the ambient noise environment. Being that a mobile phone is essentially a microphone, it is all too easy the voice recognition to inadvertently activate due to ambient noise or other extraneous conversations.  

Pohang University of Science and Technology professor Kilwon Cho
POSTECH professor Kilwon Cho,
one of two scientists who developed
a ​​​​​wearable vibration sensor that
is unaffected by ambient noise.

Two scientists from Pohang University of Science and Technology (POSTECH) in Pohang, South Korea have developed a flexible and wearable vibration responsive sensor. The sensor, developed by Professor Kilwon Cho of Chemical Engineering and Professor Yoonyoung Chung of Electronic and Electric Engineering, can precisely recognize voice through vibration of the neck’s skin and is not affected by ambient noise or the volume of sound.

Conventional vibration sensors, which recognize voice through air vibration, lose their sensitivity due to mechanical resonance and damping effects. Consequently, ambient sound or obstacles such as a mouth mask can affect voice recognition accuracy and cannot be used for security authentication.

Sponsored by Infosys

In Conversation with Antonio Neri, President & CEO – Hewlett Packard Enterprise & Salil Parekh, CEO – Infosys

Hear the CEOs of Infosys & HPE discuss the current crisis and how it has accelerated the need for digital transformation for their clients. Connectivity at the Edge, right mix of hybrid cloud, ability to extract data faster than ever before… these are just some of the contributions that HPE and Infosys make to our clients’ digital transformation journey.

The researchers found that voice pressure is proportional to the acceleration of neck skin vibration at various sound pressure levels from 40 to 70 dBSPL (a measurement of sound pressure). They developed a vibration sensor, comprising an ultrathin polymer film and a diaphragm with tiny holes, that can sense voices quantitatively by measuring the acceleration of skin vibration.

The researchers also demonstrated that the device can accurately recognize voice without vibrational distortion, even in noisy environments and at a very low voice volume with a mouth mask worn. They believe this research can be further extended to various voice-recognition applications such as an electronic skin, human-machine interface, or wearable vocal healthcare monitoring device.

“This research is very meaningful in a way that it developed a new voice-recognition system which can quantitatively sense and analyze voice and is not affected by the surroundings “ says Professor Cho in a statement. “It took a step forward from the conventional voice-recognition system that could only recognize voice qualitatively.”

This research was supported by the Center for Advanced Soft Electronics under the Global Frontier Research Program of The Ministry of Science and ICT, Korea. Additional results of the study appear  on the website of Nature Communications.

Suggested Articles

Working with Jacoti of Belgium, Qualcomm wants to make earbuds recognize the hearing anomalies of users.

Deep learning is one of the most promising techniques for training machines to "think" like people.

Tally upgrade from Simbe Robotics uses Nvidia Jetson GPU for edge processing and Intel RealSense LiDAR for higher resolution images