基于Leap Motion手语语音转换的设计与实现

文章介绍了基于Leap Motion手语语音转换的原理以及在实际中如何实现应用,其能够将手语手势翻译成所需语言,并且以语音的形式传递消息,实现为聋哑人"发声"的目的。Leap Motion手语语音转换的硬件部分采用Leap Motion体感控制器,能够实时采集人手指的坐标、加速度、方向等动态手势的运动信息。软件采用Unity 3D三维引擎,提供了开发手势识别的SDK,并给出了一些基本手的模型,在Unity 3D中完成由手势到文字,再到语音的转换。

Design and implementation of voice conversion based on Leap Motion sign language

This paper introduces the principle of sign-language conversion based on Leap Motion and how to implement it in practice. It can translate gestures into the required language and transmit messages in the form of speech, so as to achieve the purpose of "voice" for deaf-mute people. The hardware part of sign-language speech conversion based on Leap Motion uses motion-sensing controller called Leap Motion, which can collect the motion information of the finger’s coordinate, acceleration, direction and other dynamic gestures in real time. The software uses Unity 3D engine, provides an SDK for developing gesture recognition, as well as some basic hand models for converting gestures to text and then to speech in Unity 3D.