基于车载毫米波雷达动态手势识别网络

Dynamic Gesture Recognition Network Based on Vehicular Millimeter Wave Radar

  • 摘要: 基于Transformer提出一种车载毫米波雷达手势识别方法,可用于车内人员进行人机交互. 毫米波雷达信号不受车内光照变化影响,同时能够保证乘客隐私. 首先,毫米波雷达采样信号经过二维傅里叶变换和滤波获得距离—多普勒(RDM)和距离—角度图(RAM);然后,将连续多帧RDM和RAM经过三维卷积网络后进行特征融合与拼接得到特征向量,利用Transformer模块进行位置和序列编码;最后通过全连接层获得手势概率分布向量. 采集了基于实际路况和多种干扰环境下的雷达数据制作了手势识别分类的数据集,实验结果表明该方法可以有效的检测与识别多种典型手势,识别准确率可以达到97.14%以上.

     

    Abstract: A Transformer based millimeter wave radar gesture recognition method was proposed for human-computer interaction of vehicle occupants. The millimeter wave radar signal was designed to be not affected by the change of light inside the vehicle, and at the same time to ensure the privacy of passengers. Firstly, the millimeter wave radar sampled signal was carried through two-dimensional Fourier transform and filtering to obtain distance-Doppler (RDM) and distance-angle maps(RAM) . Then, consecutive multi-frame RDM and RAM were fused and stitched after three-dimensional convolutional networks to obtain feature vectors. And a Transformer module was used to perform position and sequence encoding. Finally, the gesture probability distribution vector was obtained through the fully connected layer. A data set for gesture recognition classification was collected based on the actual road conditions and radar data under a variety of interference environments. The experimental results show that the method can effectively detect and recognize a variety of typical hand gestures, and the recognition accuracy can reach more than 97.14%.

     

/

返回文章
返回
Baidu
map