http://www.jsjkx.comDOI:10.11896/jsjkx.220600242到稿日期:2022-06-27返修日期:2022-10-17通信作者:雷印杰(yinjie@scu.edu.cn)基于多模态时-频特征融合的信号调制格式识别方法贺超陈进杰金钊雷印杰四川大学电子信息学院成都610065(enaoan@foxmail.com)摘要自动调制识别(AutomaticModulationRecognition,AMR)是认知无线电中的关键技术,在无线通信中有着广泛应用。针对现有的自动调制识别方法大多都只利用了信号时域或频域的单模态信息,忽略了多模态信息之间的互补性的问题,提出了一种基于多模态时-频特征融合的信号调制格式识别方法。首先,在融合之前利用对比学习对齐信号的时域特征和频域特征,减小时-频特征间的异质性差异。然后,采用跨模态注意力实现时域特征和频域特征的互补性融合。最后,为了进一步提高模型整体的性能,在频域编码器中引入残差收缩模块来提取信号时频图的频域特征,并在时域编码器中引入复数双向门控循环单元,以提取I和Q两路信号之间的相关性特征及信号时序特征。在RadioML2016a上进行了实验,结果表明,所提方法具有较高的识别准确率和噪声鲁棒性。关键词:自动调制识别;跨模态注意力融合;对比学习;残差收缩模块;复数双向门控循环单元中图法分类号TP389AutomaticModulationRecognitionMethodBasedonMultimodalTime-FrequencyFeatureFusionHEChao,CHENJinjie,JINZhaoandLEIYinjieCollegeofElectronicsandInformationEngineering,SichuanUniversity,Chengdu610065,ChinaAbstractAutomaticmodulationrecognition(AMR)isakeytechnologyincognitiveradioandhasawiderangeofapplicationsinwirelesscommunication.Aimingattheproblemthatmostoftheexistingautomaticmodulationclassificationmethodsonlyusethesingle-modalinformationinthetimedomainorfrequencydomain,ignoringthecomplementaritybetweenthemulti-modalinfor-mation,asignalmodulationclassificationrecognitionmethodbasedonmultimodaltime-frequencyfeaturefusionisproposed.First,thetime-domainfeaturesandfrequency-domainfeaturesofthesignalarealignedbycontrastivelearningbeforefusiontore-ducetheheterogeneitydifference.Secondly,cross-modalattentionisusedtoachievecomplementaryfusionoftime-domainfea-turesandfrequency-domainfeatures.Finally,inordertofurtherimprovetheoverallperformanceofthemodel,aresidualshrin-kagemoduleisintroducedintothe...