多尺度卷积结合Transformer的抑郁脑电分类研究

翟凤文; 孙芳林; 金静

doi:10.19665/j.issn1001-2400.20230211

您当前的位置：

首页 >

文章列表页 >

多尺度卷积结合Transformer的抑郁脑电分类研究

计算机科学与技术&网络空间安全 | 更新时间：2024-06-03

- 多尺度卷积结合Transformer的抑郁脑电分类研究
- Study of EEG classification of depression by multi-scale convolution combined with the Transformer
- 西安电子科技大学学报 2024年51卷第2期页码：182-195
- 作者机构：
  
  兰州交通大学电子与信息工程学院,甘肃兰州 730070
- 作者简介：
  
  [ "翟凤文(1979—),女,副教授,E-mail:[email protected]; " ]
  孙芳林(1998—),女,兰州交通大学硕士研究生,E-mail:[email protected]
  [ "金静(1982—),女,副教授,E-mail:[email protected]" ]
- 基金信息：
  
  甘肃省自然基金(21JR11RA062);甘肃省高校创新基金(2022A-047)
- DOI：10.19665/j.issn1001-2400.20230211
  中图分类号： TP391
- 纸质出版日期：2024-4-20，
  
  网络出版日期：2023-10-12，
  
  收稿日期：2022-11-28，
扫描看全文
翟凤文, 孙芳林, 金静. 多尺度卷积结合Transformer的抑郁脑电分类研究[J]. 西安电子科技大学学报, 2024,51(2):182-195.

Fengwen ZHAI, Fanglin SUN, Jing JIN. Study of EEG classification of depression by multi-scale convolution combined with the Transformer[J]. Journal of Xidian University, 2024,51(2):182-195.
翟凤文, 孙芳林, 金静. 多尺度卷积结合Transformer的抑郁脑电分类研究[J]. 西安电子科技大学学报, 2024,51(2):182-195. DOI： 10.19665/j.issn1001-2400.20230211.

Fengwen ZHAI, Fanglin SUN, Jing JIN. Study of EEG classification of depression by multi-scale convolution combined with the Transformer[J]. Journal of Xidian University, 2024,51(2):182-195. DOI： 10.19665/j.issn1001-2400.20230211.

摘要

在通过深度学习模型进行抑郁症类脑电信号分析时

针对单一尺度的卷积存在特征提取不充分的问题和卷积神经网络在感知脑电信号全局依赖性方面的局限性

分别设计了多尺度动态卷积网络模块和门控Transformer编码器模块

并与时间卷积网络相结合

提出了混合网络模型(MGTTCNet)进行抑郁症患者和健康对照组的脑电信号分类。该模型首先通过多尺度动态卷积从空间域和频率域捕捉脑电信号的多尺度时频信息。其次通过门控Transformer编码器学习脑电信号中的全局依赖关系

其利用多头注意力机制有效增强网络表达相关脑电信号特征的能力。之后利用时间卷积网络提取脑电信号可用的时间特征

最后将提取的抽象特征输入到分类模块进行分类。在公开数据集MODMA上用留出法和十折交叉验证法对提出模型进行实验验证

分别取得了约98.51%和98.53%的分类准确率

相较于基线单尺度模型EEGNet

分类准确率分别提升了约1.89%和1.93%

F1值分别提升了约2.05%和2.08%

kappa系数值分别提高了约0.038 1和0.038 5;同时消融实验验证了文中设计的各个模块的有效性。

Abstract

In the process of using the deep learning model to classify the EEG signals of depression

aiming at the problem of insufficient feature extraction in single-scale convolution and the limitation of the convolutional neural network in perceiving the global dependence of EEG signals

a multi-scale dynamic convolution network module and the gated transformer encoder module are designed respectively

which are combined with the temporal convolution network

and a hybrid network model MGTTCNet is proposed to classify the EEG signals of patients with depression and healthy controls.First

multi-scale dynamic convolution is used to capture the multi-scale time-frequency information of EEG signals from spatial and frequency domains.Second

the gated transformer encoder is used to learn global dependencies in EEG signals

which effectively enhances the ability of the network to express relevant EEG signal features using the multi-head attention mechanism.Third

the temporal convolution network is used to extract temporal features available for EEG signals.Finally

the extracted abstract features are fed into the classification module for classification.The proposed model is experimentally validated on the public data set MODMA using the Hold-out method and the 10-Fold Cross Validation method

with the classification accuracy being 98.51% and 98.53%

respectively.Compared with the baseline single-scale model EEGNet

the classification accuracy of the proposed model is increased by 1.89% and 1.93%

the F1 value is increased by 2.05% and 2.08%

and the kappa coefficient values are increased by 0.0381 and 0.0385

respectively.Meanwhile

the ablation experiments verify the effectiveness of each module designed in this paper.

关键词

脑电信号抑郁分类深度学习Transformer时间卷积网络

Keywords

electroencephalographydepression classificationdeep learningTransformertemporal convolutional networks

references

KARUNARATHNE A, GUNNELL D, KONRADSEN F, et al. How Many Premature Deaths From Pesticide Suicide Have Occurred Since the Agricultural Green Revolution?[J]. Clinical Toxicology, 2019, 58(4):227-232.

FRIEDRICH M J. Depressionis the Leading Cause of Disability Around the World[J]. JAMA, 2017, 317(15):1517.

SAEIDI M, KARWOWSKI W, FARAHANI F, et al. Neural Decoding of EEG Signals with Machine Learning:A Systematic Review[J]. Brain Sciences, 2021(11):1525.

SCHIRRMEISTER R, SPRINGENBERG J, FIEDERER L, et al. Deep Learning with Convolutional Neural Networks for EEG Decoding and Visualization[J]. Human Brain Mapping, 2017,38:5391-5420.

ACHARYA U, RAJENDRA S, YUKI H, et al. Automated EEG-Based Screening of Depression Using Deep Convolutional Neural Network[J]. Computer Methods and Programs in Biomedicine, 2018,161:103-113.

KARAKUS B, YILDIRIM Ö, TALO M, et al. Automated Depression Detection Using Deep Representation and Sequence Learning with EEG Signals[J]. Journal of Medical Systems, 2019,43:1-12.

UYULAN Ç, ERGÜZEL T, et al. UNUBOLH, Major Depressive Disorder Classification Based on Different Convolutional Neural Network Models:Deep Learning Approach[J]. Clinical EEG and Neuroscience, 2020,52:38-51.

DAN Y, ZHAO L L, SONG X W, et al. Automated Detection of Clinical Depression Based on Convolution Neural Network Model[J]. Biomedical Engineering/Biomedizinische Technik, 2022,67:131-142.

LAWHERN V J, SOLON A J, WAYTOWICH N R, et al. EEGNet:A Compact Convolutional Network for EEG-Based Brain-Computer Interfaces[J]. Journal of Neural Engineering, 2018, 15(5):1-17.

LIU W, JIA K B, WANG Z Z, et al. A Depression Prediction Algorithm Based on Spatiotemporal Feature of EEG Signal[J]. Brain Sciences, 2022, 12(5):630.

BAI S, KOLTER J, KOLTUN V. An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling(2022)[J/OL].[2022-11-13]. https://arxiv.org/abs/1803.01271. https://arxiv.org/abs/1803.01271https://arxiv.org/abs/1803.01271

INGOLFSSON T M, HERSCHE M, WANG X, et al. EEG-TCNet:An Accurate Temporal Convolutional Network for Embedded Motor-Imagery Brain-Machine Interfaces[C]//Proceedings of the 2020 IEEE International Conference on Systems,Man,and Cybernetics(SMC). Piscataway:IEEE, 2020:2958-2965.

HASHEMPOUR S, BOOSTANI R, MOHAMMADI M, et al. Continuous Scoring of Depressionfrom EEG Signals via a Hybrid of Convolutional Neural Networks[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2022,30:176-183.

王怡忻, 朱湘茹, 杨利军. 融合共空间模式与脑网络特征的EEG抑郁识别[J]. 计算机工程与应用, 2021, 58(22):150-158.

WANG Yixin, ZHU Xiangru, YANG Lijun. EEG Depression Recognition Based on Feature Fusion of Common Spatial Pattern and Brain Connectivity[J]. Computer Engineering and Applications, 2021, 58(22):150-158.

VASWANI A, SHAZEER N, PARMAR N, et al. Attention is All You Need[C]// Proceedings of the in Advances in Neural Information Processing Systems(NIPS). San Diego: NIPS, 2017:5998-6008.

SONG Y H, JIA X Y, YANG L, et al. Transformer-Based Spatial-Temporal Feature Learning for EEG Decoding(2022)[J/OL].[2022-11-13]. https://arxiv.org/abs/2106.11170. https://arxiv.org/abs/2106.11170https://arxiv.org/abs/2106.11170

CASAL R, PERSIA L, SCHLOTTHAUER G. Temporal Convolutional Networks and Transformers for Classifying the Sleep Stage in Awake or Asleep Using Pulse Oximetry Signals[J]. Journal of Computational Science, 2022,59:101544.

MA Y, SONG Y, GAO F. A Novel Hybrid CNN-Transformer Model for EEG Motor Imagery Classification[C]// Proceedings of the IEEE International Joint Conference on Neural Network(IJCNN). Piscataway:IEEE, 2022:1-8.

张静, 张雪英, 陈桂军, 等. 结合3D-CNN和频-空注意力机制的EEG情感识别[J]. 西安电子科技大学学报, 2022, 49(3):191-198.

ZHANG Jing, ZHANG Xueying, CHEN Guijun, et al. EEG Emotion Recognition Based on the 3D-CNN and Spatial-Frequency Attention Mechanism[J]. Journal of Xidian University, 2022, 49(3):191-198.

DAUPHIN Y, FAN A, AULI M, et al. Language Modeling with Gated Convolutional Networks[C]// Proceedings of the 34th International Conference on Machine Learning(ICML). New York: ACM, 2017:933-941.

HE K, ZHANG X, REN S, et al. Deep Residual Learning for Image Recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition(CVPR). Piscataway:IEEE, 2016:770-778.

CAI H S, YUAN Z Q, GAO Y P, et al. A Multi-Modal Open Dataset for Mental-Disorder Analysis[J]. Scientific Data, 2022,9:178-188.

ARBANAS G. Diagnostic and Statistical Manual of Mental Disorders(DSM-5)[J]. Alcoholism and psychiatry research, 2015,51:61-64.

SUN S T, LI J X, CHEN H Y, et al. A Study of Resting-State EEG Biomarkers for Depression Recognition(2022)[J/OL].[2022-10-23]. https://arxiv.org/abs/2002.11039. https://arxiv.org/abs/2002.11039https://arxiv.org/abs/2002.11039

SEAL A, BAJPAI R, AGNIHOTRI J, et al. DeprNet:A Deep Convolution Neural Network Framework for Detecting Depression Using EEG[J]. IEEE Transactions on Instrumentation and Measurement, 2021,70:1-13.

JAS M, ENGEMANN D, BEKHTI Y, et al. Autoreject:Automated Artifact Rejection for MEG and EEG Data[J]. Neuroimage, 2016,159:417-429.

HASANZADEH F, MOHEBBI M, ROSTAMI R. Graph Theory Analysis of Directed Functional Brain Networks in Major Depressive Disorder Based on EEG Signal[J]. Journal of Neural Engineering, 2020, 17(2):026010.

SUN S T, CHEN H Y, SHAO X X, et al. EEG Based Depression Recognition by Combining Functional Brain Network and Traditional Biomarkers[C]//Proceedings of the 2020 IEEE International Conference on Bioinformatics and Biomedicine(BIBM). Piscataway:IEEE, 2020:2074-2081.

尚照岩, 乔晓艳. 轻度抑郁症脑电特征分析与机器识别研究[J]. 测试技术学报, 2022, 36(6):498-505.

SHANG Zhaoyan, QIAO Xiaoyan. Study on Analysis and Recognition of EEG Characteristics of Mild Depression[J]. Journal of Test and Measurement Technology, 2022, 36(6):498-505.

SANTAMARIA V E, MARTINEZ C V, VAQUERIZO V F, et al. EEG-Inception:A Novel Deep Convolutional Neural Network for Assistive ERP-Based Brain-Computer Interfaces[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2020, 28(12):2773-2782.

SALAMI A, ANDREU-PEREZ J, GILLMEISTER H. EEG-ITNet:An Explainable Inception Temporal Convolutional Network for Motor Imagery Classification[J]. IEEE Access, 2022,10:36672-36685.

ZHANG X W, LI J L, HOU K C, et al. EEG-Based Depression Detection Using Convolutional Neural Network with Demographic Attention Mechanism[C]//Proceedings of the annual International Conference of the IEEE Engineering in Medicine and Biology Society(EMBC). Piscataway:IEEE, 2020:128-133.

WANG Y X, LIU F R, YANG L J. EEG-Based Depression Recognition Using Intrinsic Time-scale Decomposition and Temporal Convolution Network[C]//Proceedings of the International Conference on Biological Information and Biomedical Engineering(BIBE). New York: ACM, 2021:1-6.

DENG X, FAN X F, LV X W, et al. SparNet:A Convolutional Neural Network for EEG Space-Frequency Feature Learning and Depression Discrimination[J]. Frontiers in Neuroinformatics, 2022,16:914823.

MAATEN L, HINTON G. Visualizing Data Using t-SNE[J]. Journal of Machine Learning Research, 2008,9:2579-2605.

浏览量

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

结合3D-CNN和频-空注意力机制的EEG情感识别

一种高效的软件模糊测试种子生成方法

融合全局和局部信息的实时烟雾分割算法

三维注意力增强的暴力场景检测算法

用于语义分割的自监督对比式表征学习