The brain-computer interface (BCI) based on motor imagery electroencephalography (MI-EEG) enables direct information interaction between the human brain and external devices. In this paper, a multi-scale EEG feature extraction convolutional neural network model based on time series data enhancement is proposed for decoding MI-EEG signals. First, an EEG signals augmentation method was proposed that could increase the information content of training samples without changing the length of the time series, while retaining its original features completely. Then, multiple holistic and detailed features of the EEG data were adaptively extracted by multi-scale convolution module, and the features were fused and filtered by parallel residual module and channel attention. Finally, classification results were output by a fully connected network. The application experimental results on the BCI Competition IV 2a and 2b datasets showed that the proposed model achieved an average classification accuracy of 91.87% and 87.85% for the motor imagery task, respectively, which had high accuracy and strong robustness compared with existing baseline models. The proposed model does not require complex signals pre-processing operations and has the advantage of multi-scale feature extraction, which has high practical application value.
In order to meet the need of autonomous control of patients with severe limb disorders, this paper designs a nursing bed control system based on motor imagery-brain computer interface (MI-BCI). In view of the low decoding performance of cross-subjects and the dynamic fluctuation of cognitive state in the existing MI-BCI technology, the neural network structure optimization and user interaction feedback enhancement are improved. Firstly, the optimized dual-branch graph convolution multi-scale neural network integrates dynamic graph convolution and multi-scale convolution. The average classification accuracy is higher than that of multi-scale attention temporal convolution network, Gram angle field combined with convolution long short term memory hybrid network, Transformer-based graph convolution network and other existing methods. Secondly, a dual visual feedback mechanism is constructed, in which electroencephalogram (EEG) topographic map feedback can improve the discrimination of spatial patterns, and attention state feedback can enhance the temporal stability of signals. Compared with the single EEG topographic map feedback and non-feedback system, the average classification accuracy of the proposed method is also greatly improved. Finally, in the four classification control task of nursing bed, the average control accuracy of the system is 90.84%, and the information transmission rate is 84.78 bits/min. In summary, this paper provides a reliable technical solution for improving the autonomous interaction ability of patients with severe limb disorders, which has important theoretical significance and application value.
ObjectiveTo investigate the feasibility and effectiveness of motor imagery based brain computer interface with wrist passive movement in chronic stroke patients with wrist extension impairment.MethodsFifteen chronic stroke patients with a mean age of (47.60±14.66) years were recruited from March 2017 to June 2018. At baseline, motor imagery ability was assessed first. Then motor imagery based brain computer interface with wrist passive movement was given as an intervention. Both range of motion of paretic wrist and Barthel index was assessed before and after the intervention.ResultsAmong the 15 chronic stroke patients admitted in the study, 12 finished the whole therapy, and 3 failed to pass the initial assessment. After the therapy, the 12 participants who completed the whole sessions of the treatment and follow up had improved ability of control electroencephalogram, in whom 9 regained the ability to actively extend the affected wrist, and the other 3 failed to actively extend their wrist (the rate of active extending wrist was 75%). The activity of daily life of all the participants did not change significantly before and after intervention, and no discomfort was found after daily treatment.ConclusionIn chronic stroke patients with wrist extension impairment, motor imagery based brain computer interface with wrist passive movement training is feasible and effective.
To accurately capture and address the multi-dimensional feature variations in cross-subject motor imagery electroencephalogram (MI-EEG), this paper proposes a time-frequency transform and Riemannian manifold based domain adaptation network (TFRMDANet) in a high-dimensional brain source space. Source imaging technology was employed to reconstruct neural electrical activity and compute regional cortical dipoles, and the multi-subband time-frequency feature data were constructed via wavelet transform. The two-stage multi-branch time–frequency–spatial feature extractor with squeeze-and-excitation (SE) modules was designed to extract local features and cross-scale global features from each subband, and the channel attention and multi-scale feature fusion were introduced simultaneously for feature enhancement. A Riemannian manifold embedding-based structural feature extractor was used to capture high-order discriminative features, while adversarial training promoted domain-invariant feature learning. Experiments on public BCI Competition IV dataset 2a and High-Gamma dataset showed that TFRMDANet achieved classification accuracies of 77.82% and 90.47%, with Kappa values of 0.704 and 0.826, and F1-scores of 0.780 and 0.905, respectively. The results demonstrate that cortical dipoles provide accurate time–frequency representations of MI features, and the unique multi-branch architecture along with its strong time–frequency–spatial–structural feature extraction capability enables effective domain adaptation enhancement in brain source space.
The bidirectional closed-loop motor imagery brain-computer interface (MI-BCI) is an emerging method for active rehabilitation training of motor dysfunction, extensively tested in both laboratory and clinical settings. However, no standardized method for evaluating its rehabilitation efficacy has been established, and relevant literature remains limited. To facilitate the clinical translation of bidirectional closed-loop MI-BCI, this article first introduced its fundamental principles, reviewed the rehabilitation training cycle and methods for evaluating rehabilitation efficacy, and summarized approaches for evaluating system usability, user satisfaction and usage. Finally, the challenges associated with evaluating the rehabilitation efficacy of bidirectional closed-loop MI-BCI were discussed, aiming to promote its broader adoption and standardization in clinical practice.
Transcranial alternating current stimulation (tACS) holds significant potential for improving motor function in stroke patients, but its underlying mechanisms remain unclear. In this study, 20 Hz tACS was applied to 15 stroke patients, and their motor imagery (MI) signals were collected before and after stimulation, which were for assessment by combining with the Fugl-Meyer Assessment for Upper Extremity (FMA-UE). Additionally, 11 subjects were recruited as a healthy control group. The study demonstrated that FMA-UE scores of stroke patients significantly increased after tACS intervention. The duration of EEG microstate C and F decreased significantly, while microstate D (coverage, duration, and occurrence probability) increased markedly, and microstate E decreased. The transition probabilities of C→D and D→B were positively correlated with FMA-UE scores. Based on these findings, this study concludes that 20 Hz tACS can enhance neuroplasticity and motor function in patients, and the transition probabilities (C→D/D→B) may serve as potential indicators for assessing motor function, providing experimental evidence for the clinical application of tACS and the development of rehabilitation brain-computer interfaces.
This paper proposes a motor imagery recognition algorithm based on feature fusion and transfer adaptive boosting (TrAdaboost) to address the issue of low accuracy in motor imagery (MI) recognition across subjects, thereby increasing the reliability of MI-based brain-computer interfaces (BCI) for cross-individual use. Using the autoregressive model, power spectral density and discrete wavelet transform, time-frequency domain features of MI can be obtained, while the filter bank common spatial pattern is used to extract spatial domain features, and multi-scale dispersion entropy is employed to extract nonlinear features. The IV-2a dataset from the 4th International BCI Competition was used for the binary classification task, with the pattern recognition model constructed by combining the improved TrAdaboost integrated learning algorithm with support vector machine (SVM), k nearest neighbor (KNN), and mind evolutionary algorithm-based back propagation (MEA-BP) neural network. The results show that the SVM-based TrAdaboost integrated learning algorithm has the best performance when 30% of the target domain instance data is migrated, with an average classification accuracy of 86.17%, a Kappa value of 0.723 3, and an AUC value of 0.849 8. These results suggest that the algorithm can be used to recognize MI signals across individuals, providing a new way to improve the generalization capability of BCI recognition models.
Motor imagery (MI) is a mental process that can be recognized by electroencephalography (EEG) without actual movement. It has significant research value and application potential in the field of brain-computer interface (BCI) technology. To address the challenges posed by the non-stationary nature and low signal-to-noise ratio of MI-EEG signals, this study proposed a Riemannian spatial filtering and domain adaptation (RSFDA) method for improving the accuracy and efficiency of cross-session MI-BCI classification tasks. The approach addressed the issue of inconsistent data distribution between source and target domains through a multi-module collaborative framework, which enhanced the generalization capability of cross-session MI-EEG classification models. Comparative experiments were conducted on three public datasets to evaluate RSFDA against eight existing methods in terms of classification accuracy and computational efficiency. The experimental results demonstrated that RSFDA achieved an average classification accuracy of 79.37%, outperforming the state-of-the-art deep learning method Tensor-CSPNet (76.46%) by 2.91% (P < 0.01). Furthermore, the proposed method showed significantly lower computational costs, requiring only approximately 3 minutes of average training time compared to Tensor-CSPNet’s 25 minutes, representing a reduction of 22 minutes. These findings indicate that the RSFDA method demonstrates superior performance in cross-session MI-EEG classification tasks by effectively balancing accuracy and efficiency. However, its applicability in complex transfer learning scenarios remains to be further investigated.
The effective classification of multi-task motor imagery electroencephalogram (EEG) is helpful to achieve accurate multi-dimensional human-computer interaction, and the high frequency domain specificity between subjects can improve the classification accuracy and robustness. Therefore, this paper proposed a multi-task EEG signal classification method based on adaptive time-frequency common spatial pattern (CSP) combined with convolutional neural network (CNN). The characteristics of subjects' personalized rhythm were extracted by adaptive spectrum awareness, and the spatial characteristics were calculated by using the one-versus-rest CSP, and then the composite time-domain characteristics were characterized to construct the spatial-temporal frequency multi-level fusion features. Finally, the CNN was used to perform high-precision and high-robust four-task classification. The algorithm in this paper was verified by the self-test dataset containing 10 subjects (33 ± 3 years old, inexperienced) and the dataset of the 4th 2018 Brain-Computer Interface Competition (BCI competition Ⅳ-2a). The average accuracy of the proposed algorithm for the four-task classification reached 93.96% and 84.04%, respectively. Compared with other advanced algorithms, the average classification accuracy of the proposed algorithm was significantly improved, and the accuracy range error between subjects was significantly reduced in the public dataset. The results show that the proposed algorithm has good performance in multi-task classification, and can effectively improve the classification accuracy and robustness.
Aiming at the problem of low recognition accuracy of motor imagery electroencephalogram signal due to individual differences of subjects, an individual adaptive feature representation method of motor imagery electroencephalogram signal is proposed in this paper. Firstly, based on the individual differences and signal characteristics in different frequency bands, an adaptive channel selection method based on expansive relevant features with label F (ReliefF) was proposed. By extracting five time-frequency domain observation features of each frequency band signal, ReliefF algorithm was employed to evaluate the effectiveness of the frequency band signal in each channel, and then the corresponding signal channel was selected for each frequency band. Secondly, a feature representation method of common space pattern (CSP) based on fast correlation-based filter (FCBF) was proposed (CSP-FCBF). The features of electroencephalogram signal were extracted by CSP, and the best feature sets were obtained by using FCBF to optimize the features, so as to realize the effective state representation of motor imagery electroencephalogram signal. Finally, support vector machine (SVM) was adopted as a classifier to realize identification. Experimental results show that the proposed method in this research can effectively represent the states of motor imagery electroencephalogram signal, with an average identification accuracy of (83.0±5.5)% for four types of states, which is 6.6% higher than the traditional CSP feature representation method. The research results obtained in the feature representation of motor imagery electroencephalogram signal lay the foundation for the realization of adaptive electroencephalogram signal decoding and its application.