TY - JOUR
T1 - Domain Adaptation Techniques for EEG-based Emotion Recognition
T2 - A Comparative Study on Two Public Datasets
AU - Lan, Zirui
AU - Sourina, Olga
AU - Wang, Lipo
AU - Scherer, Reinhold
AU - Muller-Putz, Gernot R.
PY - 2019/3
Y1 - 2019/3
N2 - Affective brain-computer interface (aBCI) introduces personal affective factors to human-computer interaction. The state-of-the-art aBCI tailors its classifier to each individual user to achieve accurate emotion classification. A subject-independent classifier that is trained on pooled data from multiple subjects generally leads to inferior accuracy, due to the fact that encephalogram (EEG) patterns vary from subject to subject. Transfer learning or domain adaptation techniques have been leveraged to tackle this problem. Existing studies have reported successful applications of domain adaptation techniques on SEED dataset. However, little is known about the effectiveness of the domain adaptation techniques on other affective datasets or in a cross-dataset application. In this paper, we focus on a comparative study on several state-of-the-art domain adaptation techniques on two datasets: DEAP and SEED. We demonstrate that domain adaptation techniques can improve the classification accuracy on both datasets, but not so effective on DEAP as on SEED. Then, we explore the efficacy of domain adaptation in a cross-dataset setting when the data are collected under different environments using different devices and experimental protocols. Here, we propose to apply domain adaptation to reduce the inter-subject variance as well as technical discrepancies between datasets, and then train a subject-independent classifier on one dataset and test on the other. Experiment results show that using domain adaptation technique in a transductive adaptation setting can improve the accuracy significantly by 7.25% -13.40% compared to the baseline accuracy where no domain adaptation technique is used.
AB - Affective brain-computer interface (aBCI) introduces personal affective factors to human-computer interaction. The state-of-the-art aBCI tailors its classifier to each individual user to achieve accurate emotion classification. A subject-independent classifier that is trained on pooled data from multiple subjects generally leads to inferior accuracy, due to the fact that encephalogram (EEG) patterns vary from subject to subject. Transfer learning or domain adaptation techniques have been leveraged to tackle this problem. Existing studies have reported successful applications of domain adaptation techniques on SEED dataset. However, little is known about the effectiveness of the domain adaptation techniques on other affective datasets or in a cross-dataset application. In this paper, we focus on a comparative study on several state-of-the-art domain adaptation techniques on two datasets: DEAP and SEED. We demonstrate that domain adaptation techniques can improve the classification accuracy on both datasets, but not so effective on DEAP as on SEED. Then, we explore the efficacy of domain adaptation in a cross-dataset setting when the data are collected under different environments using different devices and experimental protocols. Here, we propose to apply domain adaptation to reduce the inter-subject variance as well as technical discrepancies between datasets, and then train a subject-independent classifier on one dataset and test on the other. Experiment results show that using domain adaptation technique in a transductive adaptation setting can improve the accuracy significantly by 7.25% -13.40% compared to the baseline accuracy where no domain adaptation technique is used.
KW - affective brain-computer interface (aBCI)
KW - Brain-computer interfaces
KW - cross dataset.
KW - domain adaptation
KW - Electroencephalogram (EEG)
KW - Electroencephalography
KW - Emotion recognition
KW - emotion recognition
KW - Feature extraction
KW - Motion pictures
KW - Task analysis
KW - Training
KW - transfer learning
UR - http://www.scopus.com/inward/record.url?scp=85048330084&partnerID=8YFLogxK
U2 - 10.1109/TCDS.2018.2826840
DO - 10.1109/TCDS.2018.2826840
M3 - Article
AN - SCOPUS:85048330084
SN - 2379-8920
VL - 11
SP - 85
EP - 94
JO - IEEE Transactions on Cognitive and Developmental Systems
JF - IEEE Transactions on Cognitive and Developmental Systems
IS - 1
ER -