TY - GEN
T1 - Detecting Deepfakes with Super-Resolution EEG
AU - Al-Sharawi, Ramzi
AU - Athar, Hamza
AU - Khan, M. Riyyan
AU - Tariq, Usman
AU - Al Shargie, Fares
AU - Dhall, Abhinav
AU - Al Nashash, Hasan
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - Electroencephalogram (EEG) signals play a crucial role as biomarkers of brain activity, providing valuable insights into neural processes. The spatial resolution of EEG, determined by the number of channels, is essential for obtaining a comprehensive understanding of brain functions. However, low-resolution EEG systems pose a significant challenge in capturing detailed brain processes. In this paper we propose a deep autoencoder structure that essentially takes in the information from low resolution (LR) 32 channels of EEG and outputs a super-resolution (SR) 63 channel EEG signal. Our proposed approach, draws its inspiration from image super-resolution literature, and greatly improves on traditional interpolation approaches such as bilinear interpolation, with a 74.69% reduction in mean-squared error (MSE), 27.70% increase in correlation, and 25.19% increase in peak signal-to-noise (PSNR) ratio. Furthermore, the resulting LR, SR, and original high resolution (HR) signals were used within a Naive Bayes for deepfake classification; this yielded similar SR and HR classification results (61.13% and 62.21%, respectively), whereas the LR classification lagged behind both, with an average accuracy of 58.35%. This serves as a proof-of-concept for generating higher resolution EEG from low resolution data to channels as high as 63 with a simple autoencoder based structure, with application to deepfake detection.
AB - Electroencephalogram (EEG) signals play a crucial role as biomarkers of brain activity, providing valuable insights into neural processes. The spatial resolution of EEG, determined by the number of channels, is essential for obtaining a comprehensive understanding of brain functions. However, low-resolution EEG systems pose a significant challenge in capturing detailed brain processes. In this paper we propose a deep autoencoder structure that essentially takes in the information from low resolution (LR) 32 channels of EEG and outputs a super-resolution (SR) 63 channel EEG signal. Our proposed approach, draws its inspiration from image super-resolution literature, and greatly improves on traditional interpolation approaches such as bilinear interpolation, with a 74.69% reduction in mean-squared error (MSE), 27.70% increase in correlation, and 25.19% increase in peak signal-to-noise (PSNR) ratio. Furthermore, the resulting LR, SR, and original high resolution (HR) signals were used within a Naive Bayes for deepfake classification; this yielded similar SR and HR classification results (61.13% and 62.21%, respectively), whereas the LR classification lagged behind both, with an average accuracy of 58.35%. This serves as a proof-of-concept for generating higher resolution EEG from low resolution data to channels as high as 63 with a simple autoencoder based structure, with application to deepfake detection.
KW - PSNR
KW - Pearson correlation coefficient
KW - Super-resolution
KW - autoencoder
KW - deepfake classification
KW - interpolation
UR - https://www.scopus.com/pages/publications/85215001699
U2 - 10.1109/EMBC53108.2024.10782476
DO - 10.1109/EMBC53108.2024.10782476
M3 - Conference contribution
C2 - 40039082
AN - SCOPUS:85215001699
T3 - Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS
BT - 46th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2024 - Proceedings
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 46th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2024
Y2 - 15 July 2024 through 19 July 2024
ER -