EEG-based classification of bilingual unspoken speech using ANN

Advait Balaji, Aparajita Haldar, Keshav Patil, T. Sai Ruthvik, Valliappan Ca, Mayur Jartarkar, Veeky Baths

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract / Description of output

The ability to interpret unspoken or imagined speech through electroencephalography (EEG) is of therapeutic interest for people suffering from speech disorders and 'lockedin' syndrome. It is also useful for brain-computer interface (BCI) techniques not involving articulatory actions. Previous work has involved using particular words in one chosen language and training classifiers to distinguish between them. Such studies have reported accuracies of 40-60% and are not ideal for practical implementation. Furthermore, in today's multilingual society, classifiers trained in one language alone might not always have the desired effect. To address this, we present a novel approach to improve accuracy of the current model by combining bilingual interpretation and decision making. We collect data from 5 subjects with Hindi and English as primary and secondary languages respectively and ask them 20 'Yes'/'No' questions ('Haan'/'Na' in Hindi) in each language. We choose sensors present in regions important to both language processing and decision making. Data is preprocessed, and Principal Component Analysis (PCA) is carried out to reduce dimensionality. This is input to Support Vector Machine (SVM), Random Forest (RF), AdaBoost (AB), and Artificial Neural Networks (ANN) classifiers for prediction. Experimental results reveal best accuracy of 85.20% and 92.18% for decision and language classification respectively using ANN. Overall accuracy of bilingual speech classification is 75.38%.

Original languageEnglish
Title of host publication2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC 2017)
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1022-1025
Number of pages4
ISBN (Electronic)9781509028092
DOIs
Publication statusPublished - 13 Sept 2017
Event39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society - Jeju Island, Korea, Republic of
Duration: 11 Jul 201715 Jul 2017
https://embc.embs.org/2017/

Publication series

NameProceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS
ISSN (Print)1557-170X

Conference

Conference39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society
Abbreviated titleEMBC 2017
Country/TerritoryKorea, Republic of
CityJeju Island
Period11/07/1715/07/17
Internet address

Keywords / Materials (for Non-textual outputs)

  • sensors
  • electroencephalography
  • support vector machines
  • speech
  • radio frequency
  • training
  • sensitivity

Fingerprint

Dive into the research topics of 'EEG-based classification of bilingual unspoken speech using ANN'. Together they form a unique fingerprint.

Cite this