Noise-robust whispered speech recognition using a non-audible-murmur microphone with VTS compensation

Chen-Yu Yang, G. Brown, Liang Lu, J. Yamagishi, S. King

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract / Description of output

In this paper, we introduce a newly-created corpus of whispered speech simultaneously recorded via a close-talking microphone and a non-audible murmur (NAM) microphone in both clean and noisy conditions. To benchmark the corpus, which has been freely released recently, experiments on automatic recognition of continuous whispered speech were conducted. When training and test conditions are matched, the NAM microphone is found to be more robust against background noise than the close-talking microphone. In mismatched conditions (noisy data, models trained on clean speech), we found that Vector Taylor Series (VTS) compensation is particularly effective for the NAM signal.
Original languageEnglish
Title of host publicationChinese Spoken Language Processing (ISCSLP), 2012 8th International Symposium on
PublisherInstitute of Electrical and Electronics Engineers
Pages220-223
Number of pages4
ISBN (Electronic)978-1-4673-2505-9
DOIs
Publication statusPublished - 4 Dec 2012

Keywords / Materials (for Non-textual outputs)

  • microphones
  • speech recognition
  • NAM microphone
  • VTS compensation
  • clean conditions
  • close-talking microphone
  • noise-robust whispered speech recognition
  • noisy conditions
  • non-audible-murmur microphone
  • vector Taylor series compensation
  • Acoustics
  • Hidden Markov models
  • Microphones
  • Noise
  • Noise measurement
  • Speech
  • Speech recognition
  • noise robustness
  • non-audible murmur (NAM)
  • silent speech interface (SSI)
  • vector Taylor series (VTS)
  • whisper recognition

Fingerprint

Dive into the research topics of 'Noise-robust whispered speech recognition using a non-audible-murmur microphone with VTS compensation'. Together they form a unique fingerprint.

Cite this