Centre for Speech Technology Research

Research output

Research output per year 1995 2021

• 591 Conference contribution
• 126 Article
• 13 Chapter
• 5 Chapter (peer-reviewed)
• 29 More
  • 4 Book
  • 4 Other chapter contribution
  • 4 Working paper
  • 3 Paper
  • 3 Poster
  • 2 Special issue
  • 2 Doctoral Thesis
  • 1 Entry for encyclopedia/dictionary
  • 1 Foreword/postscript
  • 1 Other
  • 1 Editorial
  • 1 Literature review
  • 1 Digital or Visual Products
  • 1 Other contribution

Research output per year

Research output per year

Search results

• 2021

  Adaptation Algorithms for Neural Network-Based Speech Recognition: An Overview

  Bell, P., Fainberg, J., Klejch, O., Li, J., Renals, S. & Swietojanski, P., 2021, In: IEEE Open Journal of Signal Processing. 2, p. 33-66 34 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Speech recognition
  • Neural networks
  • Embeddings (Algorithms)
  • Hidden Markov models

• Exploiting ultrasound tongue imaging for the automatic detection of speech articulation errors

  Ribeiro, M. S., Cleland, J., Eshky, A., Richmond, K. & Renals, S., Apr 2021, In: Speech Communication. 128, p. 24-34

  Research output: Contribution to journal › Article › peer-review

  • Ultrasound
  • Speech
  • Articulation
  • Imaging
  • Tongue
• 2020

  An overview of voice conversion and its challenges: From statistical modeling to deep learning

  Sisman, B., Yamagishi, J., King, S. & Li, H., 17 Nov 2020, In: IEEE/ACM Transactions on Audio, Speech and Language Processing. 29, p. 132-157 26 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Statistical Modeling
  • learning
  • Deep learning
  • Learning
  • Prosody

• ASVspoof 2019: A large-scale public database of synthesized, converted and replayed speech

  Wang, X., Yamagishi, J., Todisco, M., Delgado, H., Nautsch, A., Evans, N., Sahidullah, M., Vestman, V., Kinnunen, T., Lee, K. A., Juvela, L., Alku, P., Peng, Y-H., Hwang, H-T., Tsao, Y., Wang, H-M., Maguer, S. L., Becker, M., Henderson, F., Clark, R. & 20 others, Zhang, Y., Wang, Q., Jia, Y., Onuma, K., Mushika, K., Kaneda, T., Jiang, Y., Liu, L-J., Wu, Y-C., Huang, W-C., Toda, T., Tanaka, K., Kameoka, H., Steiner, I., Matrouf, D., Bonastre, J-F., Govender, A., Ronanki, S., Zhang, J-X. & Ling, Z-H., 30 Nov 2020, In: Computer Speech and Language. 64, 27 p., 101114.

  Research output: Contribution to journal › Article › peer-review

  • Speech
  • Speaker Verification
  • Countermeasures
  • Attack
  • Automatic Verification

• A Vector Quantized Variational Autoencoder (VQ-VAE) Autoregressive Neural F0 Model for Statistical Parametric Speech Synthesis

  Wang, X., Takaki, S., Yamagishi, J., King, S. & Tokuda, K., 1 Jan 2020, In: IEEE/ACM Transactions on Audio, Speech and Language Processing. 28, p. 157-170 13 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Speech Synthesis
  • Speech synthesis
  • Linguistics
  • linguistics
  • Recurrent Neural Networks

• Integrating lexical and prosodic features for automatic paragraph segmentation

  Lai, C., Farrús, M. & Moore, J., Aug 2020, In: Speech Communication. 121, p. 44-57

  Research output: Contribution to journal › Article › peer-review

  • Discourse
  • Segmentation
  • segmentation
  • Paragraph
  • Speech

• Neural Source-Filter Waveform Models for Statistical Parametric Speech Synthesis

  Wang, X., Takaki, S. & Yamagishi, J., 2020, In: IEEE/ACM Transactions on Audio, Speech and Language Processing. 28, p. 402-415 14 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Speech Synthesis
  • Speech synthesis
  • Waveform
  • Filter
  • waveforms
• 2019

  Complex-Valued Restricted Boltzmann Machine for Speaker-Dependent Speech Parameterization from Complex Spectra

  Nakashika, T., Takaki, S. & Yamagishi, J., Feb 2019, In: IEEE/ACM Transactions on Audio, Speech and Language Processing. p. 244-254 11 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Boltzmann Machine
  • Speech
  • parameterization
  • Parameterization
  • Dependent

• Comunicaci ́on enriquecida a lo largo de la vida

  Cooke, M., King, S., Hazan, V., Stylianou, Y., Janse, E., Baskent, D., Hohmann, V., Winneke, A. & Hernaez, I., 2019, In: Procesamiento del Lenguaje Natural. 63, p. 175-178

  Research output: Contribution to journal › Article › peer-review

  Open Access

  • Life Span
  • life-span
  • Communication
  • communication
  • Enrichment

• Normal-to-Lombard Adaptation of Speech Synthesis Using Long Short-Term Memory Recurrent Neural Networks

  Bollepalli, B., Juvela, L., Airaksinen, M., Valentini Botinhao, C. & Alku, P., 1 Jul 2019, In: Speech Communication. 110, p. 64-75 21 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Speech Synthesis
  • Vocoders
  • Recurrent Neural Networks
  • Memory Term
  • Long short-term memory

• Recognizing Induced Emotions of Movie Audiences From Multimodal Information

  Muszynski, M., Tian, L., Lai, C., Moore, J., Kostoulas, T., Lombardo, P., Pun, T. & Chanel, G., 27 Feb 2019, In: IEEE Transactions on Affective Computing. 17 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Fusion reactions
  • Experiments

• Spatio-temporal generative adversarial network for gait anonymization

  Tieu, N. D. T., Nguyen, H. H., Nguyen-Son, H. Q., Yamagishi, J. & Echizen, I., 1 Jun 2019, In: Journal of Information Security and Applications. 46, p. 307-319 13 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Discriminators
  • Law enforcement

• НЕЙРОСЕТЕВОЕ МОДЕЛИРОВАНИЕ ГРАФЕМНО-ФОНЕМНОГО ПРЕОБРАЗОВАНИЯ: АВТОМАТИЧЕСКИЙ МОРФОЛОГИЧЕСКИЙ АНАЛИЗ

  Bikmetova, M. & Richmond, K., 4 Jul 2019, In: ВЕСТНИК УФИМСКОГО ГОСУДАРСТВЕННОГО АВИАЦИОННОГО ТЕХНИЧЕСКОГО УНИВЕРСИТЕТА . 23, 2(84), p. 121-126

  Research output: Contribution to journal › Article › peer-review

  Open Access

  • Transducers
  • Neural networks
  • Speech synthesis
  • Glossaries
  • Experiments
• 2018

  A Comparison Between STRAIGHT, Glottal, an Sinusoidal Vocoding in Statistical Parametric Speech Synthesis

  Airaksinen, M., Juvela, L., Bollepalli, B., Yamagishi, J. & Alku, P., 11 May 2018, In: IEEE/ACM Transactions on Audio, Speech and Language Processing. 26, 9, p. 1658-1670 13 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Speech Synthesis
  • Voice
  • Text-to-speech
  • Speech
  • Speech synthesis

• A multilinear tongue model derived from speech related MRI data of the human vocal tract

  Hewer, A., Wuhrer, S., Steiner, I. & Richmond, K., 21 Feb 2018, In: Computer Speech and Language. 51, p. 68-92

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Speech
  • Magnetic resonance imaging
  • Human
  • 3D Imaging
  • Motion Capture

• Autoregressive neural F0 model for statistical parametric speech synthesis

  Wang, X., Takaki, S. & Yamagishi, J., 19 Apr 2018, In: IEEE/ACM Transactions on Audio, Speech and Language Processing. 26, 8, p. 1406-1419 14 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Speech Synthesis
  • Recurrent Neural Networks
  • Speech synthesis
  • AR Model
  • synthesis

• Investigating different representations for modeling and controlling multiple emotions in DNN-based speech synthesis

  Lorenzo-Trueba, J., Eje Henter, G., Takaki, S., Yamagishi, J., Morino, Y. & Ochiai, Y., May 2018, In: Speech Communication. 99, p. 135-143 9 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Speech Synthesis
  • Emotion
  • Speech synthesis
  • Modeling
  • emotion

• Speech Enhancement of Noisy and Reverberant Speech for Text-to-Speech

  Valentini Botinhao, C. & Yamagishi, J., 1 Aug 2018, In: IEEE/ACM Transactions on Audio, Speech and Language Processing. 26, 8, p. 1420-1433 14 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Text-to-speech
  • Speech Enhancement
  • Speech
  • Speech enhancement
  • Voice
• 2017

  ASVspoof: the Automatic Speaker Verification Spoofing and Countermeasures Challenge

  Wu, Z., Yamagishi, J., Kinnunen, T., Hanilc, C., Sahidullah, M., Sizov, A., Evans, N., Todisco, M. & Delgado, H., Jun 2017, In: IEEE Journal of Selected Topics in Signal Processing. 11, 4, p. 588-604 17 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Acoustic waves
  • Network protocols

• End-to-end neural segmental models for speech recognition

  Hao, T., Lu, L., Kong, L., Gimpel, K., Livescu, K., Dyer, C., Smith, N. A. & Renals, S., 14 Sep 2017, In: IEEE Journal of Selected Topics in Signal Processing. 11, 8, p. 1254-1264 11 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Speech recognition
  • Neural networks
  • Recurrent neural networks
  • Transducers
  • Acoustics

• Influence of speaker familiarity on blind and visually impaired children’s and young adults’ perception of synthetic voices

  Puchera, M., Zillinger, B., Toman, M., Schabus, D., Valentini Botinhao, C., Yamagishi, J., Schmid, E. & Woltron, T., 1 Nov 2017, In: Computer Speech and Language. 46, p. 179-195 10 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Visually Impaired
  • Voice
  • Perception
  • Influence
  • Game

• Investigating very deep highway networks for parametric speech synthesis

  Wang, X., Takaki, S. & Yamagishi, J., 8 Nov 2017, In: Speech Communication. 96, p. 1-9 9 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Speech Synthesis
  • Speech synthesis
  • Acoustics
  • Deep neural networks
  • Neural networks

• Multitask Learning of Context-Dependent Targets in Deep Neural Network Acoustic Models

  Bell, P., Swietojanski, P. & Renals, S., 1 Feb 2017, In: IEEE/ACM Transactions on Audio, Speech and Language Processing. 25, 2, p. 238 - 247 10 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Multi-task Learning
  • Acoustic Model
  • Network Model
  • Deep neural networks
  • learning

• Small-footprint highway deep neural networks for speech recognition

  LU, L. & Renals, S., Jul 2017, In: IEEE/ACM Transactions on Audio, Speech and Language Processing. 25, 7, p. 1502-1511 10 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Speech Recognition
  • speech recognition
  • Acoustic Model
  • footprints
  • Deep neural networks

• Using eigenvoices and nearest-neighbours in HMM-based cross-lingual speaker adaptation with limited data

  Sarfjoo, S. S., Demiroglu, C. & King, S., Apr 2017, In: IEEE/ACM Transactions on Audio, Speech and Language Processing. 25, 4, p. 839-851 13 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Speaker Adaptation
  • Nearest Neighbor
  • Speech
  • Speech Synthesis
  • regression analysis
• 2016

  ALISA: An automatic lightly supervised speech segmentation and alignment tool

  Stan, A., Mamiya, Y., Yamagishi, J., Bell, P., Watts, O., Clark, R. A. J. & King, S., 31 Jan 2016, In: Computer Speech and Language. 35, p. 116-133 18 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Speech
  • Segmentation
  • Alignment
  • Voice
  • Gold

• Anti-Spoofing for Text-Independent Speaker Verification: An Initial Database, Comparison of Countermeasures, and Human Performance

  Wu, Z., De Leon, P., Demiroglu, C., Khodabakhsh, A., King, S., Ling, Z., Saito, D., Stewart, B., Toda, T., Wester, M. & Yamagishi, J., Apr 2016, In: IEEE/ACM Transactions on Audio, Speech and Language Processing. 24, 4, p. 768 - 783 17 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Speaker Verification
  • Human Performance
  • human performance
  • Countermeasures
  • countermeasures

• Differentiable Pooling for Unsupervised Acoustic Model Adaptation

  Swietojanski, P. & Renals, S., Aug 2016, In: IEEE/ACM Transactions on Audio, Speech and Language Processing. 24, 10, p. 1773-1784 12 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Acoustic Model
  • Pooling
  • Differentiable
  • Acoustics
  • acoustics

• Evaluating the predictions of objective intelligibility metrics for modified and synthetic speech

  Tang, Y., Cooke, M. & Valentini-Botinhao, C., Jan 2016, In: Computer Speech and Language. 35, p. 73-92 30 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Speech
  • Speech intelligibility
  • Prediction
  • Metric
  • Predict

• Investigation of Using Continuous Representation of Various Linguistic Units in Neural Network Based Text-to-Speech Synthesis

  Wang, X., Takaki, S. & Yamagishi, J., 1 Oct 2016, In: IEICE Transactions on Information and Systems. E99.D, 10, p. 2471-2480 10 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Speech synthesis
  • Linguistics
  • Acoustics
  • Neural networks
  • Feedforward neural networks

• Learning Hidden Unit Contributions for Unsupervised Acoustic Model Adaptation

  Swietojanski, P., Li, J. & Renals, S., 1 Aug 2016, In: IEEE/ACM Transactions on Audio, Speech and Language Processing. 24, 8, p. 1450-1463 14 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Acoustic Model
  • learning
  • Learning
  • Acoustics
  • Unit
• 2015

  A Deep Generative Architecture for Postfiltering in Statistical Parametric Speech Synthesis

  Chen, L-H., Raitio, T., Valentini-Botinhao, C., Ling, Z-H. & Yamagishi, J., Jul 2015, In: IEEE Transactions on Audio, Speech and Language Processing. 99, 13 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Speech synthesis
  • synthesis
  • Deep neural networks
  • belief networks
  • associative memory

• A perceptually-motivated low-complexity instantaneous linear channel normalization technique applied to speaker verification

  Poblete, V., Espic, F., King, S., Stem, R. M., Huenupan, F., Fredes, J. & Yoma, N. B., May 2015, In: Computer Speech and Language. 31, 1, p. 1-27 27 p.

  Research output: Contribution to journal › Article › peer-review

• Combining Lightly-supervised Learning and User Feedback to Construct Andimprove a Statistical Parametric Speech Synthesizer for Malay

  Chee Yong, L., Watts, O. & King, S., 15 Dec 2015, In: Research Journal of Applied Sciences, Engineering and Technology. 11, 11, p. 1227-1232 6 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Supervised learning
  • Problem-Based Learning
  • Feedback
  • Text processing
  • Studios

• Emotion transplantation through adaptation in HMM-based speech synthesis

  Lorenzo-Trueba, J., Barra-Chicote, R., San-Segundo, R., Ferreiros, J., Yamagishi, J. & Montero, J. M., Nov 2015, In: Computer Speech and Language. 34, 1, p. 292-307 16 p.

  Research output: Contribution to journal › Article › peer-review

  • Speech Synthesis
  • Transplantation
  • Emotion
  • Speech synthesis
  • Emotional Speech

• Intelligibility of time-compressed synthetic speech: Compression method and speaking style

  Valentini-Botinhao, C., Toman, M., Pucher, M., Schabus, D. & Yamagishi, J., Nov 2015, In: Speech Communication. 74, p. 52-64 13 p.

  Research output: Contribution to journal › Article › peer-review

  • Speech
  • Speech intelligibility
  • Compression
  • Intelligibility
  • Style

• Open Challenges in Modelling, Analysis and Synthesis of Human Behaviour in Human--Human and Human--Machine Interactions

  Vinciarelli, A., Esposito, A., André, E., Bonin, F., Chetouani, M., Cohn, J. F., Cristani, M., Fuhrmann, F., Gilmartin, E., Hammal, Z., Heylen, D., Kaiser, R., Koutsombogera, M., Potamianos, A., Renals, S., Riccardi, G. & Salah, A. A., Aug 2015, In: Cognitive Computation. 7, 4, p. 397-413 17 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Semantics
  • Information Dissemination
  • Social Behavior
  • Financial Management
  • Technology

• Soft context clustering for F0 modeling in HMM-based speech synthesis

  Khorram, S., Sameti, H. & King, S., 2015, In: EURASIP Journal on Advances in Signal Processing. 2015, 2, p. 1-17 2.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Speech synthesis
  • Hidden Markov models
  • Decision trees
  • Entropy
  • Fuzzy sets

• Spoofing and countermeasures for speaker verification: A survey

  Wu, Z., Evans, N., Kinnunen, T., Yamagishi, J., Alegre, F. & Li, H., Feb 2015, In: Speech Communication. 66, p. 130-153 24 p.

  Research output: Contribution to journal › Article › peer-review

  • Speaker Verification
  • Countermeasures
  • biometrics
  • Attack
  • Biometrics

• The use of articulatory movement data in speech synthesis applications: An overview — Application of articulatory movements using machine learning algorithms

  Richmond, K., Ling, Z. & Yamagishi, J., 1 Nov 2015, In: Acoustical Science and Technology. 36, 6, p. 467-477 11 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  • machine learning
  • synthesis
  • linguistics
  • tongue
  • waveforms

• 調音運動の機械学習に基づく応用(<小特集>調音運動の計測とその応用)

  Richmond, K., Yamagishi, J. & Ling, Z-H., 1 Oct 2015, In: The Journal of the Acoustical Society of Japan. 71, 10, p. 539–545 7 p.

  Research output: Contribution to journal › Article › peer-review

  • Machine learning

• 音声の障がい者のための最先端音声合成技術

  Yamagishi, J., 2015, In: Journal of Information Processing and Management (Joho Kanri). 57, 12, p. 882-889 8 p.

  Research output: Contribution to journal › Article › peer-review

  • Speech synthesis
• 2014

  Combining Vocal Tract Length Normalization With Hierarchical Linear Transformations

  Saheer, L., Yamagishi, J., Garner, P. N. & Dines, J., 1 Apr 2014, In: IEEE Journal of Selected Topics in Signal Processing. 8, 2, p. 262-272 11 p.

  Research output: Contribution to journal › Article › peer-review

  • Linear transformations
  • Linear regression
  • Speech synthesis
  • Speech recognition
  • Speech intelligibility

• Convolutional Neural Networks for Distant Speech Recognition

  Swietojanski, P., Ghoshal, A. & Renals, S., 1 Sep 2014, In: IEEE Signal Processing Letters. 21, 9, p. 1120-1124 5 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Speech Recognition
  • Speech recognition
  • Neural Networks
  • Deep neural networks
  • Microphones

• Cross-Lingual Subspace Gaussian Mixture Models for Low-Resource Speech Recognition

  Lu, L., Ghoshal, A. & Renals, S., 2014, In: IEEE/ACM Transactions on Audio, Speech and Language Processing. 22, 1, p. 17-27 11 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Speech Recognition
  • speech recognition
  • Gaussian Mixture Model
  • resources
  • Speech recognition

• Feature analysis for discriminative confidence estimation in spoken term detection

  Tejedor, J., Toledano, D. T., Wang, D., King, S. & Colas, J., Sep 2014, In: Computer Speech and Language. 28, 5, p. 1083–1114 32 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Confidence
  • Perceptron
  • Multilayer
  • Term
  • Multilayer neural networks

• Glottal Spectral Separation for Speech Synthesis

  Cabral, J. P., Richmond, K., Yamagishi, J. & Renals, S., 1 Apr 2014, In: IEEE Journal of Selected Topics in Signal Processing. 8, 2, p. 195-208 14 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Speech synthesis

• Intelligibility enhancement of HMM-generated speech in additive noise by modifying Mel cepstral coefficients to increase the glimpse proportion

  Valentini-Botinhao, C., Yamagishi, J., King, S. & Maia, R., Mar 2014, In: Computer Speech and Language. 28, 2, p. 665-686 22 p.

  Research output: Contribution to journal › Article › peer-review

  File

• Introduction to the Special Issue on The listening talker: Context-dependent speech production and perception

  Cooke, M., King, S., Kleijn, W. B. & Stylianou, Y., Mar 2014, In: Computer Speech and Language. 28, 2, p. 540-542

  Research output: Contribution to journal › Article › peer-review

• Measuring a decade of progress in Text-to-Speech

  King, S., Jan 2014, In: Loquens. 1, 1, e006.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Snow
  • Communication Aids for Disabled
  • Speech synthesis
  • system comparison
  • recording