Projects per year
Cross-lingual speaker adaptation for speech synthesis has many applications, such as use in speech-to-speech translation systems. Here, we focus on cross-lingual adaptation for statistical speech synthesis systems using limited adaptation data. To that end, we propose two eigenvoice adaptation approaches exploiting a bilingual Turkish-English speech database that we collected. In one approach, eigenvoice weights extracted using Turkish adaptation data and Turkish voice models are transformed into the eigenvoice weights for the English voice models using linear regression. Weighting the samples depending on the distance of reference speakers to target speakers during linear regression was found to improve the performance. Moreover, importance weighting the elements of the eigenvectors during regression further improved the performance. The second approach proposed here is speaker-specific state-mapping which performed significantly better than the baseline state-mapping algorithm both in objective and subjective tests. Performance of the proposed state mapping algorithm was further improved when it was used with the intra-lingual eigenvoice approach instead of the linear-regression based algorithms used in the baseline system.
|Number of pages||13|
|Journal||IEEE/ACM Transactions on Audio, Speech and Language Processing|
|Early online date||13 Feb 2017|
|Publication status||Published - Apr 2017|
- statistical speech synthesis
- speaker adaptation
- nearest neighbour
- cross lingual speaker adaptation
FingerprintDive into the research topics of 'Using eigenvoices and nearest-neighbours in HMM-based cross-lingual speaker adaptation with limited data'. Together they form a unique fingerprint.
- School of Philosophy, Psychology and Language Sciences - Personal Chair of Speech Processing
- Centre for Speech Technology Research
Person: Academic: Research Active