Experiment materials for "The temporal delay hypothesis: Natural, vocoded and synthetic speech."



Experiment materials associated with the paper: "The temporal delay hypothesis: Natural, vocoded and synthetic speech." by Mirjam Wester, Martin Corley and Rasmus Dall published at The 7th Workshop on Disfluency in Spontaneous Speech (DiSS), Edinburgh, Scotland.


Including disfluencies in synthetic speech is being explored as a way of making synthetic speech sound more natural and conversational. How to measure whether the resulting speech is actually more natural, however, is not straightforward. Conventional approaches to synthetic speech evaluation fall short as a listener is either primed to prefer stimuli with filled pauses or when they aren't primed they prefer more fluent speech. Reaction time experiments from psycholinguistics may circumvent this issue. In this paper, we revisit one such reaction time experiment. For natural speech, delays in word onset were found to facilitate word recognition regardless of the type of delay; be they filled pause (um), silent or a tone. We reused the materials for natural speech, and extended it to vocoded and synthetic speech. The results partially replicate previous findings. For natural and vocoded speech, if the delay is a silent pause, significant increases in the speed of word recognition are found. If the delay comprises filled pauses there is a significant increase in reaction time for vocoded speech but not for natural speech. For synthetic speech, no clear effects of delay on word recognition are found. We hypothesise this is because it takes longer (requires more cognitive resources) to process synthetic speech than natural or vocoded speech.
Date made available2015
PublisherSchool of Informatics

Cite this