Comparison of HMM and TMDN Methods for Lip Synchronisation

Gregor Hofer; Korin Richmond

Comparison of HMM and TMDN Methods for Lip Synchronisation

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

This paper presents a comparison between a hidden Markov model (HMM) based method and a novel artificial neural network (ANN) based method for lip synchronisation. Both model types were trained on motion tracking data, and a perceptual evaluation was carried out comparing the output of the models, both to each other and to the original tracked data. It was found that the ANN-based method was judged significantly better than the HMM based method. Furthermore, the original data was not judged significantly better than the output of the ANN method.

Original language	English
Title of host publication	INTERSPEECH 2010 11th Annual Conference of the International Speech Communication Association
Publisher	International Speech Communication Association
Pages	454-457
Number of pages	4
Publication status	Published - Sept 2010

Access to Document

IS100668Final published version, 1.08 MB

http://www.isca-speech.org/archive/interspeech_2010/i10_0454.html

Cite this

@inproceedings{cd784ae394f14d4487192490adcd0772,

title = "Comparison of HMM and TMDN Methods for Lip Synchronisation",

abstract = "This paper presents a comparison between a hidden Markov model (HMM) based method and a novel artificial neural network (ANN) based method for lip synchronisation. Both model types were trained on motion tracking data, and a perceptual evaluation was carried out comparing the output of the models, both to each other and to the original tracked data. It was found that the ANN-based method was judged significantly better than the HMM based method. Furthermore, the original data was not judged significantly better than the output of the ANN method.",

author = "Gregor Hofer and Korin Richmond",

year = "2010",

month = sep,

language = "English",

pages = "454--457",

booktitle = "INTERSPEECH 2010 11th Annual Conference of the International Speech Communication Association",

publisher = "International Speech Communication Association",

address = "France",

}

TY - GEN

T1 - Comparison of HMM and TMDN Methods for Lip Synchronisation

AU - Hofer, Gregor

AU - Richmond, Korin

PY - 2010/9

Y1 - 2010/9

N2 - This paper presents a comparison between a hidden Markov model (HMM) based method and a novel artificial neural network (ANN) based method for lip synchronisation. Both model types were trained on motion tracking data, and a perceptual evaluation was carried out comparing the output of the models, both to each other and to the original tracked data. It was found that the ANN-based method was judged significantly better than the HMM based method. Furthermore, the original data was not judged significantly better than the output of the ANN method.

AB - This paper presents a comparison between a hidden Markov model (HMM) based method and a novel artificial neural network (ANN) based method for lip synchronisation. Both model types were trained on motion tracking data, and a perceptual evaluation was carried out comparing the output of the models, both to each other and to the original tracked data. It was found that the ANN-based method was judged significantly better than the HMM based method. Furthermore, the original data was not judged significantly better than the output of the ANN method.

M3 - Conference contribution

SP - 454

EP - 457

BT - INTERSPEECH 2010 11th Annual Conference of the International Speech Communication Association

PB - International Speech Communication Association

ER -

Comparison of HMM and TMDN Methods for Lip Synchronisation

Abstract

Access to Document

Fingerprint

Cite this