TY - GEN
T1 - Adversarial guitar amplifier modelling with unpaired data
AU - Wright, Alec
AU - Valimaki, Vesa
AU - Juvela, Lauri
PY - 2023/5/5
Y1 - 2023/5/5
N2 - We propose an audio effects processing framework that learns to emulate a target electric guitar tone from a recording. We train a deep neural network using an adversarial approach, with the goal of trans-forming the timbre of a guitar, into the timbre of another guitar after audio effects processing has been applied, for example, by a guitar amplifier. The model training requires no paired data, and the resulting model emulates the target timbre well whilst being capable of real-time processing on a modern personal computer. To verify our approach we present two experiments, one which carries out un-paired training using paired data, allowing us to monitor training via objective metrics, and another that uses fully unpaired data, corresponding to a realistic scenario where a user wants to emulate a guitar timbre only using audio data from a recording. Our listening test results confirm that the models are perceptually convincing.
AB - We propose an audio effects processing framework that learns to emulate a target electric guitar tone from a recording. We train a deep neural network using an adversarial approach, with the goal of trans-forming the timbre of a guitar, into the timbre of another guitar after audio effects processing has been applied, for example, by a guitar amplifier. The model training requires no paired data, and the resulting model emulates the target timbre well whilst being capable of real-time processing on a modern personal computer. To verify our approach we present two experiments, one which carries out un-paired training using paired data, allowing us to monitor training via objective metrics, and another that uses fully unpaired data, corresponding to a realistic scenario where a user wants to emulate a guitar timbre only using audio data from a recording. Our listening test results confirm that the models are perceptually convincing.
KW - audio systems
KW - deep learning
KW - generative adversarial networks
KW - music
KW - non-linear systems
KW - unsupervised learning
UR - https://conferences.ieeeauthorcenter.ieee.org/get-published/post-your-paper/
U2 - 10.1109/ICASSP49357.2023.10094600
DO - 10.1109/ICASSP49357.2023.10094600
M3 - Conference contribution
SN - 9781728163284
T3 - IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
SP - 1
EP - 5
BT - ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
PB - Institute of Electrical and Electronics Engineers
ER -