Adversarial guitar amplifier modelling with unpaired data

Alec Wright, Vesa Valimaki, Lauri Juvela

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We propose an audio effects processing framework that learns to emulate a target electric guitar tone from a recording. We train a deep neural network using an adversarial approach, with the goal of trans-forming the timbre of a guitar, into the timbre of another guitar after audio effects processing has been applied, for example, by a guitar amplifier. The model training requires no paired data, and the resulting model emulates the target timbre well whilst being capable of real-time processing on a modern personal computer. To verify our approach we present two experiments, one which carries out un-paired training using paired data, allowing us to monitor training via objective metrics, and another that uses fully unpaired data, corresponding to a realistic scenario where a user wants to emulate a guitar timbre only using audio data from a recording. Our listening test results confirm that the models are perceptually convincing.
Original languageEnglish
Title of host publicationICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
PublisherInstitute of Electrical and Electronics Engineers
Pages1-5
Number of pages5
ISBN (Electronic)9781728163277
ISBN (Print)9781728163284
DOIs
Publication statusE-pub ahead of print - 5 May 2023

Publication series

NameIEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
ISSN (Print)1520-6149
ISSN (Electronic)2379-190X

Keywords / Materials (for Non-textual outputs)

  • audio systems
  • deep learning
  • generative adversarial networks
  • music
  • non-linear systems
  • unsupervised learning

Fingerprint

Dive into the research topics of 'Adversarial guitar amplifier modelling with unpaired data'. Together they form a unique fingerprint.

Cite this