w[i]nd: An interactive and generative audio-visual composition/installation in procedural and orchestrated space

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

w[i]nd is an interactive and generative audio-visual composition / installation in procedural and orchestrated space. This project aims to be a rich and immersive visual and sound art experience in a first-person Virtual Environment (VE). The VE consists of an array of audio-visual exhibits of images of wind instruments created by generative image synthesis techniques coupled with samples of physically modelled synthesis and processed acoustic recordings that exhibit a range of characteristics of augmentation and abstraction. In addition to the displayed exhibits, there are a number of very large-scale three-dimensional models of conventional wind instruments emitting untreated sustained tones typical of these instruments that reciprocally contrast with and comment on the synthesised sounds and images. First person motion, underlying algorithmic parameters and triggers on exhibits are used as a mechanic to influence the sonic density and character of the experience. Among other things, the work explores open sonic form, timbre and character in non-linear interactive experiences and contributes to research into the use of sound and sounding objects as an approach to presence and immersion, orientation, navigation, interaction and “ergodic musicking” (Oliva 2019) in VEs.
Original languageEnglish
Title of host publicationxCoAx 2021 
Subtitle of host publicationProceedings of the Ninth Conference on Computation, Communication, Aesthetics & X
EditorsMiguel Carvalhais, Mario Verdicchio, Luísa Ribas, André Rangel
Publisheri2ADS
Pages483-489
Number of pages7
ISBN (Print)9789899049062
Publication statusPublished - 12 Jul 2021
EventConference on Computation, Communication, Aesthetics & X - Online
Duration: 12 Jul 202116 Jul 2021
Conference number: 9
https://2021.xcoax.org/index.php

Conference

ConferenceConference on Computation, Communication, Aesthetics & X
Abbreviated titlexCoAx
Period12/07/2116/07/21
Internet address

Keywords

  • aesthetics
  • audio-visual
  • generative design
  • immersion
  • presence
  • sound art
  • StyleGAN
  • virtual environment

Fingerprint

Dive into the research topics of 'w[i]nd: An interactive and generative audio-visual composition/installation in procedural and orchestrated space'. Together they form a unique fingerprint.

Cite this