Assessing Progress in Building Autonomously Creative Systems

Simon Colton, Alison Pease, Joseph Corneli, Michael Cook

Research output: Chapter in Book/Report/Conference proceedingConference contribution


Determining conclusively whether a new version of software creatively exceeds a previous version or a third party system is difficult, yet very important for scientific approaches in Computational Creativity research. We argue that software product and process need to be assessed simultaneously in assessing progress, and we introduce a diagrammatic formalism which exposes various timelines of creative acts in the construction and execution of successive versions of artefact generating software. The formalism enables estimations of
progress or regress from system to system by comparing their diagrams and assessing changes in quality, quantity and variety of creative acts undertaken; audience perception of behaviours; and the quality of artefacts produced. We present a case study in the building of evolutionary art systems, and we use the formalism to highlight various issues in measuring progress in the building of creative systems.
Original languageEnglish
Title of host publicationProceedings of the Fifth International Conference on Computational Creativity, Ljubljana, Slovenia, June 10-13, 2014.
Number of pages9
Publication statusPublished - 2014

Cite this