SonoMorphis / Sono reMorphed

Mobile interactive installation with 3D graphics and sound

SonoMorphis is a complex musical instrument with sonic and visual dimensions. It is able to react to its master's playing style with stunning complexity and diligence. Furthermore, you, as the player, can create your own audio-visual instrument with only a few clicks yourself and immediately play it! Through the easy interface layout you can come up with overwhelming 3D music and video sequences in no time, without prior practice.

SonoMorphis provides you with a host of audio-visual components to choose from. Out of these you put together your individual instrument. Even while creating it's already alive and is projected in 3D, so close that you will want to grab at it. Like all the other visitors have wanted to. You can even zoom yourself right into the projection having arms and limbs surround you. Can you feel it? Loudspeakers around you produce your instrument's sound with strong, extremely dynamic, sonic gestures that you, the musician, fully control.

Mobile Installation
The mobile version of SonoMorphis is easily shipped and set up. The installation scales well with environments of nearly all sizes. Please call for availability and pricing.

Credits
Bernd Lintermann (Graphics)
ZKM Karlsruhe (Production Support)

Press
Interactive installation artists such as Ken Feingold, Masaki Fujihata, and Germans Bernd Lintermann and Torsten Belschner, positively encourage viewers to create their own narratives or associations with their interactive works, designing them with this purpose -- and challenging notions of authorship. [ www.artandculture.com 2002 ]

"SonoMorphis" is an especially impressing experiment created at ZKM. Endless variations of a given form. The visitor is given the chance to direct the changes' directions. No form will ever appear twice - as SonoMorphis is ruled by cleverly thought-out complex mathematics. [Josef Schnelle in Deutschland Radio 10.03.2001]

Display Mobile Installation
Produced @: media art revisited, ZKM Karlsruhe 2009-2010
YOU_ser: The Century of The Consumer, santralistanbul, Istanbul, Turkey 2009
Sono reMorphed at Panoramic Projection Festival, ZKM Karlsruhe 2007
Bibliotheca Insomnia. Digital Bauhaus II, Bauhaus-University Weimar 2006
Permanent exhibition Master Works of Media Art, ZKM Media Museum Karlsruhe 2004-2006
Opera Festival Munich / Festspiele+, House of Art Munich 2004
Art of Immersion, CAVE version. BEC / Fraunhofer Gesellschaft Bonn 2002
Festival ZKM Music Institute, Karlsruhe 2002
Festival Schloss Kapfenburg 2001
Warsaw Autumn 2000
VIA Festival Maubeuge 2000
EXIT Festival Paris 2000
Stuttgarter Filmwinter, CAVEE version. Fraunhofer IAO 1999
SurroGate Festival, ZKM Karlsruhe 1998


Background
As one of the installation's aesthetic goals is the bodily impression of the generated object on the user, a sound synthesis technique was in demand, that is able to both render a visible object's genuine sound thru all its user-inferred alterations in shape and space in a plausible way, and to be abstract enough where needed to not duplicate a real-world artefact. The technique of choice is known as physical modelling which derives the emerging sound from the physical properties of an assumed object, i.e. its shape, material, excitation mode etc. 

Based on associative relationship to the genoms' textures, each acoustic representation has first been assigned a set of material properties, causing its basic timbre. Second, the genoms' shape is taken into account, controlling the representations' basic modes of vibration and their reaction to parameter-induced deformations. Third, the single graphic objects' current spatial positions are mapped to the sound space, rendering their horizontal movement as well as their proximity to the user.

Sound
The basic idea is to put the sonic and visual representations of the installation's structure into as close a relationship as possible. Material, shape, and spatial position of the visible organic correlate with sound properties like timbre variations, pitch alterations, dynamically moving positions, and the like of the projected sound in the real space. The correlations rely in part on easily graspable rules for the sake of clarity, in part on juxtaposition and more sophistacated transformations. 

Both sound and projection relate in equal parts to the same underlying abstract structure which they make palpable to the user. The sound acoustically represents selected properties of the genoms, i.e. their structure, position, and behavior in a non-arbitrary way. The easiest way to think of this representation metaphorically is that of a musical instrument: a set of rules with associated variables by which to generate sound, with the possibility included to control these variables in real-time according to the underlying genoms' structures. 

It is possible and intended to handle the installation as flexible as a musical instrument, consisting of an image and a sonic component. Observation of the system's behavior during exhibitions has shown its ability to respond to users' varying approaches, playing styles, and temperaments in a differentiated and recognizable way. 

The installation is accessible from two coupled access points. The first of these exists in real space, visitors interact with a virtual organic projected onto a screen via a special interface box. The second access point uses the world wide web as its user interface. 

In both systems, users evolve a three-dimensional organic object which is created using genetic algorithms. The organic is defined by a genom, a set of components, which is successively mutated by the users. Out of six randomly generated mutations users select one, which in the succeeding steps becomes the starting point for new mutations. This way users choose a thread through a space out of approximately 1080 possible forms. 

In the real space users additionally change the shape and dynamic behavior of the life-like organic object via an interface box. Both systems are coupled and operate on the same data set constituting the genom. Actions in the web space effect the real space and vice versa. If a change on the web happens, the organic in the real space slowly morphs towards the web selection, a change in real space directly affects the next web action. 

In this work the interaction follows the evolutionary principle of mutation of the graphic and acoustic structure and selection from five available variants. On the visual level, specific formal patterns that have been extracted from the natural world are combined arbitrarily and generate creations that are both familiar and yet have never been seen before. The momentary state of the graphic objects controls the sound level in "SonoMorphis". The parameters of the graphics must be interpreted from acoustical viewpoints in such a way that a musical structure emerges from them. In this way automatic compositions arise, the results of which are functions of their components and are variable in the details of their contours, complexity, and their behaviors. The overlapping of visual levels and sound levels produces an open structure that can be continually and endlessly configured in new ways by each viewer. 

Further information
www.zkm.de/masterworks
www.bernd-lintermann.de