Work / 01 of 04

Cosmic Improv

Improvisation as an interface for a living visual world.

An interactive audiovisual improvisation environment built in Max/MSP and TouchDesigner, talking over OSC. What I play becomes how the image behaves, in real time.

Category
Interactive Audio
Audiovisual Systems
Creative Coding
Built with
Max/MSP
TouchDesigner
OSC
MIDI
Role
Concept, design, build

01See it run

Watch on YouTube ↗

02Overview

Cosmic Improv starts from a simple question: if improvising is a conversation, what happens when the other voice is visual? The system listens to a performance and translates it into the behaviour of a small universe — not a visualiser that decorates the sound, but an environment the music steers.

Each musical role is given its own visual consequence, so the picture can be read the way a band can be heard: you can see who is doing what.

03Mappings

What you play → what you see

Musical inputVisual behaviourNotes
PadsCloudsSustained harmony gathers as cloud-like forms.
Bass notesDropletsEach low note falls into the scene as a droplet.
TempoPlanet sizeThe pulse of the music sets the scale of the planets.

04Signal flow

→Try it

Play the mapping

A browser sketch of the mapping idea, made for this page. The real system runs in Max/MSP and TouchDesigner — see the video above.

05How it works

  1. 01

    Listening

    Musical input arrives in Max/MSP, where it is separated by role — pads, bass, tempo — and turned into control data.

  2. 02

    Translating

    Max sends that data to TouchDesigner as OSC messages. The mapping layer is where the piece is really composed: deciding what a musical gesture should mean visually.

  3. 03

    Answering

    TouchDesigner renders the scene in real time, so the image responds within the same moment as the sound and can be played against.

06What I did

  • Concept and system design
  • Max/MSP programming
  • TouchDesigner integration
  • OSC communication between the two environments
  • MIDI and musical input mapping
  • Performance

07Tools & technologies

  • Max/MSP
  • TouchDesigner
  • OSC
  • MIDI

08Documentation

Development notes

Patch walkthrough, OSC address list and notes on latency and mapping decisions will be documented here.