Project Outline - NickalusLindale/Visual-Theremin GitHub Wiki

I. Creating a Simple Oscillator Controlled by Motion Capture

Create connectivity between Max and TD

  1. Create simple oscillator in Max controlled by sliders
  2. Create Gen variables (oscillator, random step) in TD
  3. Send TD variables to Max
  4. Use var to control the interface (sliders, bangs, etc.)

Build a TD patch that uses MediaPipe for hand tracking

  1. Incorporate MediaPipe (Open Source)
  2. Create an output that transfers floats
  3. Create a recorded version of variable changes that can be replicated in Max

Build a Max patch that utilizes TD variables

  1. Create a Max patch for an oscillator
  2. Build interface of patch that can be controlled through imported variables
  3. Connect TD and Max modules

Deepen connectivity of patches

  1. Utilize more variables from MediaPipe (ie different finger articulations)
  2. Create additional oscillators from MoCap control (diff waveforms?)
  3. Create hand gesture to switch between/turn off oscillators in Maxmsp

II. Filter Controls and Audio Playback Manipulation