Patch Notes - Motion Tracking Theremin

Version 0.1 - May 2, 2025
"Motion Controlled Digital Theremin"

Features

MediaPipe Integration

This patch utilizes MediaPipe for hand tracking capabilities. To run this software, the user must download and relocate MediaPipe folders into the correct folder (see: How to Setup Theremin)

Sine Wave Oscillator

Currently, the synthesizer patch in MaxMSP uses a simple sine oscillator cycle~ to create sound.

OSC Communication

Communication between the MaxMSP patch and TouchDesigner is using OSC (Open Sound Control). This information is being sent to local host and parsed in MaxMSP by CNMAT's UDP plugin package.

File Structure

Terpsitone
   > max
      > synthesizer_0-1
   > media                              # Currently unused. Will be utilized for examples in later patches
   > touchdesigner
      > Backup                          # Multiple backup files. Will be cleared out in later patches
         > hand_tracking.x.toe
      > toxes                           # Entire folder is pulled directly from MediaPipe (specifications in _How to Setup Theremin_)
         > face_detector.toe
         > face_filter_example.toe
         > face_mapping_example.toe
         > face_tracking.toe
         > hand_tracking.toe
         > image_classification.toe
         > image_embeddings.toe
         > image_segmentation.toe
         > MediaPipe.toe
         > object_tracking.toe
         > pose_tracking.toe
      > hand_tracking.15.toe           # The most recent backup file of the TouchDesigner file. Will be removed in later patches
      > hand_tracking.toe              # Main TouchDesigner file. Will be renamed in later patches

Known Issues

Next Steps

Additive Synthesis
Individual Calibration
Performance Optimization