A right and left Motion Synth are being used to play four instrument sounds: a harp, a cello, piano, and a brass ensemble.
The visual was created in Processing and is responding in realtime to the same motion and touch data that is controlling the harp and cello sounds.
The left-handed Motion Synth is a prototype; currently only right-handed models are available from www.auug.com.
Software used:
MusicIO app for send MIDI over lightning cables
Blown ensemble: WIVI (Wallander Instruments) Cello: Bowed Strings Reaktor ensemble
Harp and piano: Kontakt
(Ableton Live hosted the above instruments as VSTs)
Visual: Processing – Download the free sketch here: http://auug.info/wiki/doku.php/public/processing_example
Sound control:
– Harp: Notes can be triggered from the touch screen or via Up-Down motion (all notes are from a pre-selected scale).
– Cello: Notes are being selected on the touchscreen. Volume and timbre are being controlled by velocity. Vibrato is proportional to changes in Up-Down orientation. Pitch glide speed is proportional to Forearm Rotation.
– Blown ensemble: Notes are being selected on the touchscreen. Volume and timbre are being controlled by velocity.
– Piano: Notes are being selected on the touchscreen, without any motion control.
Zones of Forearm Rotation are being used to crossfade between the various instruments.
More info about the motion definitions used above can be found here: http://auug.info/wiki/doku.php/public/orientation_and_motion_inputs
More info on playing techniques: http://auug.info/wiki/doku.php/public/bowed_strings_reaktor_ensemble#bowed_strings_-_how_to_play
