Wii

Video: YouTube: Drancing accelerometer music with Wiimotes: 3D variable frequency oscillators + amplitude variation + triggered "air drum" samples

Play video (then use fullscreen !)
ERROR: You are missing some Flash content that should appear here! Perhaps your browser cannot display it, or maybe it did not initialise correctly.
This error usually only occurs if embedding remote content fails; Please try playing the original video on the original site using the following link.
Scenes

Demonstrates combined oscillator frequency variation, amplitude variation, and triggered Drum sample ("Drumming by Dancing") modes along with Drancel RGB monitor visuals projected onto the "Drancer" performer.

For this demonstration two hand-held WiiTM Remotes on a MacBook Pro were used. (The original Drancing accelerometer suit (since 1997) used 5 triaxial accelerometers in a "body star" pattern").

MonitorWin.pd

MonitorWin.pd

Opens a GEM window for the Drancel RGB monitors.

I have tuned the size to work well on a data projector display at 1280x960 (the Mac OS X reference in the patch is irrelevant). I usually have the PureData audio synthesis control patches on the main display of a MacBook Pro, and the GEM visuals projected on a 2nd display.

DranceWare.pd

DranceWare.pd

The 1st-level virtual instrument user interface for the system. It is just enough to manage a few fundamental Drancing operations modes, to manage conditioning and control of 2 Drancel virtual 3D synthesis atoms (fed here by 2 Wiimotes), as well as offering some global controls, some output filters, some monitors, and a simple recording system. (It also fits nicely into a 1280x960 screencast when combined with Drancel monitor visuals side-by-side.)

It looks of course almost exactly like the 0th-level "wrapper" for the skin, except it shows the (rather tedious) connections, and some initialisations, as well as some OSC dump feeds from specific ports "pragmatically hardwired" into A0.pd (5600) and A1.pd (5602) (yes, this is indeed a rapid prototype).

SysML and UML abstractions (used as typed parts with ports) are so much easier to model, diagram, and connect up than this. I am working on forward-engineering from SysML tools to PureData and also $jsyn_$, i.e. SysML tools becomes a real-time synthesis patch editors !

MonoToStereoPanned.pd

MonoToStereoPanned.pd

Here the (X,Y,Z) signals are stereo panned, so that an entire Drancel is panned. This works well if an accelerometer is worn on the left/right hands/feet of a performer.

Drancel.pd

Drancel.pd

A Drancel is the virtual synthesis 3D "atom" of the Drancing accelerometer music system (where "music" means here both real-time sound and light synthesis).

A Drancel is designed to work with ANY triaxial accelerometer (of which the WiiTM Remote is a convenient example, thanks to its leverage of Bluetooth™ wireless technology).

It is the calibrated, conditioned, "homed", virtual Drancel that is considered to synthesise, not the triaxial accelerometer, which is merely a source of (X,Y,Z) acceleration signals that are mapped to synthesis channel triads and (R,G,B) (or other) light components.

A Drancel RGB (drancing light element) is to Drancing synthesis what a "pixel" (picture element) is to a picture.

Imagine hundreds of "Drancers" (Drancing performers), each with 5 Drancel RGB units, each synthesising sound and light, and you get the picture ! Can you hear it ? Can you see it ? That's the Drancing vision !

Drancels can act as independent synthesis units or they can be combined (multiplexed) to create arbitrarily complex syntheses. In this PureData prototype there are, however, only 2 Drancels, for 2 hand-held $Wiimotes$ as wireless accelerometer sources. (The original Drancing accelerometer suit (since 1997) had 5 triaxial accelerometers in a "body star" pattern.)

Currently the PureData synthesis prototype offers the following elementary synthesis units:

  • AM: modulation of the amplitudes of a triad of "fixed-frequency" oscillators,
    which frequencies can be set by the user using the sliders.
  • VFO: variable frequency oscillators: the user can set the scale of frequency driving, a frequency offset, the overall gain of the oscillations, and whether or not the frequencies are discretised to lock-on to MIDI note frequencies (as opposed to arbitrarily fine continjous frequency variation).
  • Drums: simple sample drums (I currently use the free AudioPervert CR-78 drum samples) which will probably be replaced soon with completely synthetic PureData drums.
Syndicate content