The wonderful Nintendo WiiTM Remote
- which uses Bluetooth® wireless technology -
has now been combined with the Drancing gestural synthesis system:
-
The 3D accelerometer signals of the "Wiimote" map directly to the
3D
Drancel-RGB "virtual synthesis atom" of the Drancing system (which is designed to work with any triaxial accelerometer).
-
Accelerometer signals are acquired from Wiimotes using DarwiinRemote OSC, which
was adapted by Andreas Schlegel (sojamo.de)
from the original
DarwiinRemote
written by Hiroaki Kimura for Mac OS-X:
- It could easily be adapted to exploit other OSC-fluent drivers for the Wiimote.
-
A PureData audio and GEM video synthesis prototype of the DranceWare has been developed for Mac OS-X.
This prototype only uses 2 Wiimotes, sufficient for proof-of-concept and demonstration.
The
original Drancing sensor suit (from circa. 1997)
used 5 Crosswbow triaxial accelerometers
mounted in a "body star" pattern, which encapsulates some important principles of proprioception
and body awareness, as celebrated in Leonardo da Vinci's famous
Vitruvian Man drawings.
I am developing a
Bluetooth®-driven version of the
Drancing accelerometer suit.
Movies of Drancing audio and video using PureData synthesis
and Wiimotes as wireless accelerometers
Various modes driven (modulated) and triggered by conditioned accelerometers signals are illustrated, both alone and combined:
-
AM: Amplitude modulation of constant note triads managed by each
Drancel-RGB
-
VFO: Variable frequency oscillators with frequency scaling and offset managed by each
Drancel-RGB
-
Drums: samples triads triggered independently by the XYZ signals of each
Drancel-RGB
-
echo: Simple stereo delay echo
-
echo+fb: Stereo delay echo with some feedback
For detailed explanations of these modes PureData DranceWare synthesis patches.
Some DV PAL digicam movies of Drancing with Wiimotes, converted to 320x240 MPEG4s:
| AM | VFO | Drums | echo | FB | filesize | duration | file |
| x | - | x | x | x | 3.9M | 01:35 |
MPEG4
|
| x | x | x | x | x | 1.4M | 0:33 |
MPEG4 |
Some iSight webcam movies of Drancing with Wiimotes, converted to 320x240 MP4s:
A gesture of thanks
I would like to extend my sincere thanks to:
-
Nintendo for developing the the fabulous Wii Remote wireless controllers !
-
Bluetooth® for convenient wireless technology.
- Hiroaki Kimura for the original DarwiinRemote
- Andreas Schlegel from adapting DarwiinRemote to DarwiinRemote OSC
- To My Mac Australia for excellent help and support with my new MacBook Pro and with
video editing advice
(Visit also acknowledgements for PureData and GEM synthesis.)