webel.com.au
  Projects
  UML & SysML
  Java (Sun)
  Java (other)
  XML
  database
JDO
  web
  security
  mathematics
  data analysis
  personal
Drancing: with the Nintendo WiiTM Remote as triaxial accelerometer

YouTube videos of Drancing using PureData+GEM synthesis and Wiimote controllers.


DV camcorder video: combines 3D variable frequency oscillators and triggered drum samples with Drancel-RGB monitor visuals. Duration 01:39.

DV camcorder video: combines 3D amplitude modulation and triggered drum samples with Drancel-RGB monitor visuals. Duration 01:39

iSight webcam video: combines VFO and AM modes and triggered drums with Drancel-RGB monitor visuals. Duration 03:30.

Visit also these 320x240 MP4 mini movies of various Drancing modes


The wonderful Nintendo WiiTM Remote - which uses Bluetooth® wireless technology - has now been combined with the Drancing gestural synthesis system:

  • The 3D accelerometer signals of the "Wiimote" map directly to the 3D Drancel-RGB "virtual synthesis atom" of the Drancing system (which is designed to work with any triaxial accelerometer).
  • Accelerometer signals are acquired from Wiimotes using DarwiinRemote OSC, which was adapted by Andreas Schlegel (sojamo.de) from the original DarwiinRemote written by Hiroaki Kimura for Mac OS-X:
    • It could easily be adapted to exploit other OSC-fluent drivers for the Wiimote.
  • A PureData audio and GEM video synthesis prototype of the DranceWare has been developed for Mac OS-X.
This prototype only uses 2 Wiimotes, sufficient for proof-of-concept and demonstration. The original Drancing sensor suit (from circa. 1997) used 5 Crosswbow triaxial accelerometers mounted in a "body star" pattern, which encapsulates some important principles of proprioception and body awareness, as celebrated in Leonardo da Vinci's famous Vitruvian Man drawings. I am developing a Bluetooth®-driven version of the Drancing accelerometer suit.

Movies of Drancing audio and video using PureData synthesis and Wiimotes as wireless accelerometers

Various modes driven (modulated) and triggered by conditioned accelerometers signals are illustrated, both alone and combined:

  • AM: Amplitude modulation of constant note triads managed by each Drancel-RGB
  • VFO: Variable frequency oscillators with frequency scaling and offset managed by each Drancel-RGB
  • Drums: samples triads triggered independently by the XYZ signals of each Drancel-RGB
  • echo: Simple stereo delay echo
  • echo+fb: Stereo delay echo with some feedback

For detailed explanations of these modes PureData DranceWare synthesis patches.


Some DV PAL digicam movies of Drancing with Wiimotes, converted to 320x240 MPEG4s:

AMVFODrumsechoFBfilesizedurationfile
x-xxx3.9M01:35 MPEG4
xxxxx1.4M0:33 MPEG4

Some iSight webcam movies of Drancing with Wiimotes, converted to 320x240 MP4s:

AMVFODrumsechoFBfilesizedurationfile
-x---3.1M01:08 MPEG4
-xxxx2.4M00:52 MPEG4
xxx--9.7MB03:30 MPEG4
xxx--924K00:20 MPEG4
xxx--2.6M00:56 MPEG4
xxxxx1.7MB00:36 MPEG4
--xxx2.1MB00:45 MPEG4
--xxx768K00:16 MPEG4
--x--2.1M00:46 MPEG4
--xxx1.7M00:36 MPEG4
x-xxx6.8M02:25 MPEG4

A gesture of thanks

I would like to extend my sincere thanks to:

  • Nintendo for developing the the fabulous Wii Remote wireless controllers !
  • Bluetooth® for convenient wireless technology.
  • Hiroaki Kimura for the original DarwiinRemote
  • Andreas Schlegel from adapting DarwiinRemote to DarwiinRemote OSC
  • To My Mac Australia for excellent help and support with my new MacBook Pro and with video editing advice

(Visit also acknowledgements for PureData and GEM synthesis.)

top     up     home     -     sitemap     news     about    
Email: info@webel.com.au   Tel: +61 (2) 9386-0090   Post: webel.com.au, PO Box 1816, Bondi Junction, NSW 1355, Australia.   ABN: 67 677 268 579