17:16
The dynamic duo delire + pix have been hacking game engines to produce sound and visuals for some time now. Their projects typically go much further than simple Unreal or Quake hacks. Instead, they use the game engines to create application environments that are either self-running installations or interactive performance systems. The resulting works exploit the aesthetics and interactivity of computer games while presenting new models for realtime performance tools.
fijuu is a sound performance tool based on the Ogre3D open source graphics engine. The user controls sound synthesis by manipulating morphing 3D shapes using a Playstation-style controller. Different shapes correspond to different “instruments”. See the Fijuu video on YouTube and screenshots for examples.
q3apd uses Quake3 and various bots to control realtime sound synthesis in a PureData (PD) patch. Data like bot position, view angle, weapon etc. are sent to PD over the network interface. The PD patch then uses these to control the soundscape that is being continuously generated. The visual component consists of Quake3 with custom made maps and graphics. See a video of q3apd at Lovebytes to get an idea of the result.
