Lawrence Loh
Interactive Media Programmer
IMG_2323.jpg

RXP KL

RXP KL

REXPERIENCE (RXP.KL) is an immersive digital art gallery in REXKL — in the heart of Kuala Lumpur. REXPERIENCE merges the past's rich tapestry with new and cutting-edge digital art forms, that welcome all into the world of art.

Over the course of the project, Lawrence has contributed to the technical design, programming, testing & commissioning of the video system.

TouchDesigner Media Server Solution

TouchDesigner served as the backbone of RXP custom media server solution. Known for its versatility and robust performance, TouchDesigner was meticulously programmed to handle complex media tasks, ensuring real-time processing and media playback. Given the large canvas size of the project, we developed a multi-machine networked infrastructures to manage outputs to multiple projectors while maintaining perfect synchronization. This setup ensured that our high-resolution visuals were projected seamlessly across various surfaces, creating a cohesive and immersive visual experience.

Real-Time Motion Capture

For the exhibit “Annihilation”, the dancer’s captivating movements are tracked and projected in real time using Xsens Motion Capture suit. These intricate movements are rendered live in Unreal Engine, creating a mesmerizing visual display that combines the grace of human motion with the power of real-time digital rendering.

Integration with Unreal Engine nDisplay

nDisplay technology enabled us to produce high-fidelity real-time content, providing an immersive and interactive experience. The real-time rendering capabilities of Unreal Engine were crucial for creating responsive environments that could adapt seamlessly to user inputs and external data streams.

Key Achievements

  • Custom Media Server Development: Leveraged TouchDesigner to develop a bespoke media server capable of handling intricate visual workflows.

  • Multi-Machine Syncing: Developed a synchronized network of multiple machines to manage projector outputs, ensuring flawless and unified visuals across a large canvas.

  • Real-time Content Integration: Implemented Unreal Engine's nDisplay for high-quality, real-time content generation, ensuring immersive visual experiences.

  • Seamless System Integration: Achieved a cohesive integration of TouchDesigner and Unreal Engine, resulting in a robust and flexible video system architecture.

  • Real-Time Motion Capture: Utilized the Xsens Motion Capture suit to track and project a dancer's movements in real time, rendered dynamically in Unreal Engine.

  1. The project planning started in the 3D world, by defining the projection surfaces.

  2. Projection study to determine our target illumination level and pixel density.

 

The custom developed Media Server UI with 3D previz, multi-machine syncing and show scheduling.

 

The Unreal Engine nDisplay config, which is distributed across 5 machines.