Artist Masatane Muto performed live in Tokyo using a combination of brain-computer interfaces, eye-tracking, and robotics to create music and visuals [1].

The performance demonstrates how advanced assistive technology can restore creative agency to individuals with severe physical limitations. By bypassing traditional motor functions, Muto showcased a new model for artistic expression for those living with amyotrophic lateral sclerosis (ALS).

Muto utilized a suite of high-tech tools to manage his performance. This included eye-tracking systems and brain-wave technology to control the music and visual elements of the show [1]. A robotic arm was also integrated into the setup, allowing for physical interaction and movement that would otherwise be impossible due to his condition [1].

To facilitate communication and performance, Muto employed artificial intelligence. While some reports indicate the use of non-invasive brain-wave technology for the live set [1], other data suggests the use of implantable devices and AI models trained on his specific brain activity to generate speech [2]. These systems translate neural signals into digital commands, enabling the artist to direct the flow of the performance in real time [2].

The integration of these technologies allows Muto to operate as a DJ, manipulating soundscapes and imagery through mental and ocular cues. The goal of the project is to highlight the potential of neuroprosthetics to bridge the gap between mental intent and physical execution [3].

This multidisciplinary approach combines neuroscience, robotics, and AI to create a seamless interface. By turning biological signals into digital inputs, Muto can maintain his identity as a creator despite the progressive nature of ALS [1, 3].

“The performance demonstrates how advanced assistive technology can restore creative agency to individuals with severe physical limitations.”

This event signals a shift in assistive technology from purely functional utility, such as basic communication, to complex creative expression. The convergence of AI and brain-computer interfaces suggests a future where severe motor impairment no longer precludes professional artistic output, potentially expanding the field of inclusive design and neuro-rehabilitation.