DRAMATIC JAZZ

Dramatic Jazz is a mixed reality performance that explores the fusion of dance and voice within digital art. The performance was first presented at the SANAA building during the 2nd Symposium for Digital Arts and Teaching at Folkwang University of the Arts. It questions whether a dancer and a singer, together with Kanna Mori (dance) and Lilly Gocht (jazz vocals), can create a unified work of art through digital tools. Voice and movement merge within the digital realm, influencing each other in real time.

In this experimental collaboration, both performers explored digital tools such as projections, motion tracking, and virtual and mixed reality for the first time. With no prior experience in this field, they engaged in a process of discovery, learning how their artistic expressions could be translated into a digital space. A microphone records the singer’s voice, while a Kinect Azure captures the dancer’s movements. These data streams are then artistically transformed into a dynamic 2D visualization, which is projected for the audience to experience. A particularly fascinating aspect is the ability to see through the dancer’s eyes via the MR headset, offering a unique perspective on movement and interaction.

Our process is rooted in collaboration, sharing expertise across disciplines to foster a deeper understanding of each other's artistic fields. The results are presented in the form of a live performance, bringing the interplay of digital art, movement, and voice to the forefront. By integrating Augmented Reality (AR) within TouchDesigner, using a Quest 2, ZED Mini, and Kinect Azure, we navigate the evolving space of digital performance. The title “Dramatic Jazz” reflects our approach to reinterpreting jazz through digital expression, adding an individual, immersive layer to the genre.