Gestura

Project Description

Gestura is a wearable device that revolutionizes the performing arts by empowering artists with cerebral palsy and limited speech abilities. Gestura represents a transformative approach to stage performance and real-time expression, transcending traditional boundaries of communication. It redefines the intersection of technology and art, extending its reach to artists across disciplines. As a gesture-based system, Gestura enables performers to manipulate the nuances of sounds and visuals through the simple movement of their fingers or arms. This innovative technology not only expands the realm of possibility for those with speech limitations but also offers a new dimension of expression for the artistically adventurous. Each movement becomes a brush stroke in a stage canvas, allowing the seamless integration of sound and visuals with physical expression. Gestura's user-centric design is the cornerstone of its inclusivity, inviting individuals to customize its functions to their unique expressive body language. It is a testament to the power of adaptive technology to not just overcome barriers but to create an entirely new lexicon of artistic vocabulary. With Gestura, the body speaks in tones, and movement resonates with the voice of creativity.

Video Demo

Technical Details

• Hand-made leather glove and arm strap that fits most people.
• Arduino Nano 33 IoT
  • Flex Sensors
  • Soft Potentiometer
  • Accelerometer
  • Gyroscope
  • Wifi
  • 9V Battery
• TouchDesigner - Visual
• Max/MSP/Jitte - Audio