This project is scheduled for launch
Launch date: Sunday, August 9, 2026 at 08:00 AM UTC
Gesture Synth is a free, browser-based gesture synthesizer that allows users to create music using hand movements captured by their device's camera. This innovative tool requires no downloads or sign-ups, with all processing and recordings remaining local to the user's device for enhanced privacy. Users can play music with both hands, shaping chords and tone in real-time. The interface provides visual feedback, displaying hand landmarks and chord information to help users connect their movements with the resulting sound.
The synthesizer offers intuitive control over musical elements. The left hand is primarily used to select chord degrees and shape the harmony, allowing users to switch between major and minor tonalities by tilting their hand. The right hand can then be introduced to control voicing, octave, volume, and filter settings, adding further depth and expression to the music. This two-handed approach enables a dynamic and responsive playing experience, turning simple gestures into complex musical expressions.
Gesture Synth comes equipped with a playable sound engine that supports 12 different musical keys. Users can also choose from three distinct synth waveforms: Warm Synth, Bright Synth, and Retro Synth, allowing for a variety of sonic textures. The system is designed to be immediately responsive, with the sound engine reacting instantly to changes in hand position. This immediate feedback loop is crucial for learning and experimentation, enabling users to explore musical ideas as they arise.
For those who wish to capture their creations, Gesture Synth offers a local MP4 performance recording feature. This allows users to record their live synth display, complete with generated audio, for up to five minutes. The recording process is straightforward: once the user initiates recording, the browser may request microphone access to combine audio with the visual performance. The resulting MP4 file can then be downloaded directly from the browser, ensuring that all creative output remains under the user's control and stays local.
廖家伟
Musicians, creators, and hobbyists looking for an innovative, accessible, and private way to create music using hand gestures directly in their web browser.
Comments will be available once the project is launched.