Musical Fingers is a two-glove instrument built with Jaiden Grimminck at Makeathon.
copper pads / IMU → Pico + Arduino nano → UART → serial-to-WebSocket relays → Python looper → LooperX UI- Right glove — copper finger pads wired through Raspberry Pi Pico ADCs; tapping a finger triggers drum hits, piano notes, or synth chords.
- Left glove — an MPU6050 IMU and four buttons read by an Arduino nano: yaw gestures modulate pitch/playback rate and volume in real time, while the buttons toggle loop recording, switch instruments, and reset loops.
- Looper — a Python audio engine (numpy + sounddevice) on the host runs an 8-beat looper that records and replays finger patterns across multiple tracks.
- LooperX — a Next.js control-surface UI listening on a compact binary WebSocket protocol for beat ticks and looper state.
- Gemini remix — holding a button sends the current loop to Gemini, which returns a re-arranged groove that’s parsed and applied live.
