I built this mixed reality instrument back in 2019 I believe. Affordable AR headsets didn’t exist yet so I build my own with a VR headset from Walmart and Arduino parts.
The player sees synthesizer controls overlaying a video feed from the little camera at his third eye. He holds lights in his hands which are tracked and trigger the various controls. The software is what I call “semi-generative.” The player makes big picture musical decisions about the general direction of the music while the computer intelligently fills in the individual notes and rhythms.