We use our hands to interact with the world around us. Researchers have been using all kinds of sensors to capture data from these interactions. Soundbubble takes a different approach. As the name suggests, it is a virtual microphone that captures sound inside a bubble. It relies a user’s headset/glasses microphones and beamforming to create a virtual mic that tracks fingers in 3D space. It can capture subtle finger noises across surfaces, including skin to skin contact and micro gestures. The below video shows what this approach is all about.
As the researchers explain, Soundbubble can be used for interactive control of XR interfaces. It is also possible to attach a bubble to a thumb for app control. More information about this research can be found at the link below.
[HT]
