When I initially reached out to touch the floating holographic button in front of my face, I was surprised to feel it being pressed. The sEMG band I wore, equipped with a small haptic engine, made this possible. Tapping the virtual button felt real, and I was eager to explore its capabilities further!
Android Central Labs
Android Central Labs is a weekly column devoted to deep dives, experiments, and a focused look into the tech you use. It covers phones, tablets, and everything in between.
Almost every Sci-fi movie features a futuristic computer with a holographic display controlled by hand waves. However, the practical use of such interfaces is limited without touch. The sEMG band enables the feeling of virtual buttons and objects through a haptic engine, indicating Meta’s broader vision.
Meta aims to make XR as groundbreaking as the original iPhone with the commercial availability of AR smart glasses. The sEMG band, worn like a smartwatch, enhances hand tracking accuracy by translating muscle movements into actions.
The band offers a more private input option than voice commands, preserving attention on the surroundings rather than a physical device. It’s an ideal control method for Meta’s future AR glasses, as outlined in their recent white paper.
Orion is the North Star
Using a pair of smart glasses without this band is akin to using a smartphone without a touch screen. It can work, but the experience isn’t very good.
Meta’s AR glasses prototype, Meta Orion, relies on the sEMG band, emphasizing its necessity for upcoming AR smart glasses. Operating smart glasses without this band is like using a touchscreen-less smartphone, functional but lacking in user experience.
Termed as a “neural interface,” the sEMG band detects muscle signals for interaction with virtual objects. It enhances hand tracking precision and subtlety, offering a more personal and ergonomic input method for future smart glasses.
The band not only offers privacy and efficiency but also allows users to remain engaged in their environment. With Meta’s innovative approach, controlling next-gen smart glasses becomes seamless, as highlighted in their recent white paper.
How an sEMG band works
This is not a “brain-reading device” and cannot read your thoughts. It also cannot beam Zuck’s thoughts (or anyone else’s) into your head.
Unlike camera-dependent hand tracking, an sEMG band provides secondary input through wrist muscle activity. It interprets electrical impulses to understand various gestures with precision. It’s not a mind-reading device, as emphasized by Meta, debunking any misconceptions associated with the term “neural interface.”
The sensors come in contact with the skin and read electrical signals in your wrist muscles in the same non-invasive way a smartwatch reads your pulse.
The non-invasive sEMG band, resembling a smart ring, interacts with wrist muscles to enhance hand tracking accuracy. It differs from clinical EMG devices and offers a comfortable, discreet design suitable for everyday use.
Providing a natural and ergonomic way to interact with virtual interfaces, the sEMG band uses a haptic feedback engine to simulate touch sensations. This technology enhances user experience and could potentially replace traditional devices like tablets.
While Meta has not disclosed a release timeline for the band, it is expected to accompany the launch of their first smart glasses with a display, promising a revolutionary user interface experience.