Apple is exploring a new version of the Magic Mouse that would recognize gestures not only on its surface but also on the table beside it.
Since launching the original Magic Mouse in 2009 with multi-touch capabilities, Apple has updated the design and sparked speculation about future enhancements.
Most rumors have focused on the frequently criticized placement of the USB-C charging port on the bottom, leaving no hint that Apple was considering expanding gesture recognition.
However, a recently granted patent titled “Electronic devices with extended input-output capabilities” shows that Apple is indeed pursuing this idea, with a focus on recognizing gestures made around the mouse.
According to the patent, “A mouse or other electronic pointing device may have an array of sensors on a housing sidewall configured to gather information on the location of a user’s finger in an area adjacent to the device.” These sensors may include optical components like LEDs or lasers, as well as capacitive technologies that detect finger movements nearby.
This could enable users to perform “three-dimensional gestures” by moving their hands or fingers in the air near the device.
Future iterations of the Magic Mouse might incorporate some gesture detection capabilities similar to those used in the Apple Vision Pro. The patent mentions that gestures could be tracked using visible light and infrared cameras.
Additionally, the patent discusses the integration of projectors, which could display images onto surfaces. These projections could include interactive elements such as virtual buttons or icons that users can select with finger movements.
This technology could allow for a setup similar to laser-projected QWERTY keyboards, enabling users to tap on projected images on their desk, with the mouse recognizing and interpreting their selections.
The mouse could project an image for users to interact with—similar to a MacBook Pro.
While patents often anticipate various applications and innovations from competitors, this one notably extends beyond just the mouse. It mentions that similar technology could apply to:
- Trackpads or other pointing devices
- Laptop computers
- Monitors with built-in computers
- Tablet computers
- Mobile phones
- Media players
- Smartwatches
- Pendants
- Headphones or earpieces
- Headsets
The list goes on to include many other devices, suggesting that gestures made near these products could trigger various functions. For example, setting a coffee mug down could wake a Mac, while spreading fingers could emulate a pinch-to-zoom gesture.
Apple envisions this mouse or other device as a way to enhance user interaction without replacing traditional input methods. The device would track finger or hand movements nearby to supplement the information gathered from buttons and sensors.
Input could be used for various tasks, from adjusting icons on the screen to making text selections, allowing for more fluid and intuitive interactions.
Imagine bidding on an auction where you click a button to enter a price and then wave your hand to indicate how much you’re willing to go. Or, more practically, a flick of the wrist could navigate the cursor on the screen, similar to how a click near a button currently works.
As with all patents, it’s important to note that just because this concept exists in a patent doesn’t guarantee it will appear in future products.
The patent lists three inventors, including the prolific Paul X. Wang, who has a history of innovative patent contributions, such as replacing the old Touch Bar with an Apple Pencil holder.