Exploring AirPods through an image on AppleInsider with Visual Intelligence
Apple has introduced a minor update to Visual Intelligence in iOS 26, but the ability to apply it to any image significantly enhances its utility, effectively doubling its functionality.
In earlier versions, Visual Intelligence was one of the standout features of the iPhone. By simply pointing the camera at an object and using the Camera Control, users could get detailed information about it.
While the Photos app could identify plants, Visual Intelligence expands on this by recognizing famous landmarks and even everyday buildings you’ve always been curious about.
Unlike Photos, which might tell you the Latin name of a plant, Visual Intelligence can break down the components of a complex coffee order.
In theory, Visual Intelligence can read dates on event posters and input them directly into your calendar. However, it struggles with certain poster designs, so it’s not foolproof—especially with musicians’ tour schedules—but it’s impressive when it works.
Previously, using Visual Intelligence required pointing your iPhone camera at the subject of interest. With iOS 26, Apple has removed this limitation.
Now you can utilize Visual Intelligence on any content displayed on your iPhone’s screen.
This enhancement allows researchers to learn about objects found on websites and enables shoppers to pause a YouTube video to identify items an influencer is wearing.
However, the introduction of two different methods to use Visual Intelligence means users must follow distinct steps for each, even with Apple eliminating the requirement for the Camera Control button in 2024.
How to Use Traditional Visual Intelligence
To employ the original Visual Intelligence functionality, point your iPhone at the object you’re interested in and then follow these steps:
- Press and hold the Camera Control button
- Press the Action Button
- From the Lock Screen, tap a Visual Intelligence button
- Access the Control Center and tap a Visual Intelligence button
If your iPhone has a Camera Control button, you are set up for Visual Intelligence without requiring further action. You can still use the other options if you prefer.
To add Visual Intelligence to the Action Button, navigate to Settings > Action Button, and swipe to Controls.
Capture a screenshot (left), highlight your interest (middle), and get information (right)
For Control Center, swipe down to open it, then press and hold a blank area. Select Add a Control, then search for Visual Intelligence.
Alternatively, you can activate Visual Intelligence from the Lock Screen. Press and hold until the option to Customize appears, then add the Visual Intelligence control.
These methods let you use Visual Intelligence in its original capacity, yet they do not access the new version.
How to Use the New Version of Visual Intelligence
The new functionality supplements, rather than replaces, the existing Visual Intelligence features. While previous options remain useful, a different set of steps is required to apply Visual Intelligence to anything on your screen.
- Take a screenshot by pressing the volume up and sleep/wake buttons
- Highlight the area of interest with your finger
- Ask a question or perform an image search
When you circle an area, it will shimmer with a new Siri-style animation. You can then tap the Ask button to type a question or swipe up for image search results.
Some results may link to retailers, allowing you to purchase items directly.
Apple has promoted this feature as user-friendly, akin to the familiar process of taking screenshots. However, if you’re not used to capturing screenshots, it adds another layer of complexity to learn.
With various ways to utilize Visual Intelligence, one of which provides unique services, the ability to recognize nearly anything depicted on your screen represents a significant advantage. Apple has greatly expanded the functionality of Visual Intelligence by eliminating the prior necessity of using the camera.
It would be even more beneficial if this version of Visual Intelligence could be introduced to the iPad or Mac.