Have you ever noticed a stylish pair of shoes in a video and wanted to know where to buy them? Or maybe someone sent you a picture of a cool restaurant or a gadget, and you didn’t want to go through the hassle of typing a description into Google? Well, with Apple’s newly launched iOS 27, iPhone users have an easier solution. The Visual Intelligence feature can now recognize what’s on your screen, allowing you to search for objects, ask questions, or take action based on what your iPhone identifies. Apple also mentions that it can transform information from flyers or invitations directly into calendar events.
Samsung Galaxy and Google Pixel devices have a similar option called Google’s Circle to Search. This way, you can select an item on your screen and quickly dive into searching for more information without needing to switch apps.
So, how do these tools work? On a Samsung Galaxy, you can open Circle to Search by pressing and holding the Home button or the navigation handle, then choose what you want to identify.
Visual Intelligence in iOS 27 enhances the experience. Previously, it mostly focused on things in your environment—you could point your camera and get information about whatever was captured. Now, it expands to include items that are already displayed on your phone. For instance, if you’re watching a video and spot a lamp you like, you can simply take a screenshot to search for similar styles instead of fumbling around trying to describe it.
Another handy aspect is if you receive an event flyer in a message; instead of manually entering details into your calendar, Visual Intelligence can recognize the event information and suggest adding it for you.
Now, as for compatible devices, it’s important to note that not all iPhones that support iOS 27 will have Visual Intelligence. This feature is limited to newer models like the iPhone 15 Pro, iPhone 15 Pro Max, or the iPhone 16 and later. So, even if you’ve upgraded to iOS 27 on an older model, you might find these advanced tools missing due to hardware limitations.
If you want to try out Visual Intelligence, here’s a quick rundown: Open the app or screen with the content, take a screenshot by pressing the side button and the volume up button together, and then look at the Visual Intelligence tools that show up at the bottom. You can tap on “Search” for more information, swipe over an object to narrow your search, or ask questions regarding what’s on the screen. Depending on the content, options like “Add to Calendar” or “Read Aloud” might be available too.
Speaking of cameras, Visual Intelligence can also help you identify what’s in front of you. If you have a compatible iPhone, simply point your camera, hold down Camera Control, and choose from the options presented. There’s also a feature where you can use Siri for visual inquiries, although it’s still in beta, so availability may vary.
As for Samsung Galaxy users, they can use Circle to Search without taking a screenshot. The feature works on selected devices running Android 14 and later updates. Just ensure Circle to Search is enabled in your settings and then hold down the Home button or the navigation line to activate it.
Google Pixel devices also incorporate Circle to Search, albeit with some varying functions depending on the model. The overall process is similar—with options to select objects or text on-screen to perform a search.
In practical terms, these visual search options are great for shopping. If you see a piece of clothing in a video, you can try to select it and let your phone do the searching instead of coming up with the right keywords. They can also be helpful when traveling—perhaps you see an interesting landmark in someone’s photo, and this tool can help you figure out where it is.
Of course, text recognition is useful too. Both Visual Intelligence and Circle to Search can copy and translate text without the hassle of switching between apps, making it a smoother experience. Still, it’s wise to double-check the results, as these tools might not always get the context right.
Now, regarding privacy—it’s definitely something worth considering. Both Apple and Google have systems in place to process data responsibly. Apple claims that many of its requests happen directly on your device, which is a good step towards maintaining your privacy. It’s always a good practice to avoid using these features with highly sensitive information, like banking details or medical records.
Ultimately, I appreciate features that simplify our tasks, like searching for something I can already see. Apple’s recent update adds a robust way for iPhone users to use Visual Intelligence, making everyday interactions a bit more intuitive. While each system has its own style, they both enhance how we can interact with our digital environment while saving us time. How comfortable would you feel letting your phone analyze what’s on your screen? Or are there certain things you would prefer not to share?
