In April, Google introduced a new “multisearch” feature that offered a way to search the web using both text and images at the same time. Today, at Google’s I/O developer conference, the company announced an expansion to this feature, called “Multisearch Near Me.” This addition, arriving later in 2022, will allow Google app users to combine either a picture or a screenshot with the text “near me” to be directed to options for local retailers or restaurants that would have the apparel, home goods, or food you’re in search of. It’s also pre-announcing a forthcoming development to multisearch that appears to be built with AR glasses in mind, as it can visually search across multiple objects in a scene based on what you’re currently “seeing” via a smartphone camera’s viewfinder.

With the new “near me” multisearch query, you’ll be able to find local options related to your current visual and text-based search combination. For example, if you were working on a DIY project and came across a part that you needed to replace, you could snap a photo of the part with your phone’s camera to identify it and then find a local hardware store that has a replacement in stock.

This isn’t all that different from how multisearch already works, Google explains — it’s just adding the local component.

google’s new ‘multisearch’ features hint towards an ar glasses future

Image Credits: Google

Originally, the idea with multisearch was to allow users to ask questions about an object in front of them and refine those results by color, brand, or other visual attributes. The feature today works best with shopping searches, as it allows users to narrow down product searches in a way that standard text-based web searches could sometimes struggle with. For instance, a user could snap a photo of a pair of sneakers, then add text to ask to see them in blue to be shown just those shoes in the color specified. They could choose to visit the website for the sneakers and immediately purchase them, as well. The expansion to include the “near me” option now simply limits the results further in order to point users to a local retailer where the given product is available.

In terms of helping users find local restaurants, the feature works similarly. In this case, a user could search based on a photo they found on a food blog or somewhere else on the web to learn what the dish is and which local restaurants might have the option on their menu for dine-in, pickup, or delivery. Here, Google Search combines the image with the intent that you’re in search of a nearby restaurant, and will scan across millions of images, reviews, and community contributions to Google Maps to find the local spot.

The new “near me” feature will be available globally in English and will roll out to more languages over time, Google says.

The more interesting addition to multisearch is the capability to search within a scene. In the future, Google says users will be able to pan their camera around to learn about multiple objects within that wider scene.

Google suggests the feature could be used to scan the shelves at a bookstore then see helpful several insights overlaid in front of you.

google’s new ‘multisearch’ features hint towards an ar glasses future

Image Credits: Google

“To make this possible, we bring together not only computer vision, natural language understanding, but we also bring that together with the knowledge of the web and on-device technology,” noted Nick Bell, Senior Director, Google Search. “So the possibilities and the capabilities of this are going to be huge and significant,” he noted.

The company — which came to the AR market early with its Google Glass release — didn’t confirm it had any sort of new AR glasses-type device in the works, but hinted at the possibility.

“With A.I. systems now, what’s possible today — and going to be possible over the next few years — just kind of unlocks so many opportunities,” said Bell. In addition to voice search, desktop, and mobile search, the company believes visual search will also be a bigger part of the future, he noted.

google’s new ‘multisearch’ features hint towards an ar glasses future

Image Credits: Google

“There are 8 billion visual searches on Google with Lens every single month now and that number is three times the size that it was just a year ago,” Bell continued. “What we’re definitely seeing from people is that the appetite and the desire to search visually is there. And what we’re trying to do now is lean into the use cases and identify where this is most useful,” he said. “I think as we think about the future of search, visual search is definitely a key part of that.”

The company, of course, is reportedly working on a secret project, codenamed Project Iris, to build a new AR headset with a projected 2024 release date. It’s easy to imagine not only how this scene-scanning capability could run on such a device, but also how any sort of image-plus-text (or voice!) search feature could be used on an AR headset. Imagine again looking at the pair of sneakers you liked, for instance, then asking a device to navigate to the nearest store you could make the purchase.

“Looking further out, this technology could be used beyond everyday needs to help address societal challenges, like supporting conservationists in identifying plant species that need protection, or helping disaster relief workers quickly sought through donations in times of need,” suggested Prabhakar Raghavan, Google Search SVP, speaking on stage at Google I/O.

Unfortunately, Google didn’t offer a timeframe for when it expected to put the scene-scanning capability into the hands of users, as the feature is still “in development.”

TECH NEWS RELATED

How to unlock computer using fingerprint on Android

Can you believe it, we can completely unlock the computer using fingerprint on Android with just the operations that TechtipsNReview.com will introduce and guide you to do right on your device. me. Instructions for setting up screen unlock with fingerprint on Galaxy Note 4 Enable fingerprint unlock on Galaxy S6 ...

View more: How to unlock computer using fingerprint on Android

We’ve found some stellar Pixel 6 deals that will save you up to £150

Both models have had their prices cut (iStock/The Independent) The Pixel 7 may be on the horizon, but the Pixel 6 is still the best Google phone you can buy right now – and one that has been made even better by a couple of deals we’ve found this ...

View more: We’ve found some stellar Pixel 6 deals that will save you up to £150

Chinese smartphone brands smell moolah in premium Android tablets space

Reuters China’s Xiaomi returned to the tablet space after eight years in April, with the Xiaomi Pad 5. Chinese brands with a strong grip over the smartphones segment are seeing an untapped market opportunity in the high-end Android tablets space, riding on the back of success in other screen segments ...

View more: Chinese smartphone brands smell moolah in premium Android tablets space

5 Ways to Use Named Ranges in Google Sheets

Want to get more efficient when working with ranges in your Google Sheets? While it’s often a matter of preference, there are situations where named ranges can be beneficial and make certain tasks easier. Why Name Ranges? First, you can easily edit named ranges to include more or fewer ...

View more: 5 Ways to Use Named Ranges in Google Sheets

Samsung Galaxy XCover Pro 2 Could be Marketed as Samsung Galaxy XCover6 Pro, Google Play Console Suggests

The Samsung Galaxy XCover Pro 2 is expected to launch sometime later this year. In the past, we spotted the device on the Geekbench listing, which revealed some key specifications and a couple of months back, the phone’s render and specifications were leaked revealing most of the details of ...

View more: Samsung Galaxy XCover Pro 2 Could be Marketed as Samsung Galaxy XCover6 Pro, Google Play Console Suggests

How to create a Gmail signature on iPhone and Android phones

Believe it or not, creating a Gmail signature on iPhone and Android phones will become extremely simple and easy if you follow the steps that TechtipsNReview.com wants to mention below. Let’s go with TechtipsNReview.com to learn about how to create a Gmail signature on your phone. Create signature for Email ...

View more: How to create a Gmail signature on iPhone and Android phones

Google reportedly delays Pixel Fold for a second time

Will this phone ever release?

View more: Google reportedly delays Pixel Fold for a second time

How to turn on and off keyboard sound on Android

In the article below, TechtipsNReview.com will answer many of your questions about turning on and off the keyboard sound on Android that many people are interested in. With the steps below, you will easily turn on or off the sound every time you compose a message, press and touch the ...

View more: How to turn on and off keyboard sound on Android

How to record Android screen with YouTube Gaming

Android 13 expected to use HUAWEI's EROFS file system format to save more space

Nothing Phone (1) release date and price just tipped to challenge Google Pixel 6a

Streets of Rage 4 is out now on Android and iOS

Democrats urge Google to limit location tracking to protect people seeking abortions

Google takes on OpenAI with flashy text-to-image generator

Fix common Youtube errors on Samsung TVs

Raven is an indie-developed scenic card game coming to iOS and Android on May 27th

Here’s How You Can Free Up More Space in Google Drive

Fix the error of not being able to watch YouTube on the phone

Apple Music Is Finally Integrated To Waze— Enjoying the Ride While Listening To Your Favorite Songs

Apple's U1 chip and Android brings UWB location tech to your car or home

OTHER TECH NEWS

Top Car News Car News