Google Lens’ New Feature Uses AI for Contextual Video Search
May. 15, 2024The new Search with video feature inside Google Lens allows you to record videos of anything you’re curious about and share them with Google. It will thenuse Gemini to find the context of the videoand give you the answers you’re looking for.
Senior Director of Google Product Management, Rose Yao did a small live demonstration of how this feature. She recorded a video of a vinyl record player and asked why its tonearm is drifting without actually using the word “tonearm”. Gemini, however, picked up that shewanted to fix the tonearm and provided resultsaccordingly.
The customGeminimodel was able to pick up her voice from the uploaded video. It broke down the video frame-by-frame to learn the device’s make and model and detect motion to understand the issue. This feature goingto be available within Google Lensand you should be able to try it out in the coming weeks. Users will have to opt in on Google Search Labs.
This will make searching the web for problems a lot more accessible. Especially for users who have hand impairments, our grandparents who have a tough time navigating through Google searches. What do you think about this feature and are you excited to try it out? Let us know in the comments below.
As a tech journalist, I dive into the ever-evolving tech landscape with a particular interest for smartphones, apps, and gaming. With a passion for sharing insights, my articles blend expertise with a friendly touch—think of me as your friendly neighborhood tech support.
