Google adds multimodal possibilities to Chatbot from AI -oriented mode, which enable “seeing” and answering questions about images, because it expands access to AI mode to “millions more” users.
The update combines the custom version of AI Gemini with the technology for recognizing the company’s lens image, enabling users to search AI mode to receive or send the image and receive “a rich, comprehensive answer with links” about its content. Multimodal update for AI is available today and you can access Google on Android and iOS.
“AI mode is based on our years of work on visual search and goes a step further,” says Robby Stein, product vice president to Google Search. “Thanks to the multimodal capabilities, Gemini AI can understand the whole scene in the image, including the context of how objects relate to each other and their unique materials, colors, shapes and arrangements.”
Google claims that the update uses the “fan technique”, which gave many inquiries regarding the image it sees, and all objects in it to provide answers that are “extremely refined and significant contextual”. This allows you to do things such as identification of books that are displayed in the image, suggestions about similar titles with positive ratings and answering questions for further vicarrows.
The AI mode for the search engine serves as Google’s response to embarrassment and chatgPT, the impressions similar to Chatbot, which responds to queries with the summaries generated by AI drawn from everything in the Google search index.
AI mode launched only for Google One AI Premium subscribers last month, although only in laboratories. Now Google claims that he has started to share AI mode for “millions more” users of laboratories in the USA, except for paying AI Premium subscribers.