Google's New AI Search Feature Disrupts Mobile User Experience

On Wednesday, Google launched an improved multiple search feature in Lens, which allows you to add text-based queries to photos and receive AI-driven answers, not just visual matches.

The AI-driven overview on multiple search results will be launched this week in the US English environment. The best part of the launch is that you don't need to access this feature through Search Labs as it is not part of the Google Search experience.

All you need to do is click on the Lens camera icon in the Google app for Android or iOS, take a photo or select an existing one, add a text question, and you will receive a generative AI reply.

Google is also introducing a "Circle to Search" feature, which allows users to search by circling, highlighting, doodling, or tapping on anything on their Android screens, and the searched information will pop up.

For example, if you see an accessory you like in a TikTok video while browsing, all you have to do is circle it, and you will be redirected to similar products on Google.

However, this feature is only available for certain high-end Android smartphones, including Pixel 8, Pixel 8 Pro, and the new Galaxy S24 series starting from January 31. To start using it, simply long-press the navigation bar or home screen button on the selected Android phone.

The newly launched Galaxy S24 series will be equipped with powerful generative AI and will utilize Imagen 2, Google's most advanced text-to-image diffusion technology, as well as Gemini, Google's most capable foundational AI model, to support Samsung's built-in apps and services.

For example, according to Google, Samsung's Notes, Voice Recorder, and Keyboard apps on the Galaxy S24 series will provide better summarization functionality with Gemini Pro. A lighter model version, Gemini Nano, will be used for a new feature in Google Messages to ensure better data protection. Imagen 2 will be used to support intuitive photo editing in Generative Edit.

Lastly, Galaxy S24 users will have an optimized Android Auto experience. This feature will use AI to automatically summarize long texts or busy group chats and provide relevant replies while you're driving. Android Auto will also soon integrate into elements on your phone, such as wallpapers and icons, to provide a more seamless transition.