More Gemini Features Coming to Google TV
Google TV integrates Gemini AI for image/video generation, enhances Google Photos, and adds a dedicated YouTube Shorts feed to the homepage.
Read moreGoogle's AVIS attempts to answer questions about images that are not easily obtainable, such as the date of establishment of an airline or the year of car manufacturing.
Recent advancements in large language models (LLMs) have made multimodal capabilities possible, such as image captioning and visual question answering. However, these visual language models (VLMs) still face difficulties in complex real-world visual reasoning that requires external knowledge, known as "visual information seeking".
To address this limitation, Google researchers propose a new approach called AVIS, which combines Google's PALM with computer vision, web search, and image search tools. With the help of these tools, AVIS autonomously searches for visual information within a dynamic framework using language models.
Google's AVIS learns from humans
Unlike previous systems that combine large language models with tools in a strict two-step process, AVIS is more flexible for planning and reasoning, enabling actions to be adjusted based on real-time feedback.
AVIS consists primarily of the following three components:
The planner and inferencer are iteratively used, with the planner determining the next tool and query based on the updated state by the inferencer. This process continues until the inferencer determines that there is enough information to provide a final answer.
Additionally, three types of tools are integrated:
To fully leverage these capabilities, researchers conducted a user study capturing common sequences of actions taken by humans using visual reasoning tools for decision-making and constructed a transition graph guiding AVIS behavior.
AVIS achieves state-of-the-art performance without fine-tuning
On the Infoseek dataset, AVIS achieves an accuracy of 50.7%, significantly outperforming fine-tuned visual language models such as OFA and PaLI. On the OK-VQA dataset, AVIS achieves an accuracy of 60.2% with fewer examples, surpassing most previous achievements and approaching fine-tuned models, according to Google.
In the future, the research team aims to explore their framework on other reasoning tasks and attempt to use lighter language models, as the current PALM model used is computationally intensive with 540 billion parameters.
Summary
Google TV integrates Gemini AI for image/video generation, enhances Google Photos, and adds a dedicated YouTube Shorts feed to the homepage.
Read moreAlphabet Q1 paid subscribers reached 350M, fueled by YouTube & Google One. YouTube ad revenue slightly missed at $9.88B amid Premium growth. Total Q1 revenue hit $109.9B, beating forecasts.
Read moreAnthropic releases Claude connectors for Adobe, Blender, and Ableton, enabling AI workflow automation and app control. It also sponsors the Blender Development Foundation.
Read moreApple introduces an App Store model splitting 12-month plans into monthly installments. On iOS 26.4+, it lowers upfront costs without reducing total price, adding billing tracking.
Read moreGoogle launches Aadhaar digital IDs in Wallet for India, enabling secure QR/NFC verification. A phased partner rollout targets key sectors, while passport-based credentials expand globally.
Read moreYouTube tests "Ask YouTube," an AI tool blending text and video for complex queries. Initially for US Premium users, it supports interactive follow-ups, expanding Google's AI search.
Read moreGoogle grants US DoD classified AI access, joining OpenAI and xAI in defense deals amid Anthropic's dispute. Contractual safeguards against surveillance and lethal weapons remain unenforceable.
Read moreMistral AI launches Workflows, a Temporal-powered orchestration platform for secure, Python-driven enterprise AI automation featuring human-in-the-loop approvals.
Read moreCustom subliminal audio maker

AI Social Media Manager

AI Search Visibility

Workout and Calorie Tracker
Stock research platform

AI interview assistant

Scientific figure generator

AI courses with real code