More Gemini Features Coming to Google TV
Google TV integrates Gemini AI for image/video generation, enhances Google Photos, and adds a dedicated YouTube Shorts feed to the homepage.
Read moreIt seems that human-like artificial intelligence chatbots have emerged. These chatbots rely on large language models, which are a special type of neural network. However, a new study suggests that large language models still tend to mistake meaningless content for natural language. For the research team at Columbia University, this flaw could point to ways to improve chatbot performance and help uncover how humans process language.
In a paper published online in Nature Machine Intelligence, scientists describe how they had nine different language models output hundreds of sentence pairs. For each pair, participants in the study were asked to choose which sentence they believed was more natural, meaning it was more likely to be seen or heard in everyday life. The researchers then tested these models to see if they would rate each sentence pair in the same way as humans.
In one-on-one tests, the more complex artificial intelligence based on what the researchers called transformer neural networks often performed better than simple recurrent neural network models and statistical models that only counted word pair frequencies in the internet or online databases. However, all models made mistakes and sometimes chose sentences that sounded like gibberish to humans.
"The impressive performance of some large language models suggests that they capture important information that simpler models miss," said Dr. Nikolaus Kriegeskorte, head of the Zuckerman Institute at Columbia University and co-author of the paper. He added, "Even the best models we studied are still fooled when it comes to recognizing meaningless sentences, indicating that their computational processes are missing something when it comes to handling human language."
Consider the following sentence pair evaluated by human participants and artificial intelligence in the study:
1. That is the narrative we have been sold.
2. This is the week you have been dying.
In this study, people judged the first sentence to be more likely encountered. However, according to the better model BERT, the second sentence is more natural. The most well-known model, GPT-2, correctly judged the first sentence to be more natural, consistent with human judgment.
"Each model has blind spots, marking some sentences that human participants consider gibberish as meaningful," said Dr. Christopher Baldassano, a senior author of the paper. He said, "This should raise doubts about whether artificial intelligence systems should make important decisions, at least for now."
One of the most interesting findings for Dr. Kriegeskorte is the good but imperfect performance of many models. "Understanding the existence of this gap and why some models perform better than others can drive progress in language models," said Dr. Kriegeskorte.
For the research team, another key question is whether the computational processes of AI chatbots can inspire new scientific questions and hypotheses to help neuroscientists better understand the human brain. Can the way these chatbots work point to certain characteristics of our brain's circuits?
Further analysis of various chatbots and their underlying algorithms' strengths and weaknesses may help answer this question.
"Ultimately, we are interested in understanding how people think," said Dr. Tal Golan, the corresponding author of the paper. He said, "These AI tools are becoming increasingly powerful, but they process language differently from us. Comparing their language understanding with ours allows us to think about our thinking in new ways."
Google TV integrates Gemini AI for image/video generation, enhances Google Photos, and adds a dedicated YouTube Shorts feed to the homepage.
Read moreAlphabet Q1 paid subscribers reached 350M, fueled by YouTube & Google One. YouTube ad revenue slightly missed at $9.88B amid Premium growth. Total Q1 revenue hit $109.9B, beating forecasts.
Read moreAnthropic releases Claude connectors for Adobe, Blender, and Ableton, enabling AI workflow automation and app control. It also sponsors the Blender Development Foundation.
Read moreApple introduces an App Store model splitting 12-month plans into monthly installments. On iOS 26.4+, it lowers upfront costs without reducing total price, adding billing tracking.
Read moreGoogle launches Aadhaar digital IDs in Wallet for India, enabling secure QR/NFC verification. A phased partner rollout targets key sectors, while passport-based credentials expand globally.
Read moreYouTube tests "Ask YouTube," an AI tool blending text and video for complex queries. Initially for US Premium users, it supports interactive follow-ups, expanding Google's AI search.
Read moreGoogle grants US DoD classified AI access, joining OpenAI and xAI in defense deals amid Anthropic's dispute. Contractual safeguards against surveillance and lethal weapons remain unenforceable.
Read moreMistral AI launches Workflows, a Temporal-powered orchestration platform for secure, Python-driven enterprise AI automation featuring human-in-the-loop approvals.
Read moreCustom subliminal audio maker

AI Social Media Manager

AI Search Visibility

Workout and Calorie Tracker
Stock research platform

AI interview assistant

Scientific figure generator

AI courses with real code